2023-10-18T17:04:39.059 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-18T17:04:39.060 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vshankar@teuthology --description fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/snaps}} --archive /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429128 --name vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi --verbose -- /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429128/orig.config.yaml 2023-10-18T17:04:39.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T17:04:39.266 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429128 branch: wip-vshankar-testing-pacific-20231016.091648 description: fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/snaps}} email: vshankar@redhat.com first_in_suite: false job_id: '7429128' kernel: client: branch: testing flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-vshankar-testing-pacific-20231016.091648 ceph: cephfs: max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: false mds op complaint time: 180 mds verify scatter: true mds_sleep_rank_change: 5000000.0 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - but it is still running - objects unfound and apparently lost - MDS_SLOW_METADATA_IO - MDS_TRIM sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-pacific-20231016.091648 sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 owner: scheduled_vshankar@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 7825 sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 sleep_before_teardown: 0 subset: 33/1024 suite: fs suite_branch: wip-vshankar-testing-pacific-20231016.091648 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 targets: smithi158.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi183.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - thrashosds: null - workunit: clients: all: - fs/snaps teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-16_12:48:28 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-18T17:04:39.267 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa; will attempt to use it 2023-10-18T17:04:39.267 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks 2023-10-18T17:04:39.268 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-18T17:04:39.270 INFO:teuthology.task.internal:Checking packages... 2023-10-18T17:04:39.294 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5' 2023-10-18T17:04:39.295 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-18T17:04:39.295 INFO:teuthology.packaging:ref: None 2023-10-18T17:04:39.295 INFO:teuthology.packaging:tag: None 2023-10-18T17:04:39.296 INFO:teuthology.packaging:branch: wip-vshankar-testing-pacific-20231016.091648 2023-10-18T17:04:39.296 INFO:teuthology.packaging:sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T17:04:39.296 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-vshankar-testing-pacific-20231016.091648 2023-10-18T17:04:39.441 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-100-gb4ddd52c-1focal 2023-10-18T17:04:39.442 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-18T17:04:39.448 INFO:teuthology.task.internal:no buildpackages task found 2023-10-18T17:04:39.449 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-18T17:04:39.466 INFO:teuthology.task.internal:Saving configuration 2023-10-18T17:04:39.484 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-18T17:04:39.491 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T17:04:39.518 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429128', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 16:57:50.031855', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-18T17:04:39.541 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429128', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 16:57:50.033954', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-18T17:04:39.541 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-18T17:04:39.548 INFO:teuthology.task.internal:roles: ubuntu@smithi158.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-10-18T17:04:39.548 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-10-18T17:04:39.548 INFO:teuthology.run_tasks:Running task console_log... 2023-10-18T17:04:39.625 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f436f4d2a60>, signals=[15]) 2023-10-18T17:04:39.626 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-18T17:04:39.633 INFO:teuthology.task.internal:Opening connections... 2023-10-18T17:04:39.634 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi158.front.sepia.ceph.com 2023-10-18T17:04:39.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:04:39.684 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi183.front.sepia.ceph.com 2023-10-18T17:04:39.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:04:39.735 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-18T17:04:39.741 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2023-10-18T17:04:39.766 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2023-10-18T17:04:39.766 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-10-18T17:04:39.816 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Ubuntu" 2023-10-18T17:04:39.816 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-18T17:04:39.816 INFO:teuthology.orchestra.run.smithi158.stdout:ID=ubuntu 2023-10-18T17:04:39.817 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE=debian 2023-10-18T17:04:39.817 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-18T17:04:39.817 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="20.04" 2023-10-18T17:04:39.817 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-18T17:04:39.817 INFO:teuthology.orchestra.run.smithi158.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-18T17:04:39.818 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-18T17:04:39.818 INFO:teuthology.orchestra.run.smithi158.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-18T17:04:39.818 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_CODENAME=focal 2023-10-18T17:04:39.818 INFO:teuthology.orchestra.run.smithi158.stdout:UBUNTU_CODENAME=focal 2023-10-18T17:04:39.819 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-10-18T17:04:39.845 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2023-10-18T17:04:39.852 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2023-10-18T17:04:39.853 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-10-18T17:04:39.859 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Ubuntu" 2023-10-18T17:04:39.859 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-18T17:04:39.860 INFO:teuthology.orchestra.run.smithi183.stdout:ID=ubuntu 2023-10-18T17:04:39.860 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE=debian 2023-10-18T17:04:39.860 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-18T17:04:39.860 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="20.04" 2023-10-18T17:04:39.861 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-18T17:04:39.861 INFO:teuthology.orchestra.run.smithi183.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-18T17:04:39.861 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-18T17:04:39.861 INFO:teuthology.orchestra.run.smithi183.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-18T17:04:39.862 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_CODENAME=focal 2023-10-18T17:04:39.862 INFO:teuthology.orchestra.run.smithi183.stdout:UBUNTU_CODENAME=focal 2023-10-18T17:04:39.862 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-10-18T17:04:39.887 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-18T17:04:39.897 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-18T17:04:39.904 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-18T17:04:39.904 DEBUG:teuthology.orchestra.run.smithi158:> test '!' -e /home/ubuntu/cephtest 2023-10-18T17:04:39.907 DEBUG:teuthology.orchestra.run.smithi183:> test '!' -e /home/ubuntu/cephtest 2023-10-18T17:04:39.913 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-18T17:04:39.920 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-18T17:04:39.920 DEBUG:teuthology.orchestra.run.smithi158:> test -z $(ls -A /var/lib/ceph) 2023-10-18T17:04:39.956 DEBUG:teuthology.orchestra.run.smithi183:> test -z $(ls -A /var/lib/ceph) 2023-10-18T17:04:39.971 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-18T17:04:40.030 INFO:teuthology.run_tasks:Running task kernel... 2023-10-18T17:04:40.045 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-18T17:04:40.046 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-10-18T17:04:40.046 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-10-18T17:04:40.047 DEBUG:teuthology.orchestra.run.smithi158:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-18T17:04:40.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T17:04:40.053 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-10-18T17:04:40.218 DEBUG:teuthology.task.kernel:sha1 for client.0 is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T17:04:40.219 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-18T17:04:40.219 DEBUG:teuthology.orchestra.run.smithi158:> uname -r 2023-10-18T17:04:40.226 INFO:teuthology.orchestra.run.smithi158.stdout:5.4.0-124-generic 2023-10-18T17:04:40.226 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T17:04:40.226 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-18T17:04:40.227 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-10-18T17:04:40.227 DEBUG:teuthology.orchestra.run.smithi158:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-10-18T17:04:40.245 INFO:teuthology.orchestra.run.smithi158.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-10-18T17:04:40.357 INFO:teuthology.orchestra.run.smithi158.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-10-18T17:04:40.359 DEBUG:teuthology.orchestra.run.smithi158:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-10-18T17:04:40.438 DEBUG:teuthology.orchestra.run.smithi158:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-10-18T17:04:40.455 DEBUG:teuthology.orchestra.run.smithi158:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-10-18T17:08:57.799 INFO:teuthology.orchestra.run.smithi158.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-10-18T17:08:57.800 INFO:teuthology.orchestra.run.smithi158.stderr: * [new branch] main -> origin/main 2023-10-18T17:08:57.855 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20190312 -> 20190312 2023-10-18T17:08:57.855 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20190416 -> 20190416 2023-10-18T17:08:57.855 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20190514 -> 20190514 2023-10-18T17:08:57.856 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20190618 -> 20190618 2023-10-18T17:08:57.856 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20190717 -> 20190717 2023-10-18T17:08:57.856 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20190815 -> 20190815 2023-10-18T17:08:57.856 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20190923 -> 20190923 2023-10-18T17:08:57.856 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20191022 -> 20191022 2023-10-18T17:08:57.857 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20191215 -> 20191215 2023-10-18T17:08:57.857 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20200122 -> 20200122 2023-10-18T17:08:57.859 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20200316 -> 20200316 2023-10-18T17:08:57.859 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20200421 -> 20200421 2023-10-18T17:08:57.859 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20200519 -> 20200519 2023-10-18T17:08:57.859 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20200619 -> 20200619 2023-10-18T17:08:57.859 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20200721 -> 20200721 2023-10-18T17:08:57.860 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20200817 -> 20200817 2023-10-18T17:08:57.860 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20200918 -> 20200918 2023-10-18T17:08:57.860 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20201022 -> 20201022 2023-10-18T17:08:57.860 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20201118 -> 20201118 2023-10-18T17:08:57.860 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20201218 -> 20201218 2023-10-18T17:08:57.861 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20210208 -> 20210208 2023-10-18T17:08:57.861 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20210315 -> 20210315 2023-10-18T17:08:57.861 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20210511 -> 20210511 2023-10-18T17:08:57.861 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20210716 -> 20210716 2023-10-18T17:08:57.861 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20210818 -> 20210818 2023-10-18T17:08:57.864 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20210919 -> 20210919 2023-10-18T17:08:57.864 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20211027 -> 20211027 2023-10-18T17:08:57.864 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20211216 -> 20211216 2023-10-18T17:08:57.864 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20220209 -> 20220209 2023-10-18T17:08:57.865 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20220310 -> 20220310 2023-10-18T17:08:57.865 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20220411 -> 20220411 2023-10-18T17:08:57.865 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20220509 -> 20220509 2023-10-18T17:08:57.865 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20220610 -> 20220610 2023-10-18T17:08:57.865 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20220708 -> 20220708 2023-10-18T17:08:57.866 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20220815 -> 20220815 2023-10-18T17:08:57.866 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20220913 -> 20220913 2023-10-18T17:08:57.866 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20221012 -> 20221012 2023-10-18T17:08:57.866 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20221109 -> 20221109 2023-10-18T17:08:57.866 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20221214 -> 20221214 2023-10-18T17:08:57.867 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20230117 -> 20230117 2023-10-18T17:08:57.867 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20230210 -> 20230210 2023-10-18T17:08:57.867 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20230310 -> 20230310 2023-10-18T17:08:57.867 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20230404 -> 20230404 2023-10-18T17:08:57.867 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20230515 -> 20230515 2023-10-18T17:08:57.868 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20230625 -> 20230625 2023-10-18T17:08:57.868 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20230804 -> 20230804 2023-10-18T17:08:57.868 INFO:teuthology.orchestra.run.smithi158.stderr: * [new tag] 20230919 -> 20230919 2023-10-18T17:09:01.551 INFO:teuthology.orchestra.run.smithi158.stderr:Updating files: 52% (1656/3161) Updating files: 53% (1676/3161) Updating files: 54% (1707/3161) Updating files: 55% (1739/3161) Updating files: 56% (1771/3161) Updating files: 57% (1802/3161) Updating files: 58% (1834/3161) Updating files: 59% (1865/3161) Updating files: 60% (1897/3161) Updating files: 61% (1929/3161) Updating files: 62% (1960/3161) Updating files: 63% (1992/3161) Updating files: 64% (2024/3161) Updating files: 65% (2055/3161) Updating files: 66% (2087/3161) Updating files: 66% (2108/3161) Updating files: 67% (2118/3161) Updating files: 68% (2150/3161) Updating files: 69% (2182/3161) Updating files: 70% (2213/3161) Updating files: 71% (2245/3161) Updating files: 72% (2276/3161) Updating files: 73% (2308/3161) Updating files: 74% (2340/3161) Updating files: 75% (2371/3161) Updating files: 76% (2403/3161) Updating files: 77% (2434/3161) Updating files: 78% (2466/3161) Updating files: 79% (2498/3161) Updating files: 80% (2529/3161) Updating files: 81% (2561/3161) Updating files: 81% (2590/3161) Updating files: 82% (2593/3161) Updating files: 83% (2624/3161) Updating files: 84% (2656/3161) Updating files: 85% (2687/3161) Updating files: 86% (2719/3161) Updating files: 87% (2751/3161) Updating files: 88% (2782/3161) Updating files: 89% (2814/3161) Updating files: 90% (2845/3161) Updating files: 91% (2877/3161) Updating files: 92% (2909/3161) Updating files: 93% (2940/3161) Updating files: 94% (2972/3161) Updating files: 95% (3003/3161) Updating files: 96% (3035/3161) Updating files: 97% (3067/3161) Updating files: 98% (3098/3161) Updating files: 99% (3130/3161) Updating files: 100% (3161/3161) Updating files: 100% (3161/3161), done. 2023-10-18T17:09:01.555 INFO:teuthology.orchestra.run.smithi158.stdout:HEAD is now at 8ff933de Merge branch 'robot/pr-0-1697570762' into 'main' 2023-10-18T17:09:01.571 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.0... 2023-10-18T17:09:01.572 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T17:09:01.871 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/ 2023-10-18T17:09:01.872 DEBUG:teuthology.orchestra.run.smithi158:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-rc5-g47672119149b_6.6.0-rc5-g47672119149b-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/ --input-file=- 2023-10-18T17:09:01.875 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi158.front.sepia.ceph.com to complete... 2023-10-18T17:09:04.601 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18 17:09:04 URL:https://4.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/linux-image-6.6.0-rc5-g47672119149b_6.6.0-rc5-g47672119149b-1_amd64.deb [38904644/38904644] -> "/tmp/linux-image.deb" [1] 2023-10-18T17:09:04.601 INFO:teuthology.orchestra.run.smithi158.stderr:FINISHED --2023-10-18 17:09:04-- 2023-10-18T17:09:04.602 INFO:teuthology.orchestra.run.smithi158.stderr:Total wall clock time: 2.7s 2023-10-18T17:09:04.602 INFO:teuthology.orchestra.run.smithi158.stderr:Downloaded: 1 files, 37M in 2.5s (15.0 MB/s) 2023-10-18T17:09:04.603 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.0... 2023-10-18T17:09:04.603 DEBUG:teuthology.orchestra.run.smithi158:> sudo dpkg -i /tmp/linux-image.deb 2023-10-18T17:09:04.924 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package linux-image-6.6.0-rc5-g47672119149b. 2023-10-18T17:09:06.789 INFO:teuthology.orchestra.run.smithi158.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-10-18T17:09:06.794 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-10-18T17:09:06.970 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-image-6.6.0-rc5-g47672119149b (6.6.0-rc5-g47672119149b-1) ... 2023-10-18T17:09:10.117 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-image-6.6.0-rc5-g47672119149b (6.6.0-rc5-g47672119149b-1) ... 2023-10-18T17:09:10.273 INFO:teuthology.orchestra.run.smithi158.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-18T17:09:36.136 INFO:teuthology.orchestra.run.smithi158.stderr:Sourcing file `/etc/default/grub' 2023-10-18T17:09:36.144 INFO:teuthology.orchestra.run.smithi158.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-18T17:09:36.171 INFO:teuthology.orchestra.run.smithi158.stderr:Generating grub configuration file ... 2023-10-18T17:09:36.550 INFO:teuthology.orchestra.run.smithi158.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-18T17:09:36.573 INFO:teuthology.orchestra.run.smithi158.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-18T17:09:37.004 INFO:teuthology.orchestra.run.smithi158.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-18T17:09:37.017 INFO:teuthology.orchestra.run.smithi158.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-18T17:09:39.304 INFO:teuthology.orchestra.run.smithi158.stderr:done 2023-10-18T17:09:39.503 DEBUG:teuthology.orchestra.run.smithi158:> dpkg-deb -c /tmp/linux-image.deb 2023-10-18T17:09:39.513 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./ 2023-10-18T17:09:39.514 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./boot/ 2023-10-18T17:09:39.514 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 4415097 2023-10-10 19:59 ./boot/System.map-6.6.0-rc5-g47672119149b 2023-10-18T17:09:39.531 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 169298 2023-10-10 19:59 ./boot/config-6.6.0-rc5-g47672119149b 2023-10-18T17:09:39.531 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11352928 2023-10-10 19:59 ./boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-18T17:09:39.553 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/ 2023-10-18T17:09:39.553 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/ 2023-10-18T17:09:39.553 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/postinst.d/ 2023-10-18T17:09:39.553 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/postrm.d/ 2023-10-18T17:09:39.554 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/preinst.d/ 2023-10-18T17:09:39.554 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/prerm.d/ 2023-10-18T17:09:39.554 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/ 2023-10-18T17:09:39.554 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/ 2023-10-18T17:09:39.554 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/ 2023-10-18T17:09:39.555 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/ 2023-10-18T17:09:39.555 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/ 2023-10-18T17:09:39.555 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/ 2023-10-18T17:09:39.555 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ 2023-10-18T17:09:39.555 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 490233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/aesni-intel.ko 2023-10-18T17:09:39.558 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-18T17:09:39.558 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-18T17:09:39.559 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-18T17:09:39.559 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 93113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-18T17:09:39.559 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 106729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-18T17:09:39.559 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 152241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-18T17:09:39.559 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-18T17:09:39.560 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-18T17:09:39.560 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 83889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-18T17:09:39.560 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-18T17:09:39.560 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 47225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-18T17:09:39.560 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 47209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-18T17:09:39.561 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 51801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-18T17:09:39.561 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 38937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-18T17:09:39.561 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 40529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-18T17:09:39.561 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 58585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-18T17:09:39.561 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 50497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-18T17:09:39.562 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 32065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-18T17:09:39.562 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-18T17:09:39.562 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/ 2023-10-18T17:09:39.562 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/ 2023-10-18T17:09:39.563 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/ 2023-10-18T17:09:39.563 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 40113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-18T17:09:39.563 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpuid.ko 2023-10-18T17:09:39.563 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/msr.ko 2023-10-18T17:09:39.563 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/ 2023-10-18T17:09:39.564 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 353761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-18T17:09:39.564 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 881713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-18T17:09:39.564 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 2276817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-18T17:09:39.625 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ 2023-10-18T17:09:39.626 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 53761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/af_alg.ko 2023-10-18T17:09:39.626 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/algif_hash.ko 2023-10-18T17:09:39.626 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/algif_skcipher.ko 2023-10-18T17:09:39.626 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-18T17:09:39.627 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-18T17:09:39.627 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-18T17:09:39.627 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/asymmetric_keys/ 2023-10-18T17:09:39.627 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-10-18T17:09:39.627 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/ 2023-10-18T17:09:39.628 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-18T17:09:39.628 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-18T17:09:39.628 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-18T17:09:39.628 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-18T17:09:39.628 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-18T17:09:39.629 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-18T17:09:39.629 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-18T17:09:39.629 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-18T17:09:39.629 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-18T17:09:39.629 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-18T17:09:39.630 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-18T17:09:39.630 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 38873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-18T17:09:39.630 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-18T17:09:39.630 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-18T17:09:39.631 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-18T17:09:39.631 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 35097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-18T17:09:39.631 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-18T17:09:39.631 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-18T17:09:39.631 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 47505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cryptd.ko 2023-10-18T17:09:39.632 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 39505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-18T17:09:39.632 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_simd.ko 2023-10-18T17:09:39.632 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-18T17:09:39.632 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-18T17:09:39.632 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-18T17:09:39.633 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-18T17:09:39.633 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-18T17:09:39.633 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-18T17:09:39.633 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-18T17:09:39.633 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-18T17:09:39.634 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lrw.ko 2023-10-18T17:09:39.634 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-18T17:09:39.634 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-18T17:09:39.634 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-18T17:09:39.634 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-18T17:09:39.635 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-18T17:09:39.635 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-18T17:09:39.635 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-18T17:09:39.635 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-18T17:09:39.635 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-18T17:09:39.636 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 149193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-18T17:09:39.636 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-18T17:09:39.636 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-18T17:09:39.636 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-18T17:09:39.636 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-18T17:09:39.637 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-18T17:09:39.637 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-18T17:09:39.637 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-18T17:09:39.637 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xts.ko 2023-10-18T17:09:39.637 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-18T17:09:39.637 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ 2023-10-18T17:09:39.638 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ 2023-10-18T17:09:39.638 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_extlog.ko 2023-10-18T17:09:39.638 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-18T17:09:39.639 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-18T17:09:39.639 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/apei/ 2023-10-18T17:09:39.639 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 31241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/apei/einj.ko 2023-10-18T17:09:39.639 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-18T17:09:39.639 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-18T17:09:39.640 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-18T17:09:39.640 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-18T17:09:39.640 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 103025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-18T17:09:39.640 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ 2023-10-18T17:09:39.640 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-18T17:09:39.641 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 88865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci.ko 2023-10-18T17:09:39.641 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-18T17:09:39.641 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 88289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci.ko 2023-10-18T17:09:39.641 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-18T17:09:39.641 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-18T17:09:39.641 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-18T17:09:39.642 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-18T17:09:39.642 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-18T17:09:39.642 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-18T17:09:39.642 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-18T17:09:39.642 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-18T17:09:39.643 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-18T17:09:39.643 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-18T17:09:39.643 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-18T17:09:39.643 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-18T17:09:39.643 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-18T17:09:39.644 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-18T17:09:39.644 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-18T17:09:39.644 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-18T17:09:39.644 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 35273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-18T17:09:39.644 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-18T17:09:39.645 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 51481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_legacy.ko 2023-10-18T17:09:39.645 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-18T17:09:39.645 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-18T17:09:39.645 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-18T17:09:39.645 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-18T17:09:39.646 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-18T17:09:39.646 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-18T17:09:39.646 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-18T17:09:39.646 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-18T17:09:39.646 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-18T17:09:39.647 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 32585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-18T17:09:39.647 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 37793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-18T17:09:39.647 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-18T17:09:39.647 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-18T17:09:39.647 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_radisys.ko 2023-10-18T17:09:39.648 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-18T17:09:39.648 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rz1000.ko 2023-10-18T17:09:39.648 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-18T17:09:39.648 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-18T17:09:39.648 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-18T17:09:39.649 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-18T17:09:39.649 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-18T17:09:39.649 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-18T17:09:39.649 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-18T17:09:39.649 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-18T17:09:39.650 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 83345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-18T17:09:39.650 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 70393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-18T17:09:39.650 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 37377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-18T17:09:39.650 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-18T17:09:39.650 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-18T17:09:39.651 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 38337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-18T17:09:39.651 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-18T17:09:39.651 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-18T17:09:39.651 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 44793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-18T17:09:39.652 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-18T17:09:39.652 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 35065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-18T17:09:39.652 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-18T17:09:39.652 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ 2023-10-18T17:09:39.652 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-18T17:09:39.653 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/ 2023-10-18T17:09:39.653 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 124473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-18T17:09:39.653 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/ 2023-10-18T17:09:39.653 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/ 2023-10-18T17:09:39.653 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 113665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-18T17:09:39.654 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/ 2023-10-18T17:09:39.654 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 965585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-18T17:09:39.654 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 173225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-18T17:09:39.654 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/ 2023-10-18T17:09:39.654 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 94297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-18T17:09:39.655 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 115793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-18T17:09:39.655 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/ 2023-10-18T17:09:39.655 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 110449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-18T17:09:39.655 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 98193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-18T17:09:39.655 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 263769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-18T17:09:39.656 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/ 2023-10-18T17:09:39.656 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 98145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-18T17:09:39.656 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/ 2023-10-18T17:09:39.656 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 60217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-18T17:09:39.656 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ 2023-10-18T17:09:39.656 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/applicom.ko 2023-10-18T17:09:39.657 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-18T17:09:39.657 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/ 2023-10-18T17:09:39.657 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-18T17:09:39.657 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-18T17:09:39.657 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-18T17:09:39.658 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-18T17:09:39.658 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-18T17:09:39.658 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ 2023-10-18T17:09:39.658 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-18T17:09:39.658 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 148601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-18T17:09:39.659 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-18T17:09:39.659 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 139313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-18T17:09:39.659 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 70921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-18T17:09:39.659 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 53513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-18T17:09:39.659 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-18T17:09:39.660 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/ 2023-10-18T17:09:39.660 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 84097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-18T17:09:39.660 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/nvram.ko 2023-10-18T17:09:39.660 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 32169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-18T17:09:39.660 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 51113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-18T17:09:39.661 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/ 2023-10-18T17:09:39.661 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-18T17:09:39.661 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-10-18T17:09:39.661 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-10-18T17:09:39.661 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 32985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-10-18T17:09:39.662 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-18T17:09:39.662 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-18T17:09:39.662 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-10-18T17:09:39.662 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/ 2023-10-18T17:09:39.662 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_class.ko 2023-10-18T17:09:39.663 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 50945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_core.ko 2023-10-18T17:09:39.663 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-10-18T17:09:39.663 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/ 2023-10-18T17:09:39.663 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-palmas.ko 2023-10-18T17:09:39.663 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 47849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-si5351.ko 2023-10-18T17:09:39.664 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-twl6040.ko 2023-10-18T17:09:39.664 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-wm831x.ko 2023-10-18T17:09:39.664 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/ 2023-10-18T17:09:39.664 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-18T17:09:39.664 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-18T17:09:39.664 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-18T17:09:39.665 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ 2023-10-18T17:09:39.665 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ 2023-10-18T17:09:39.665 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 70801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-18T17:09:39.665 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 243025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-18T17:09:39.665 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/ 2023-10-18T17:09:39.666 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/ 2023-10-18T17:09:39.666 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/ 2023-10-18T17:09:39.666 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 438761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-18T17:09:39.666 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-10-18T17:09:39.666 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-18T17:09:39.667 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-18T17:09:39.667 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-18T17:09:39.667 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/ 2023-10-18T17:09:39.667 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 68857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-18T17:09:39.667 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/ 2023-10-18T17:09:39.668 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-18T17:09:39.668 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ 2023-10-18T17:09:39.668 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/ 2023-10-18T17:09:39.668 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-18T17:09:39.668 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ 2023-10-18T17:09:39.669 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 122569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-18T17:09:39.669 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ 2023-10-18T17:09:39.669 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 79953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-18T17:09:39.669 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 35769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-18T17:09:39.669 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 63617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-18T17:09:39.670 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-18T17:09:39.670 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-18T17:09:39.670 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-18T17:09:39.670 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-18T17:09:39.670 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-18T17:09:39.671 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 52041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-18T17:09:39.671 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-18T17:09:39.671 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-18T17:09:39.671 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 56825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-18T17:09:39.671 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-18T17:09:39.672 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/ 2023-10-18T17:09:39.672 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-gpio.ko 2023-10-18T17:09:39.672 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max14577.ko 2023-10-18T17:09:39.672 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max77693.ko 2023-10-18T17:09:39.672 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max8997.ko 2023-10-18T17:09:39.673 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-palmas.ko 2023-10-18T17:09:39.673 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-rt8973a.ko 2023-10-18T17:09:39.673 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-sm5502.ko 2023-10-18T17:09:39.673 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/ 2023-10-18T17:09:39.673 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/dmi-sysfs.ko 2023-10-18T17:09:39.674 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/efi/ 2023-10-18T17:09:39.674 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/efi/efi-pstore.ko 2023-10-18T17:09:39.674 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-18T17:09:39.674 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/ 2023-10-18T17:09:39.674 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-adp5520.ko 2023-10-18T17:09:39.675 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-amd8111.ko 2023-10-18T17:09:39.675 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-arizona.ko 2023-10-18T17:09:39.675 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-da9052.ko 2023-10-18T17:09:39.675 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-da9055.ko 2023-10-18T17:09:39.675 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-dln2.ko 2023-10-18T17:09:39.676 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 77849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-f7188x.ko 2023-10-18T17:09:39.676 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-generic.ko 2023-10-18T17:09:39.676 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-18T17:09:39.676 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-10-18T17:09:39.676 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-kempld.ko 2023-10-18T17:09:39.677 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-lp3943.ko 2023-10-18T17:09:39.677 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max7300.ko 2023-10-18T17:09:39.677 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max730x.ko 2023-10-18T17:09:39.677 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max732x.ko 2023-10-18T17:09:39.677 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-10-18T17:09:39.678 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 47073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-pca953x.ko 2023-10-18T17:09:39.678 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-pcf857x.ko 2023-10-18T17:09:39.678 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-rdc321x.ko 2023-10-18T17:09:39.678 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-sch.ko 2023-10-18T17:09:39.678 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-sch311x.ko 2023-10-18T17:09:39.679 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-tps65912.ko 2023-10-18T17:09:39.679 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-twl4030.ko 2023-10-18T17:09:39.679 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-twl6040.ko 2023-10-18T17:09:39.679 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-18T17:09:39.679 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-vx855.ko 2023-10-18T17:09:39.680 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm831x.ko 2023-10-18T17:09:39.680 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm8350.ko 2023-10-18T17:09:39.680 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm8994.ko 2023-10-18T17:09:39.680 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/ 2023-10-18T17:09:39.680 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-a4tech.ko 2023-10-18T17:09:39.681 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 39169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-apple.ko 2023-10-18T17:09:39.681 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-18T17:09:39.681 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-18T17:09:39.681 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-18T17:09:39.681 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-belkin.ko 2023-10-18T17:09:39.682 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cherry.ko 2023-10-18T17:09:39.682 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-chicony.ko 2023-10-18T17:09:39.682 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 60649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cp2112.ko 2023-10-18T17:09:39.682 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cypress.ko 2023-10-18T17:09:39.682 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-18T17:09:39.683 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-18T17:09:39.683 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-18T17:09:39.683 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-18T17:09:39.683 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ezkey.ko 2023-10-18T17:09:39.683 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-18T17:09:39.683 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-generic.ko 2023-10-18T17:09:39.684 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-18T17:09:39.684 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-18T17:09:39.684 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-18T17:09:39.684 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-18T17:09:39.684 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-18T17:09:39.685 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-18T17:09:39.685 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-18T17:09:39.685 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kensington.ko 2023-10-18T17:09:39.685 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-18T17:09:39.685 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-18T17:09:39.686 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-18T17:09:39.686 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-18T17:09:39.686 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 42361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-18T17:09:39.686 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lg-g15.ko 2023-10-18T17:09:39.686 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 58185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-18T17:09:39.687 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 101369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-18T17:09:39.687 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 80993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech.ko 2023-10-18T17:09:39.687 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-magicmouse.ko 2023-10-18T17:09:39.687 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-microsoft.ko 2023-10-18T17:09:39.687 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-monterey.ko 2023-10-18T17:09:39.688 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 50161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-18T17:09:39.688 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 32593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ntrig.ko 2023-10-18T17:09:39.688 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-18T17:09:39.688 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-18T17:09:39.688 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-18T17:09:39.689 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 72937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-18T17:09:39.689 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-18T17:09:39.689 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-18T17:09:39.689 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-18T17:09:39.689 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 35457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-18T17:09:39.690 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-18T17:09:39.690 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-18T17:09:39.690 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 31425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-18T17:09:39.690 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-18T17:09:39.690 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 31129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-18T17:09:39.691 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-18T17:09:39.691 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-18T17:09:39.691 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-18T17:09:39.691 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-18T17:09:39.691 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-18T17:09:39.692 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-18T17:09:39.692 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-18T17:09:39.692 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-18T17:09:39.692 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-18T17:09:39.692 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-18T17:09:39.693 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-18T17:09:39.693 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 51249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-18T17:09:39.693 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-18T17:09:39.693 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-18T17:09:39.693 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-18T17:09:39.693 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-18T17:09:39.694 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-18T17:09:39.694 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-18T17:09:39.694 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-18T17:09:39.694 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-18T17:09:39.695 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 71073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-18T17:09:39.695 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-18T17:09:39.695 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 143473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-18T17:09:39.695 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-18T17:09:39.695 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-18T17:09:39.695 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-18T17:09:39.696 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 267825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid.ko 2023-10-18T17:09:39.696 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 32321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-18T17:09:39.696 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/ 2023-10-18T17:09:39.696 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 125721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbhid.ko 2023-10-18T17:09:39.696 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbkbd.ko 2023-10-18T17:09:39.697 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbmouse.ko 2023-10-18T17:09:39.697 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 217873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-18T17:09:39.697 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/ 2023-10-18T17:09:39.697 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 64201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-18T17:09:39.697 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 89625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-18T17:09:39.698 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 305465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-18T17:09:39.698 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ 2023-10-18T17:09:39.698 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 66521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-18T17:09:39.698 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 61393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-18T17:09:39.699 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-18T17:09:39.699 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-18T17:09:39.699 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-18T17:09:39.699 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-18T17:09:39.699 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 31729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-18T17:09:39.700 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 97977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-18T17:09:39.700 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-18T17:09:39.700 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 45553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-18T17:09:39.700 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-18T17:09:39.700 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-18T17:09:39.700 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-18T17:09:39.701 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-18T17:09:39.701 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 74433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-18T17:09:39.701 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 39585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-18T17:09:39.701 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 67929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-18T17:09:39.701 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-18T17:09:39.702 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 39073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-18T17:09:39.702 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 55265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-18T17:09:39.702 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 49913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-18T17:09:39.702 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 58617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-18T17:09:39.702 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 40889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-18T17:09:39.703 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-18T17:09:39.703 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-18T17:09:39.703 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/da9052-hwmon.ko 2023-10-18T17:09:39.703 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/da9055-hwmon.ko 2023-10-18T17:09:39.704 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 44465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-18T17:09:39.704 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 99601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-18T17:09:39.704 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-18T17:09:39.704 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-18T17:09:39.704 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-18T17:09:39.704 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc2103.ko 2023-10-18T17:09:39.705 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-18T17:09:39.705 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 66985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-18T17:09:39.705 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 94457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-18T17:09:39.705 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 41401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-18T17:09:39.705 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-18T17:09:39.706 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 55449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-18T17:09:39.706 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-18T17:09:39.706 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-18T17:09:39.706 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 46801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-18T17:09:39.706 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 45529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-18T17:09:39.707 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hih6130.ko 2023-10-18T17:09:39.707 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-18T17:09:39.707 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-18T17:09:39.707 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-18T17:09:39.708 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-18T17:09:39.708 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-18T17:09:39.708 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-18T17:09:39.708 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-18T17:09:39.708 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 130449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-18T17:09:39.709 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/jc42.ko 2023-10-18T17:09:39.709 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-18T17:09:39.709 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-18T17:09:39.709 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-18T17:09:39.709 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 48601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-18T17:09:39.710 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-18T17:09:39.710 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-18T17:09:39.710 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-18T17:09:39.710 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-18T17:09:39.710 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 31745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-18T17:09:39.711 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-18T17:09:39.711 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 72833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-18T17:09:39.711 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 46153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-18T17:09:39.711 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 37913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-18T17:09:39.711 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-18T17:09:39.712 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 108841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-18T17:09:39.712 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-18T17:09:39.712 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-18T17:09:39.712 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-18T17:09:39.712 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-18T17:09:39.712 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-18T17:09:39.713 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-18T17:09:39.713 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-18T17:09:39.713 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-18T17:09:39.713 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-18T17:09:39.713 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-18T17:09:39.714 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-18T17:09:39.714 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-18T17:09:39.714 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-18T17:09:39.714 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-18T17:09:39.714 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-18T17:09:39.715 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-18T17:09:39.715 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 35777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-18T17:09:39.715 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mc13783-adc.ko 2023-10-18T17:09:39.715 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-18T17:09:39.715 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-10-18T17:09:39.716 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 44129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-18T17:09:39.716 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 119817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-18T17:09:39.716 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 60705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-18T17:09:39.716 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 59737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-18T17:09:39.716 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 82337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-18T17:09:39.717 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 54433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-18T17:09:39.717 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-18T17:09:39.717 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ 2023-10-18T17:09:39.717 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-18T17:09:39.717 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-18T17:09:39.718 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-18T17:09:39.718 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-18T17:09:39.718 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-18T17:09:39.718 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-18T17:09:39.718 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-18T17:09:39.718 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 82577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-18T17:09:39.719 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-18T17:09:39.719 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-18T17:09:39.719 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-18T17:09:39.719 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-18T17:09:39.719 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-18T17:09:39.720 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-18T17:09:39.720 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-18T17:09:39.720 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-18T17:09:39.720 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 32137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-18T17:09:39.720 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-18T17:09:39.721 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-18T17:09:39.721 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 40105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-18T17:09:39.721 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-18T17:09:39.721 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 39193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-18T17:09:39.721 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 37385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-18T17:09:39.722 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-18T17:09:39.722 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-18T17:09:39.722 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-18T17:09:39.722 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-18T17:09:39.722 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-18T17:09:39.723 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-18T17:09:39.723 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 41945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-18T17:09:39.723 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 52457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-18T17:09:39.723 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 51545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-18T17:09:39.723 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 57513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-18T17:09:39.724 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 78873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-18T17:09:39.724 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 71345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-18T17:09:39.724 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 63289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-18T17:09:39.724 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 71321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-18T17:09:39.724 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 101473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-18T17:09:39.725 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 119505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-18T17:09:39.725 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-18T17:09:39.725 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 35625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-18T17:09:39.725 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-10-18T17:09:39.725 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-10-18T17:09:39.725 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/ 2023-10-18T17:09:39.726 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/ 2023-10-18T17:09:39.726 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-18T17:09:39.726 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-18T17:09:39.726 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/ 2023-10-18T17:09:39.726 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-10-18T17:09:39.727 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-10-18T17:09:39.727 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-10-18T17:09:39.727 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-18T17:09:39.727 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-18T17:09:39.727 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-18T17:09:39.728 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-10-18T17:09:39.728 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 6929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-18T17:09:39.728 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-10-18T17:09:39.728 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 50201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-18T17:09:39.728 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-18T17:09:39.729 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-18T17:09:39.729 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-18T17:09:39.729 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-10-18T17:09:39.729 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-10-18T17:09:39.729 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 62817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-18T17:09:39.730 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-18T17:09:39.730 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 47889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-18T17:09:39.730 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-10-18T17:09:39.730 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-18T17:09:39.730 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-18T17:09:39.731 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-10-18T17:09:39.731 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-18T17:09:39.731 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-18T17:09:39.731 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 47241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-18T17:09:39.731 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-10-18T17:09:39.732 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-18T17:09:39.732 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-18T17:09:39.732 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-10-18T17:09:39.732 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-10-18T17:09:39.732 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-18T17:09:39.732 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-10-18T17:09:39.733 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-18T17:09:39.733 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-18T17:09:39.733 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-18T17:09:39.733 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-18T17:09:39.733 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 47657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-10-18T17:09:39.734 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-18T17:09:39.734 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-18T17:09:39.734 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-18T17:09:39.734 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/ 2023-10-18T17:09:39.735 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-10-18T17:09:39.735 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-10-18T17:09:39.735 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-10-18T17:09:39.735 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ 2023-10-18T17:09:39.735 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ 2023-10-18T17:09:39.736 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 273609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-18T17:09:39.736 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 879969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-18T17:09:39.736 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 69337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-18T17:09:39.736 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 324217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-18T17:09:39.736 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 97985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-18T17:09:39.736 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 282273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-18T17:09:39.737 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 66201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-18T17:09:39.737 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ 2023-10-18T17:09:39.737 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/ 2023-10-18T17:09:39.737 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 493073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-18T17:09:39.737 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/ 2023-10-18T17:09:39.738 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 419737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-18T17:09:39.738 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/ 2023-10-18T17:09:39.738 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 739025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-18T17:09:39.738 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ 2023-10-18T17:09:39.738 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 296625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-18T17:09:39.739 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ocrdma/ 2023-10-18T17:09:39.739 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 153697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-10-18T17:09:39.739 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/usnic/ 2023-10-18T17:09:39.739 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 168969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-10-18T17:09:39.739 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ 2023-10-18T17:09:39.740 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ 2023-10-18T17:09:39.740 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 263081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-18T17:09:39.740 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ 2023-10-18T17:09:39.740 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 100241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-18T17:09:39.740 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ 2023-10-18T17:09:39.741 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 111425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-18T17:09:39.741 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ 2023-10-18T17:09:39.741 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 128753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-18T17:09:39.741 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ 2023-10-18T17:09:39.741 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 129529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-18T17:09:39.742 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/ 2023-10-18T17:09:39.742 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/evbug.ko 2023-10-18T17:09:39.742 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/ff-memless.ko 2023-10-18T17:09:39.742 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/ 2023-10-18T17:09:39.742 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-18T17:09:39.743 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-18T17:09:39.743 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 41241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-18T17:09:39.743 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 41801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-18T17:09:39.743 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/ 2023-10-18T17:09:39.743 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-10-18T17:09:39.743 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-10-18T17:09:39.744 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-10-18T17:09:39.744 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-10-18T17:09:39.744 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-18T17:09:39.744 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-10-18T17:09:39.744 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lkkbd.ko 2023-10-18T17:09:39.745 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lm8323.ko 2023-10-18T17:09:39.745 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lm8333.ko 2023-10-18T17:09:39.745 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-10-18T17:09:39.745 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-10-18T17:09:39.745 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-10-18T17:09:39.746 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-10-18T17:09:39.746 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/newtonkbd.ko 2023-10-18T17:09:39.746 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-10-18T17:09:39.746 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/qt1070.ko 2023-10-18T17:09:39.746 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/qt2160.ko 2023-10-18T17:09:39.747 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-10-18T17:09:39.747 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/stowaway.ko 2023-10-18T17:09:39.747 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/sunkbd.ko 2023-10-18T17:09:39.747 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-10-18T17:09:39.747 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-10-18T17:09:39.748 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-10-18T17:09:39.748 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/xtkbd.ko 2023-10-18T17:09:39.748 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/matrix-keymap.ko 2023-10-18T17:09:39.748 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/ 2023-10-18T17:09:39.748 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-18T17:09:39.749 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-18T17:09:39.749 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 123681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-18T17:09:39.749 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 89449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-18T17:09:39.749 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/gpio_mouse.ko 2023-10-18T17:09:39.749 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 335977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/psmouse.ko 2023-10-18T17:09:39.750 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-18T17:09:39.750 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-18T17:09:39.750 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-18T17:09:39.750 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-18T17:09:39.750 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/ 2023-10-18T17:09:39.751 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 109873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-18T17:09:39.751 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ 2023-10-18T17:09:39.751 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-18T17:09:39.751 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-18T17:09:39.751 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ct82c710.ko 2023-10-18T17:09:39.752 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-18T17:09:39.752 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/parkbd.ko 2023-10-18T17:09:39.752 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/pcips2.ko 2023-10-18T17:09:39.752 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ps2mult.ko 2023-10-18T17:09:39.752 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-18T17:09:39.753 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serport.ko 2023-10-18T17:09:39.753 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-18T17:09:39.753 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/ 2023-10-18T17:09:39.753 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/ 2023-10-18T17:09:39.753 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 39289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-18T17:09:39.754 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/ 2023-10-18T17:09:39.754 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-88pm860x.ko 2023-10-18T17:09:39.754 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-adp5520.ko 2023-10-18T17:09:39.754 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 59753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-bd2802.ko 2023-10-18T17:09:39.754 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-18T17:09:39.755 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-da903x.ko 2023-10-18T17:09:39.755 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-da9052.ko 2023-10-18T17:09:39.755 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-gpio.ko 2023-10-18T17:09:39.755 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-18T17:09:39.755 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3533.ko 2023-10-18T17:09:39.756 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm355x.ko 2023-10-18T17:09:39.756 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3642.ko 2023-10-18T17:09:39.756 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-18T17:09:39.756 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp8788.ko 2023-10-18T17:09:39.756 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-max8997.ko 2023-10-18T17:09:39.756 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-mc13783.ko 2023-10-18T17:09:39.757 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-menf21bmc.ko 2023-10-18T17:09:39.757 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca9532.ko 2023-10-18T17:09:39.757 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca955x.ko 2023-10-18T17:09:39.757 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca963x.ko 2023-10-18T17:09:39.757 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-18T17:09:39.758 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-tca6507.ko 2023-10-18T17:09:39.758 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-wm831x-status.ko 2023-10-18T17:09:39.758 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-wm8350.ko 2023-10-18T17:09:39.758 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ 2023-10-18T17:09:39.758 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-18T17:09:39.759 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-18T17:09:39.759 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-18T17:09:39.759 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-18T17:09:39.759 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-18T17:09:39.759 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-18T17:09:39.760 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-18T17:09:39.760 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-18T17:09:39.760 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/ 2023-10-18T17:09:39.760 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/ 2023-10-18T17:09:39.760 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 654969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-18T17:09:39.761 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 40577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-18T17:09:39.761 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 89601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bufio.ko 2023-10-18T17:09:39.761 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 47529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-18T17:09:39.761 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 156009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-18T17:09:39.761 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 106897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-18T17:09:39.762 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-18T17:09:39.762 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 53857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-era.ko 2023-10-18T17:09:39.762 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-18T17:09:39.762 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 41593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-18T17:09:39.763 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 32737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log.ko 2023-10-18T17:09:39.763 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 49545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-mirror.ko 2023-10-18T17:09:39.763 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 78033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-18T17:09:39.763 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-18T17:09:39.763 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 70825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-18T17:09:39.764 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-region-hash.ko 2023-10-18T17:09:39.764 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-18T17:09:39.764 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-18T17:09:39.764 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 109593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-snapshot.ko 2023-10-18T17:09:39.764 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-18T17:09:39.765 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 181865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-18T17:09:39.765 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 51737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-18T17:09:39.765 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-zero.ko 2023-10-18T17:09:39.765 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-18T17:09:39.765 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-18T17:09:39.766 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 32417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-18T17:09:39.766 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/ 2023-10-18T17:09:39.766 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 199937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-18T17:09:39.766 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 37337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-18T17:09:39.766 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 113073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-18T17:09:39.767 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 158681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-18T17:09:39.767 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 395721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-18T17:09:39.767 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/ 2023-10-18T17:09:39.767 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/ 2023-10-18T17:09:39.767 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 178137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-18T17:09:39.767 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 63385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-18T17:09:39.768 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 44665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-18T17:09:39.768 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 37225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-18T17:09:39.768 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 123321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-18T17:09:39.768 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 79041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-18T17:09:39.768 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 53081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-18T17:09:39.769 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/ 2023-10-18T17:09:39.769 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm800.ko 2023-10-18T17:09:39.769 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm805.ko 2023-10-18T17:09:39.769 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm80x.ko 2023-10-18T17:09:39.769 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/arizona-i2c.ko 2023-10-18T17:09:39.770 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 123721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/arizona.ko 2023-10-18T17:09:39.770 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/bcm590xx.ko 2023-10-18T17:09:39.770 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/cros_ec_dev.ko 2023-10-18T17:09:39.770 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/dln2.ko 2023-10-18T17:09:39.770 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/janz-cmodio.ko 2023-10-18T17:09:39.771 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 53585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/kempld-core.ko 2023-10-18T17:09:39.771 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lm3533-core.ko 2023-10-18T17:09:39.771 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-10-18T17:09:39.771 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lp3943.ko 2023-10-18T17:09:39.771 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 54569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-18T17:09:39.772 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-18T17:09:39.772 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/max8907.ko 2023-10-18T17:09:39.772 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mc13xxx-core.ko 2023-10-18T17:09:39.772 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-10-18T17:09:39.772 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/menf21bmc.ko 2023-10-18T17:09:39.773 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633-adc.ko 2023-10-18T17:09:39.773 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633-gpio.ko 2023-10-18T17:09:39.773 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633.ko 2023-10-18T17:09:39.773 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-10-18T17:09:39.773 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/retu-mfd.ko 2023-10-18T17:09:39.774 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 80425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/si476x-core.ko 2023-10-18T17:09:39.774 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 48457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-18T17:09:39.774 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-10-18T17:09:39.774 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 51137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/tps65010.ko 2023-10-18T17:09:39.774 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/tps6507x.ko 2023-10-18T17:09:39.775 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-18T17:09:39.775 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-18T17:09:39.775 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-18T17:09:39.775 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 44345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wm8994.ko 2023-10-18T17:09:39.775 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ 2023-10-18T17:09:39.776 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-10-18T17:09:39.776 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 48489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ad525x_dpot.ko 2023-10-18T17:09:39.776 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/ 2023-10-18T17:09:39.776 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 46585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-18T17:09:39.776 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-18T17:09:39.777 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-18T17:09:39.777 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 45593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-18T17:09:39.777 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/ 2023-10-18T17:09:39.777 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-10-18T17:09:39.777 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 35281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/core.ko 2023-10-18T17:09:39.778 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/ 2023-10-18T17:09:39.778 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-18T17:09:39.778 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ds1682.ko 2023-10-18T17:09:39.778 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/dummy-irq.ko 2023-10-18T17:09:39.778 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/echo/ 2023-10-18T17:09:39.779 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/echo/echo.ko 2023-10-18T17:09:39.779 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/ 2023-10-18T17:09:39.779 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 37849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-18T17:09:39.779 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-18T17:09:39.779 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-18T17:09:39.780 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-18T17:09:39.780 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-18T17:09:39.780 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/genwqe/ 2023-10-18T17:09:39.780 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 152201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-10-18T17:09:39.780 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hmc6352.ko 2023-10-18T17:09:39.781 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 31321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-18T17:09:39.781 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ibmasm/ 2023-10-18T17:09:39.781 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 72129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-10-18T17:09:39.781 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ics932s401.ko 2023-10-18T17:09:39.781 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-18T17:09:39.781 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-18T17:09:39.782 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/ 2023-10-18T17:09:39.782 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 42513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-18T17:09:39.782 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-18T17:09:39.782 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/ 2023-10-18T17:09:39.783 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 125209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-18T17:09:39.783 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 56521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-18T17:09:39.783 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 310113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-18T17:09:39.783 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 31329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/phantom.ko 2023-10-18T17:09:39.783 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ti-st/ 2023-10-18T17:09:39.783 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 74265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ti-st/st_drv.ko 2023-10-18T17:09:39.784 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-18T17:09:39.784 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-18T17:09:39.784 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-18T17:09:39.784 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 48697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-18T17:09:39.784 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/ 2023-10-18T17:09:39.785 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 183609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-18T17:09:39.785 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ 2023-10-18T17:09:39.785 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/ 2023-10-18T17:09:39.785 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 490129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-18T17:09:39.785 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/ 2023-10-18T17:09:39.786 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/ 2023-10-18T17:09:39.786 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 106033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-18T17:09:39.786 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 40297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-18T17:09:39.786 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-18T17:09:39.786 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/ 2023-10-18T17:09:39.787 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 453737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-18T17:09:39.787 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-18T17:09:39.787 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-18T17:09:39.787 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ 2023-10-18T17:09:39.787 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/ 2023-10-18T17:09:39.787 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 45785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-18T17:09:39.788 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 42105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-18T17:09:39.788 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 130553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-18T17:09:39.788 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 68849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-18T17:09:39.788 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ 2023-10-18T17:09:39.788 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 37649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-18T17:09:39.789 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 59689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-18T17:09:39.789 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-18T17:09:39.789 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 99113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-18T17:09:39.789 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/ 2023-10-18T17:09:39.789 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 54521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-18T17:09:39.790 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/ 2023-10-18T17:09:39.790 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 69201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-18T17:09:39.790 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/ 2023-10-18T17:09:39.790 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 59585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-18T17:09:39.790 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/ 2023-10-18T17:09:39.791 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 41409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-18T17:09:39.791 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/ 2023-10-18T17:09:39.791 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 54609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-18T17:09:39.791 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 49289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-18T17:09:39.791 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 87297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-18T17:09:39.792 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/ 2023-10-18T17:09:39.792 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/ 2023-10-18T17:09:39.792 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 97337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-18T17:09:39.792 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-10-18T17:09:39.792 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 104673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-18T17:09:39.793 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-10-18T17:09:39.793 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 90257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-18T17:09:39.890 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/ 2023-10-18T17:09:39.891 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 81569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-18T17:09:39.891 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 69729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-18T17:09:39.891 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/ 2023-10-18T17:09:39.891 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 78401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-18T17:09:39.891 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 176761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-18T17:09:39.892 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-10-18T17:09:39.892 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 1421497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-18T17:09:39.892 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 128569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-18T17:09:39.892 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/ 2023-10-18T17:09:39.892 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 132089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-18T17:09:39.893 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 312081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-18T17:09:39.893 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/ 2023-10-18T17:09:39.893 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/ 2023-10-18T17:09:39.893 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 323513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-18T17:09:39.893 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/ 2023-10-18T17:09:39.894 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-10-18T17:09:39.894 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 193497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-18T17:09:39.894 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-10-18T17:09:39.894 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 347417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-18T17:09:39.894 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-10-18T17:09:39.895 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 1044433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-18T17:09:39.895 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-10-18T17:09:39.895 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 166193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-18T17:09:39.895 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-10-18T17:09:39.895 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-18T17:09:39.896 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/ 2023-10-18T17:09:39.896 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/ 2023-10-18T17:09:39.896 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 204345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-18T17:09:39.896 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/ 2023-10-18T17:09:39.896 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/ 2023-10-18T17:09:39.896 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 69449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-18T17:09:39.897 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 61489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-18T17:09:39.897 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 141225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-18T17:09:39.897 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 51497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-18T17:09:39.897 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 62817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-18T17:09:39.898 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 31369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-18T17:09:39.898 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/ 2023-10-18T17:09:39.898 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 60873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-18T17:09:39.898 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 62833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-18T17:09:39.898 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 45721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-18T17:09:39.899 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ec_bhf.ko 2023-10-18T17:09:39.899 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/ 2023-10-18T17:09:39.899 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/ 2023-10-18T17:09:39.899 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 281137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-18T17:09:39.899 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 49457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-18T17:09:39.900 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 51737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-18T17:09:39.900 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fujitsu/ 2023-10-18T17:09:39.900 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 45345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-10-18T17:09:39.900 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ 2023-10-18T17:09:39.900 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 90465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-18T17:09:39.901 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/ 2023-10-18T17:09:39.901 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 295577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-18T17:09:39.901 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/ 2023-10-18T17:09:39.901 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 584497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-18T17:09:39.901 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/ 2023-10-18T17:09:39.901 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 246209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-18T17:09:39.902 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/ 2023-10-18T17:09:39.902 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 925697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-18T17:09:39.902 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/ 2023-10-18T17:09:39.902 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 302849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-18T17:09:39.903 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/ 2023-10-18T17:09:39.903 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 514681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-18T17:09:39.903 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/ 2023-10-18T17:09:39.903 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 93593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-18T17:09:39.903 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-10-18T17:09:39.904 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 734305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-18T17:09:39.904 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-10-18T17:09:39.904 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 151769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-18T17:09:39.904 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 86921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-18T17:09:39.904 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/ 2023-10-18T17:09:39.905 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-18T17:09:39.905 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 102289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-18T17:09:39.905 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 122649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-18T17:09:39.905 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/ 2023-10-18T17:09:39.905 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-10-18T17:09:39.905 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 727601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-18T17:09:39.906 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 278937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-18T17:09:39.906 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-10-18T17:09:39.906 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-10-18T17:09:39.906 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 1113993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-18T17:09:39.906 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ 2023-10-18T17:09:39.907 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 53105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-10-18T17:09:39.907 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 40993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-10-18T17:09:39.907 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-10-18T17:09:39.907 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 95665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-18T17:09:39.907 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/ 2023-10-18T17:09:39.908 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-10-18T17:09:39.908 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 108649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-18T17:09:39.908 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ 2023-10-18T17:09:39.908 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 73441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-18T17:09:39.908 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 47777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-18T17:09:39.909 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/ 2023-10-18T17:09:39.909 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 150905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-18T17:09:39.909 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/ 2023-10-18T17:09:39.909 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 136721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-18T17:09:39.909 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/ 2023-10-18T17:09:39.910 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 50481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-18T17:09:39.910 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 43145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-18T17:09:39.910 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/ 2023-10-18T17:09:39.910 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-10-18T17:09:39.910 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 227897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-18T17:09:39.911 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 87081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-18T17:09:39.911 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-10-18T17:09:39.911 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 672049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-18T17:09:39.911 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/ 2023-10-18T17:09:39.911 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 43017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-18T17:09:39.912 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/ 2023-10-18T17:09:39.912 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 67385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-18T17:09:39.912 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 83985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-18T17:09:39.912 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-18T17:09:39.912 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 189801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-18T17:09:39.912 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/ 2023-10-18T17:09:39.913 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-10-18T17:09:39.913 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 104241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-10-18T17:09:39.913 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/ 2023-10-18T17:09:39.913 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 1053921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-18T17:09:39.913 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/ 2023-10-18T17:09:39.914 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 47097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-18T17:09:39.914 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/ 2023-10-18T17:09:39.914 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 54817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-18T17:09:39.914 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 63337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-18T17:09:39.914 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/ 2023-10-18T17:09:39.915 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 61601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-18T17:09:39.915 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 67193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-18T17:09:39.915 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 73409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-18T17:09:39.915 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 68177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-18T17:09:39.915 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/ 2023-10-18T17:09:39.916 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-10-18T17:09:39.916 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-10-18T17:09:39.916 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 39905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-18T17:09:39.916 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-10-18T17:09:39.916 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 486961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-18T17:09:39.917 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/ 2023-10-18T17:09:39.917 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 103337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-18T17:09:39.917 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 166161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-18T17:09:39.917 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 66329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-18T17:09:39.917 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 78801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-18T17:09:39.917 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/ 2023-10-18T17:09:39.918 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 50057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-18T17:09:39.918 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/ 2023-10-18T17:09:39.918 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 86529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-18T17:09:39.918 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/ 2023-10-18T17:09:39.918 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 80273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-18T17:09:39.919 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 83633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-18T17:09:39.919 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/ 2023-10-18T17:09:39.919 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 46241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-18T17:09:39.919 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-18T17:09:39.919 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/ 2023-10-18T17:09:39.920 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 60057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-18T17:09:39.920 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/ 2023-10-18T17:09:39.920 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 41065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/defxx.ko 2023-10-18T17:09:39.920 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/skfp/ 2023-10-18T17:09:39.920 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 216985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/skfp/skfp.ko 2023-10-18T17:09:39.920 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 77345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-18T17:09:39.921 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/ 2023-10-18T17:09:39.921 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 235521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-18T17:09:39.921 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/ 2023-10-18T17:09:39.921 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-18T17:09:39.921 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-18T17:09:39.922 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ 2023-10-18T17:09:39.922 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 83769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-18T17:09:39.922 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 62209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-18T17:09:39.922 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-18T17:09:39.922 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/ 2023-10-18T17:09:39.923 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-18T17:09:39.923 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-18T17:09:39.923 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-gpio.ko 2023-10-18T17:09:39.923 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-18T17:09:39.923 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-18T17:09:39.924 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-18T17:09:39.924 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 43953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-18T17:09:39.924 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-18T17:09:39.924 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/ 2023-10-18T17:09:39.924 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-18T17:09:39.924 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 38977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-18T17:09:39.925 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ 2023-10-18T17:09:39.925 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-18T17:09:39.925 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 50097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-18T17:09:39.925 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 44505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-18T17:09:39.925 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-18T17:09:39.926 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 42241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-18T17:09:39.926 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-18T17:09:39.926 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-18T17:09:39.926 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-18T17:09:39.926 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-18T17:09:39.927 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-18T17:09:39.927 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 82049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-18T17:09:39.927 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 76177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-18T17:09:39.927 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-18T17:09:39.927 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 97857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-18T17:09:39.928 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-18T17:09:39.928 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 50065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-18T17:09:39.928 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-18T17:09:39.928 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-18T17:09:39.928 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-18T17:09:39.929 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/plip/ 2023-10-18T17:09:39.929 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 43569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/plip/plip.ko 2023-10-18T17:09:39.929 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ 2023-10-18T17:09:39.929 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-18T17:09:39.929 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-18T17:09:39.930 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-18T17:09:39.930 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-18T17:09:39.930 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-18T17:09:39.930 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 42545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-18T17:09:39.930 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-18T17:09:39.931 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 32689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-18T17:09:39.931 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sb1000.ko 2023-10-18T17:09:39.931 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/ 2023-10-18T17:09:39.931 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 42465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-18T17:09:39.931 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-18T17:09:39.932 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 64385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-18T17:09:39.932 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/ 2023-10-18T17:09:39.932 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 106169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-18T17:09:39.932 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-18T17:09:39.932 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-18T17:09:39.932 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-18T17:09:39.933 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-18T17:09:39.933 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-18T17:09:39.933 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 87017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-18T17:09:39.933 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/ 2023-10-18T17:09:39.933 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 144297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-18T17:09:39.934 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/ 2023-10-18T17:09:39.934 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 297329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-18T17:09:39.934 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/ 2023-10-18T17:09:39.934 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 144649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-18T17:09:39.934 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ 2023-10-18T17:09:39.935 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-18T17:09:39.935 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/ 2023-10-18T17:09:39.935 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/ 2023-10-18T17:09:39.935 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 264937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-18T17:09:39.936 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 102209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-18T17:09:39.936 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/ 2023-10-18T17:09:39.936 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 133841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-18T17:09:39.936 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-18T17:09:39.936 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 84465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-18T17:09:39.937 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-18T17:09:39.937 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/ 2023-10-18T17:09:39.937 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/ 2023-10-18T17:09:39.937 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-18T17:09:39.937 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-10-18T17:09:39.938 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-10-18T17:09:39.938 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pci-stub.ko 2023-10-18T17:09:39.938 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 46529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-18T17:09:39.938 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/ 2023-10-18T17:09:39.938 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-18T17:09:39.938 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 145809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia.ko 2023-10-18T17:09:39.939 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 62137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia_core.ko 2023-10-18T17:09:39.939 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-10-18T17:09:39.939 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-18T17:09:39.939 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 112889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-18T17:09:39.939 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/ 2023-10-18T17:09:39.940 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/broadcom/ 2023-10-18T17:09:39.940 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-10-18T17:09:39.940 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/samsung/ 2023-10-18T17:09:39.940 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-10-18T17:09:39.940 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/ 2023-10-18T17:09:39.941 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/ 2023-10-18T17:09:39.941 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 70153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-18T17:09:39.941 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/ 2023-10-18T17:09:39.941 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/ 2023-10-18T17:09:39.941 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 50889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-10-18T17:09:39.942 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec.ko 2023-10-18T17:09:39.942 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-10-18T17:09:39.942 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-10-18T17:09:39.942 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-10-18T17:09:39.942 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-10-18T17:09:39.943 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-10-18T17:09:39.943 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/ 2023-10-18T17:09:39.943 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 67097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-18T17:09:39.943 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 39145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-18T17:09:39.943 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-18T17:09:39.943 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 59665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-18T17:09:39.944 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 31097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-18T17:09:39.944 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 127569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-18T17:09:39.944 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-18T17:09:39.944 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 49121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-18T17:09:39.944 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-18T17:09:39.945 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 40265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-18T17:09:39.945 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-18T17:09:39.945 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-18T17:09:39.945 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/ibm_rtl.ko 2023-10-18T17:09:39.945 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/ 2023-10-18T17:09:39.946 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-18T17:09:39.946 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-10-18T17:09:39.946 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 43497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-18T17:09:39.946 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-18T17:09:39.946 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-18T17:09:39.947 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-18T17:09:39.947 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 42329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-18T17:09:39.947 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-18T17:09:39.947 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-18T17:09:39.947 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-18T17:09:39.948 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-18T17:09:39.948 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-18T17:09:39.948 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 57569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-18T17:09:39.948 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/ 2023-10-18T17:09:39.948 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ 2023-10-18T17:09:39.949 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/88pm860x_battery.ko 2023-10-18T17:09:39.949 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/88pm860x_charger.ko 2023-10-18T17:09:39.949 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 55057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq2415x_charger.ko 2023-10-18T17:09:39.949 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 54081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq24190_charger.ko 2023-10-18T17:09:39.949 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq24735-charger.ko 2023-10-18T17:09:39.950 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-10-18T17:09:39.950 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/da9030_battery.ko 2023-10-18T17:09:39.950 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/da9052-battery.ko 2023-10-18T17:09:39.950 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2760_battery.ko 2023-10-18T17:09:39.950 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2780_battery.ko 2023-10-18T17:09:39.950 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2781_battery.ko 2023-10-18T17:09:39.951 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2782_battery.ko 2023-10-18T17:09:39.951 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/gpio-charger.ko 2023-10-18T17:09:39.951 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/isp1704_charger.ko 2023-10-18T17:09:39.951 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/lp8727_charger.ko 2023-10-18T17:09:39.951 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max14577_charger.ko 2023-10-18T17:09:39.952 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max17040_battery.ko 2023-10-18T17:09:39.952 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max17042_battery.ko 2023-10-18T17:09:39.952 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max8903_charger.ko 2023-10-18T17:09:39.952 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max8925_power.ko 2023-10-18T17:09:39.952 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/pcf50633-charger.ko 2023-10-18T17:09:39.953 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 38009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/sbs-battery.ko 2023-10-18T17:09:39.953 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/test_power.ko 2023-10-18T17:09:39.953 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/tps65090-charger.ko 2023-10-18T17:09:39.953 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm831x_backup.ko 2023-10-18T17:09:39.953 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm831x_power.ko 2023-10-18T17:09:39.954 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm8350_power.ko 2023-10-18T17:09:39.954 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/ 2023-10-18T17:09:39.954 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 57729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-18T17:09:39.954 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-18T17:09:39.954 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/ 2023-10-18T17:09:39.955 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/ 2023-10-18T17:09:39.955 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-18T17:09:39.955 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-18T17:09:39.955 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-18T17:09:39.955 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 41873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-18T17:09:39.956 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ 2023-10-18T17:09:39.956 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 66385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-18T17:09:39.956 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-18T17:09:39.956 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/ 2023-10-18T17:09:39.956 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-88pm80x.ko 2023-10-18T17:09:39.957 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-88pm860x.ko 2023-10-18T17:09:39.957 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-18T17:09:39.957 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9052.ko 2023-10-18T17:09:39.957 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9055.ko 2023-10-18T17:09:39.957 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9063.ko 2023-10-18T17:09:39.957 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-18T17:09:39.958 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 68577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-18T17:09:39.958 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-18T17:09:39.958 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-18T17:09:39.958 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-18T17:09:39.959 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-18T17:09:39.959 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-18T17:09:39.959 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-18T17:09:39.959 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-18T17:09:39.959 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-18T17:09:39.959 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-18T17:09:39.960 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-18T17:09:39.960 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 35969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-18T17:09:39.960 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-lp8788.ko 2023-10-18T17:09:39.960 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 38097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-18T17:09:39.960 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-18T17:09:39.961 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-18T17:09:39.961 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t86.ko 2023-10-18T17:09:39.961 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-18T17:09:39.961 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8907.ko 2023-10-18T17:09:39.961 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8925.ko 2023-10-18T17:09:39.962 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8997.ko 2023-10-18T17:09:39.962 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8998.ko 2023-10-18T17:09:39.962 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-10-18T17:09:39.962 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-18T17:09:39.962 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-palmas.ko 2023-10-18T17:09:39.963 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 46633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-18T17:09:39.963 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf50633.ko 2023-10-18T17:09:39.963 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-18T17:09:39.963 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-18T17:09:39.963 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-18T17:09:39.963 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-18T17:09:39.964 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rc5t583.ko 2023-10-18T17:09:39.964 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-18T17:09:39.964 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-18T17:09:39.964 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-18T17:09:39.964 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-18T17:09:39.965 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-18T17:09:39.965 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-s35390a.ko 2023-10-18T17:09:39.965 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-18T17:09:39.965 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-tps6586x.ko 2023-10-18T17:09:39.965 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-tps65910.ko 2023-10-18T17:09:39.966 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-wm831x.ko 2023-10-18T17:09:39.966 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-wm8350.ko 2023-10-18T17:09:39.966 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-18T17:09:39.966 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ 2023-10-18T17:09:39.966 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 77617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-18T17:09:39.967 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 57665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-18T17:09:39.967 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 55169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-18T17:09:39.967 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 135185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-18T17:09:39.967 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-18T17:09:39.967 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/ 2023-10-18T17:09:39.968 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 272305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-18T17:09:39.968 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 100617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-18T17:09:39.968 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/ 2023-10-18T17:09:39.968 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 356265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-18T17:09:39.968 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 295801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-18T17:09:39.969 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic94xx/ 2023-10-18T17:09:39.969 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 189185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-10-18T17:09:39.969 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-18T17:09:39.969 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/ 2023-10-18T17:09:39.969 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 106881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-18T17:09:39.969 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 38185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-18T17:09:39.970 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/ 2023-10-18T17:09:39.970 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 246985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-18T17:09:39.970 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/ 2023-10-18T17:09:39.970 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 1171945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-18T17:09:39.970 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/ 2023-10-18T17:09:39.971 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 237273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-18T17:09:39.971 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/ 2023-10-18T17:09:39.971 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 115369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-18T17:09:39.971 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 40585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-18T17:09:39.971 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/ 2023-10-18T17:09:39.972 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 308921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-18T17:09:39.972 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/ 2023-10-18T17:09:39.972 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-10-18T17:09:39.972 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 76145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-18T17:09:39.972 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-10-18T17:09:39.973 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 101449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-18T17:09:39.973 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 146689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-18T17:09:39.973 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 75553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-18T17:09:39.973 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 38137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-18T17:09:39.973 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/ 2023-10-18T17:09:39.973 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 212425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-18T17:09:39.974 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 60505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-18T17:09:39.974 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/ 2023-10-18T17:09:39.974 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 78209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-18T17:09:39.974 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 158505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-18T17:09:39.974 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fdomain.ko 2023-10-18T17:09:39.975 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/ 2023-10-18T17:09:39.975 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 263489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-18T17:09:39.975 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 201817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-18T17:09:39.975 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 51209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-18T17:09:39.975 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 49041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-18T17:09:39.976 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 35337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/imm.ko 2023-10-18T17:09:39.976 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 44057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-18T17:09:39.976 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 266537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-18T17:09:39.976 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 101881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-18T17:09:39.976 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/ 2023-10-18T17:09:39.976 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 317153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-18T17:09:39.977 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-18T17:09:39.977 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 52961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-18T17:09:39.977 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/ 2023-10-18T17:09:39.977 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 314865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-18T17:09:39.977 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 145585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-18T17:09:39.978 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 53521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-18T17:09:39.978 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/ 2023-10-18T17:09:39.978 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 216665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-18T17:09:39.978 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/ 2023-10-18T17:09:39.978 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 2197249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-18T17:09:39.979 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/ 2023-10-18T17:09:39.979 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 73569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-18T17:09:39.979 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-18T17:09:39.979 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 310617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-18T17:09:39.979 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 84721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-18T17:09:39.979 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/ 2023-10-18T17:09:39.980 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 659777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-18T17:09:39.980 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/ 2023-10-18T17:09:39.980 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 119561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-18T17:09:39.980 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 78129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-18T17:09:39.980 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/ 2023-10-18T17:09:39.981 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 81625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-10-18T17:09:39.981 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-10-18T17:09:39.981 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-10-18T17:09:39.981 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-10-18T17:09:39.981 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/ 2023-10-18T17:09:39.982 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 364105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-18T17:09:39.982 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 123617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-18T17:09:39.982 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ppa.ko 2023-10-18T17:09:39.982 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 55361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-18T17:09:39.982 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/ 2023-10-18T17:09:39.983 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 1876625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-18T17:09:39.983 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 85289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-18T17:09:39.983 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/ 2023-10-18T17:09:39.983 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 559033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-18T17:09:39.983 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qlogicfas408.ko 2023-10-18T17:09:39.984 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-18T17:09:39.984 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 238825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-18T17:09:39.984 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 173937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-18T17:09:39.984 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 279313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-18T17:09:39.984 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 97729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-18T17:09:39.984 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 73881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-18T17:09:39.985 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 44993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-18T17:09:39.985 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-18T17:09:39.985 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 115889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-18T17:09:39.985 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 46825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-18T17:09:39.985 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/ 2023-10-18T17:09:39.986 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 162121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-18T17:09:39.986 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 42297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-18T17:09:39.986 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 50321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-18T17:09:39.986 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 40025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-18T17:09:39.986 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 50025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/xen-scsifront.ko 2023-10-18T17:09:39.987 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ 2023-10-18T17:09:39.987 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 129441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-18T17:09:39.987 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/ 2023-10-18T17:09:39.987 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/ 2023-10-18T17:09:39.987 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 736601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-18T17:09:39.987 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/ 2023-10-18T17:09:39.988 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 49985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-18T17:09:39.988 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 39713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-18T17:09:39.988 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 43025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-18T17:09:39.988 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 930321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-18T17:09:39.988 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 44305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-18T17:09:39.989 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 122521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-18T17:09:39.989 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/ 2023-10-18T17:09:39.989 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 75593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-18T17:09:39.989 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/ 2023-10-18T17:09:39.989 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/ 2023-10-18T17:09:39.990 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/ 2023-10-18T17:09:39.990 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-18T17:09:39.990 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-18T17:09:39.990 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-18T17:09:39.990 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-18T17:09:39.991 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-18T17:09:39.991 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-18T17:09:39.991 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-18T17:09:39.991 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-18T17:09:39.991 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-18T17:09:39.991 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-18T17:09:39.992 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-18T17:09:39.992 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 37065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-18T17:09:39.992 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-10-18T17:09:39.992 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-18T17:09:39.992 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-18T17:09:39.993 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-18T17:09:39.993 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ 2023-10-18T17:09:39.993 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ 2023-10-18T17:09:39.993 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 78425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-18T17:09:39.993 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 57865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/moxa.ko 2023-10-18T17:09:39.994 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 50953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/mxser.ko 2023-10-18T17:09:39.994 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 108601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-18T17:09:39.994 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 31961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-18T17:09:39.994 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 67929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-18T17:09:39.994 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/ 2023-10-18T17:09:39.995 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/ 2023-10-18T17:09:39.995 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 35753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-10-18T17:09:39.995 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 59497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-18T17:09:39.995 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-10-18T17:09:39.995 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/altera_uart.ko 2023-10-18T17:09:39.996 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-18T17:09:39.996 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 72425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-10-18T17:09:39.996 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/ 2023-10-18T17:09:39.996 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 103073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-18T17:09:39.996 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/rp2.ko 2023-10-18T17:09:39.996 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 52817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/sc16is7xx.ko 2023-10-18T17:09:39.997 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/ 2023-10-18T17:09:39.997 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ 2023-10-18T17:09:39.997 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 531265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-18T17:09:39.997 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ 2023-10-18T17:09:39.997 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-18T17:09:39.998 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-10-18T17:09:39.998 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/ 2023-10-18T17:09:39.998 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 44513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-18T17:09:39.998 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-18T17:09:39.998 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-18T17:09:39.999 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_dmem_genirq.ko 2023-10-18T17:09:39.999 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_mf624.ko 2023-10-18T17:09:39.999 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_netx.ko 2023-10-18T17:09:39.999 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-18T17:09:39.999 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-10-18T17:09:40.000 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-18T17:09:40.000 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/ 2023-10-18T17:09:40.000 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/c67x00/ 2023-10-18T17:09:40.000 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 73297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/c67x00/c67x00.ko 2023-10-18T17:09:40.000 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ 2023-10-18T17:09:40.001 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 144377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-10-18T17:09:40.001 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-10-18T17:09:40.001 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-10-18T17:09:40.001 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-10-18T17:09:40.001 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/ 2023-10-18T17:09:40.002 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 87089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-18T17:09:40.002 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 51409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-18T17:09:40.002 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 47369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-18T17:09:40.002 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 89857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-18T17:09:40.002 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/common/ 2023-10-18T17:09:40.003 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/common/ulpi.ko 2023-10-18T17:09:40.003 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc2/ 2023-10-18T17:09:40.003 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-10-18T17:09:40.003 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/ 2023-10-18T17:09:40.003 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-10-18T17:09:40.004 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-10-18T17:09:40.004 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 444553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3.ko 2023-10-18T17:09:40.004 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/ 2023-10-18T17:09:40.004 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/ 2023-10-18T17:09:40.004 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 60177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/u_ether.ko 2023-10-18T17:09:40.004 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 51881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/u_serial.ko 2023-10-18T17:09:40.005 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-10-18T17:09:40.005 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 42449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-10-18T17:09:40.005 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-10-18T17:09:40.005 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-10-18T17:09:40.005 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 92489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-10-18T17:09:40.006 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 51049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-10-18T17:09:40.006 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 122081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-10-18T17:09:40.006 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 57617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-10-18T17:09:40.006 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-10-18T17:09:40.006 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 31265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-10-18T17:09:40.007 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 57729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-10-18T17:09:40.007 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 85609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-10-18T17:09:40.007 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-10-18T17:09:40.007 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 58113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-10-18T17:09:40.007 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 67337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-10-18T17:09:40.008 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/ 2023-10-18T17:09:40.008 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-10-18T17:09:40.008 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-10-18T17:09:40.008 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-10-18T17:09:40.008 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-10-18T17:09:40.009 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-10-18T17:09:40.009 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-10-18T17:09:40.009 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-10-18T17:09:40.009 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-10-18T17:09:40.009 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 32073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-10-18T17:09:40.010 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-10-18T17:09:40.010 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-10-18T17:09:40.010 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-10-18T17:09:40.010 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 62185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-10-18T17:09:40.010 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-10-18T17:09:40.011 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 161225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/libcomposite.ko 2023-10-18T17:09:40.011 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/ 2023-10-18T17:09:40.011 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-10-18T17:09:40.011 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/bdc/ 2023-10-18T17:09:40.011 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 157681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-10-18T17:09:40.011 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-10-18T17:09:40.012 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 52721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-10-18T17:09:40.012 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 69705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-10-18T17:09:40.012 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 56033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-10-18T17:09:40.012 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 76057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/net2272.ko 2023-10-18T17:09:40.012 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 75073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/net2280.ko 2023-10-18T17:09:40.013 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 73169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-10-18T17:09:40.013 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 65809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-10-18T17:09:40.013 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 66097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-10-18T17:09:40.013 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 81505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-10-18T17:09:40.013 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 156073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-10-18T17:09:40.014 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/ 2023-10-18T17:09:40.014 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/bcma-hcd.ko 2023-10-18T17:09:40.014 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 80113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/isp116x-hcd.ko 2023-10-18T17:09:40.014 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 87353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-10-18T17:09:40.014 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 78873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-10-18T17:09:40.015 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 51329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-18T17:09:40.015 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811_cs.ko 2023-10-18T17:09:40.015 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/ssb-hcd.ko 2023-10-18T17:09:40.015 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-10-18T17:09:40.015 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/ 2023-10-18T17:09:40.016 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-18T17:09:40.016 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-18T17:09:40.016 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ 2023-10-18T17:09:40.016 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 41721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-18T17:09:40.016 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-18T17:09:40.017 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-10-18T17:09:40.017 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/cytherm.ko 2023-10-18T17:09:40.017 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ehset.ko 2023-10-18T17:09:40.017 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-18T17:09:40.017 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-18T17:09:40.017 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-18T17:09:40.018 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-18T17:09:40.018 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-18T17:09:40.018 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-18T17:09:40.018 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-18T17:09:40.018 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-18T17:09:40.019 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/lvstest.ko 2023-10-18T17:09:40.019 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/ 2023-10-18T17:09:40.019 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 64841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-18T17:09:40.019 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-18T17:09:40.019 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-18T17:09:40.020 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-18T17:09:40.020 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-18T17:09:40.020 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 70873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbtest.ko 2023-10-18T17:09:40.020 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 41969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-18T17:09:40.021 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-18T17:09:40.021 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/mon/ 2023-10-18T17:09:40.021 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 72953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/mon/usbmon.ko 2023-10-18T17:09:40.021 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/musb/ 2023-10-18T17:09:40.021 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 301545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/musb/musb_hdrc.ko 2023-10-18T17:09:40.021 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/ 2023-10-18T17:09:40.022 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-18T17:09:40.022 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-10-18T17:09:40.022 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-isp1301.ko 2023-10-18T17:09:40.022 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-tahvo.ko 2023-10-18T17:09:40.022 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ 2023-10-18T17:09:40.023 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-18T17:09:40.023 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-18T17:09:40.023 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-18T17:09:40.023 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 38105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-18T17:09:40.023 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 70257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-18T17:09:40.024 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 31057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-18T17:09:40.024 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 58217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-18T17:09:40.024 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 49817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-18T17:09:40.024 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-18T17:09:40.024 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 44337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/f81232.ko 2023-10-18T17:09:40.025 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 175137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-18T17:09:40.025 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 53113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-18T17:09:40.025 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 137081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-18T17:09:40.025 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 124833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-18T17:09:40.025 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 67769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-18T17:09:40.025 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-18T17:09:40.026 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-18T17:09:40.026 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 58233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-18T17:09:40.026 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 107521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-18T17:09:40.026 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 35617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-18T17:09:40.026 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-18T17:09:40.027 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-18T17:09:40.027 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 32953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-18T17:09:40.027 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/metro-usb.ko 2023-10-18T17:09:40.027 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 66449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-18T17:09:40.027 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 78217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-18T17:09:40.028 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 56337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mxuport.ko 2023-10-18T17:09:40.028 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-18T17:09:40.028 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-18T17:09:40.028 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-18T17:09:40.028 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 190633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-18T17:09:40.029 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 39073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-18T17:09:40.029 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 54353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-18T17:09:40.029 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-18T17:09:40.029 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 37825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-18T17:09:40.029 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-18T17:09:40.030 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-18T17:09:40.030 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 51625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-18T17:09:40.030 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-18T17:09:40.030 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-18T17:09:40.030 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-18T17:09:40.031 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 61489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-18T17:09:40.031 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-18T17:09:40.031 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-18T17:09:40.031 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-18T17:09:40.031 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 125609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usbserial.ko 2023-10-18T17:09:40.032 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-18T17:09:40.032 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 37409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-18T17:09:40.032 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/wishbone-serial.ko 2023-10-18T17:09:40.032 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-18T17:09:40.032 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ 2023-10-18T17:09:40.033 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 52913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-18T17:09:40.033 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-18T17:09:40.033 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-18T17:09:40.033 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-18T17:09:40.033 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-18T17:09:40.034 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-18T17:09:40.034 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-18T17:09:40.034 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-18T17:09:40.034 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-18T17:09:40.034 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-18T17:09:40.035 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-18T17:09:40.035 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-18T17:09:40.035 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-18T17:09:40.035 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 35337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-18T17:09:40.035 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 179969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-18T17:09:40.036 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/ 2023-10-18T17:09:40.036 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 67481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-18T17:09:40.036 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 72177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-18T17:09:40.036 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 107001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-18T17:09:40.036 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/ 2023-10-18T17:09:40.037 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/ 2023-10-18T17:09:40.037 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 154297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-18T17:09:40.037 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-18T17:09:40.037 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 108737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-18T17:09:40.037 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 77609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-18T17:09:40.038 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/ 2023-10-18T17:09:40.038 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 113873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-18T17:09:40.038 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-18T17:09:40.038 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 58089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-18T17:09:40.038 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 89249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-18T17:09:40.039 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/ 2023-10-18T17:09:40.039 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/ 2023-10-18T17:09:40.039 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-10-18T17:09:40.039 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/aat2870_bl.ko 2023-10-18T17:09:40.039 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp5520_bl.ko 2023-10-18T17:09:40.040 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 32609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp8860_bl.ko 2023-10-18T17:09:40.040 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 39993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp8870_bl.ko 2023-10-18T17:09:40.040 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-18T17:09:40.040 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/as3711_bl.ko 2023-10-18T17:09:40.040 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/bd6107.ko 2023-10-18T17:09:40.040 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/da903x_bl.ko 2023-10-18T17:09:40.041 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/da9052_bl.ko 2023-10-18T17:09:40.041 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/gpio_backlight.ko 2023-10-18T17:09:40.041 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/kb3886_bl.ko 2023-10-18T17:09:40.041 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-18T17:09:40.041 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lm3533_bl.ko 2023-10-18T17:09:40.042 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lm3639_bl.ko 2023-10-18T17:09:40.042 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lv5207lp.ko 2023-10-18T17:09:40.042 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/max8925_bl.ko 2023-10-18T17:09:40.042 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/pandora_bl.ko 2023-10-18T17:09:40.042 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-10-18T17:09:40.043 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-18T17:09:40.043 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/wm831x_bl.ko 2023-10-18T17:09:40.043 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/ 2023-10-18T17:09:40.043 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ 2023-10-18T17:09:40.043 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-18T17:09:40.044 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 38985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-18T17:09:40.044 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/matrox_w1.ko 2023-10-18T17:09:40.044 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/w1-gpio.ko 2023-10-18T17:09:40.044 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/ 2023-10-18T17:09:40.044 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-18T17:09:40.045 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-18T17:09:40.045 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-18T17:09:40.045 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-18T17:09:40.045 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-18T17:09:40.045 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-18T17:09:40.046 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-18T17:09:40.046 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-18T17:09:40.046 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-18T17:09:40.046 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-18T17:09:40.046 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 56425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-18T17:09:40.047 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 102673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-18T17:09:40.047 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ 2023-10-18T17:09:40.047 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/acquirewdt.ko 2023-10-18T17:09:40.047 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/advantechwdt.ko 2023-10-18T17:09:40.047 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-18T17:09:40.048 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-18T17:09:40.048 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/cpu5wdt.ko 2023-10-18T17:09:40.048 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9052_wdt.ko 2023-10-18T17:09:40.048 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9055_wdt.ko 2023-10-18T17:09:40.048 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9063_wdt.ko 2023-10-18T17:09:40.049 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/dw_wdt.ko 2023-10-18T17:09:40.049 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/eurotechwdt.ko 2023-10-18T17:09:40.049 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-18T17:09:40.049 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-18T17:09:40.049 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-18T17:09:40.050 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-18T17:09:40.050 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-18T17:09:40.050 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-18T17:09:40.050 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-18T17:09:40.050 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-18T17:09:40.051 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-18T17:09:40.051 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-18T17:09:40.051 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/kempld_wdt.ko 2023-10-18T17:09:40.051 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-18T17:09:40.051 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/mena21_wdt.ko 2023-10-18T17:09:40.051 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-10-18T17:09:40.052 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-18T17:09:40.052 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-10-18T17:09:40.052 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pc87413_wdt.ko 2023-10-18T17:09:40.052 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 38657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-18T17:09:40.052 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 31825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-18T17:09:40.053 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/retu_wdt.ko 2023-10-18T17:09:40.053 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-10-18T17:09:40.053 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-10-18T17:09:40.053 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-18T17:09:40.053 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sc1200wdt.ko 2023-10-18T17:09:40.054 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-18T17:09:40.054 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-10-18T17:09:40.054 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-18T17:09:40.054 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-18T17:09:40.054 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/twl4030_wdt.ko 2023-10-18T17:09:40.055 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-18T17:09:40.055 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-18T17:09:40.055 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-18T17:09:40.055 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-18T17:09:40.055 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wafer5823wdt.ko 2023-10-18T17:09:40.056 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-18T17:09:40.056 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wm831x_wdt.ko 2023-10-18T17:09:40.056 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wm8350_wdt.ko 2023-10-18T17:09:40.056 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-18T17:09:40.056 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/ 2023-10-18T17:09:40.057 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-18T17:09:40.057 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-18T17:09:40.057 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 47865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-18T17:09:40.057 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/ 2023-10-18T17:09:40.057 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 176441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-18T17:09:40.058 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 40121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-18T17:09:40.058 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 71249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-scsiback.ko 2023-10-18T17:09:40.058 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/ 2023-10-18T17:09:40.058 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-18T17:09:40.058 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ 2023-10-18T17:09:40.059 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/ 2023-10-18T17:09:40.059 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 166425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-18T17:09:40.059 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/adfs/ 2023-10-18T17:09:40.059 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 61073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/adfs/adfs.ko 2023-10-18T17:09:40.059 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/ 2023-10-18T17:09:40.060 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 163593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-18T17:09:40.060 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/afs/ 2023-10-18T17:09:40.060 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 932817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/afs/kafs.ko 2023-10-18T17:09:40.060 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/autofs/ 2023-10-18T17:09:40.060 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 101057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/autofs/autofs4.ko 2023-10-18T17:09:40.060 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/ 2023-10-18T17:09:40.061 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 64545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-18T17:09:40.061 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/bfs/ 2023-10-18T17:09:40.061 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 41257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/bfs/bfs.ko 2023-10-18T17:09:40.061 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-18T17:09:40.061 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/ 2023-10-18T17:09:40.062 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 3402585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-18T17:09:40.062 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/ 2023-10-18T17:09:40.062 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 306073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-18T17:09:40.062 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ 2023-10-18T17:09:40.063 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 1323873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-18T17:09:40.063 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/ 2023-10-18T17:09:40.063 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 100801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-18T17:09:40.063 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/configfs/ 2023-10-18T17:09:40.063 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 108393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/configfs/configfs.ko 2023-10-18T17:09:40.063 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/ 2023-10-18T17:09:40.064 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 29625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-18T17:09:40.064 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/ 2023-10-18T17:09:40.064 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 642577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-18T17:09:40.064 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/efs/ 2023-10-18T17:09:40.064 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/efs/efs.ko 2023-10-18T17:09:40.065 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/ 2023-10-18T17:09:40.065 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 1505025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-18T17:09:40.065 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/ 2023-10-18T17:09:40.065 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-18T17:09:40.065 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/freevxfs/ 2023-10-18T17:09:40.066 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 42545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/freevxfs/freevxfs.ko 2023-10-18T17:09:40.066 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/ 2023-10-18T17:09:40.066 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 226481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-18T17:09:40.066 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/ 2023-10-18T17:09:40.066 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-18T17:09:40.067 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/ 2023-10-18T17:09:40.067 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 1231529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-18T17:09:40.067 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/ 2023-10-18T17:09:40.067 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 141209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-18T17:09:40.067 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/ 2023-10-18T17:09:40.068 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 222817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-18T17:09:40.068 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hpfs/ 2023-10-18T17:09:40.068 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 192329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hpfs/hpfs.ko 2023-10-18T17:09:40.068 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/ 2023-10-18T17:09:40.068 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 74065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-18T17:09:40.068 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/ 2023-10-18T17:09:40.069 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 419497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-18T17:09:40.069 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/ 2023-10-18T17:09:40.069 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 280313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-18T17:09:40.069 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/ 2023-10-18T17:09:40.069 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 89193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-18T17:09:40.070 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/ 2023-10-18T17:09:40.070 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 124649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-18T17:09:40.070 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/ 2023-10-18T17:09:40.070 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/ 2023-10-18T17:09:40.070 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 81449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-18T17:09:40.071 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/ 2023-10-18T17:09:40.071 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 59449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-18T17:09:40.071 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/ 2023-10-18T17:09:40.071 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 117513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-18T17:09:40.072 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 1055649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-18T17:09:40.072 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 66441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv2.ko 2023-10-18T17:09:40.072 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 120177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-18T17:09:40.072 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 2041689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-18T17:09:40.072 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/ 2023-10-18T17:09:40.072 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-18T17:09:40.073 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-18T17:09:40.073 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/ 2023-10-18T17:09:40.073 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 1516809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-18T17:09:40.073 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/ 2023-10-18T17:09:40.073 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 592833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-18T17:09:40.074 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/ 2023-10-18T17:09:40.074 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-18T17:09:40.074 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-18T17:09:40.074 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-18T17:09:40.074 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-18T17:09:40.075 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-18T17:09:40.075 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-18T17:09:40.075 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-18T17:09:40.075 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-18T17:09:40.075 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-18T17:09:40.075 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-18T17:09:40.076 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-18T17:09:40.076 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ascii.ko 2023-10-18T17:09:40.076 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-18T17:09:40.076 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-18T17:09:40.076 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-18T17:09:40.077 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-18T17:09:40.077 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-18T17:09:40.077 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-18T17:09:40.077 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-18T17:09:40.077 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-18T17:09:40.078 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-18T17:09:40.078 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-18T17:09:40.078 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-18T17:09:40.078 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-18T17:09:40.078 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-18T17:09:40.079 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-18T17:09:40.079 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-18T17:09:40.079 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-18T17:09:40.079 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-18T17:09:40.079 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-18T17:09:40.079 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 94137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-18T17:09:40.080 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 142673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-18T17:09:40.080 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 165745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-18T17:09:40.080 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 118121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-18T17:09:40.080 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-18T17:09:40.080 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-18T17:09:40.081 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-18T17:09:40.081 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-18T17:09:40.081 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-18T17:09:40.081 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-18T17:09:40.081 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-18T17:09:40.082 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-18T17:09:40.082 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-18T17:09:40.082 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-18T17:09:40.082 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-18T17:09:40.082 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-18T17:09:40.083 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-18T17:09:40.083 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-18T17:09:40.083 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-18T17:09:40.083 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-18T17:09:40.083 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-18T17:09:40.085 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ntfs/ 2023-10-18T17:09:40.085 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 219417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ntfs/ntfs.ko 2023-10-18T17:09:40.085 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ 2023-10-18T17:09:40.085 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ 2023-10-18T17:09:40.086 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 244409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-18T17:09:40.086 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ 2023-10-18T17:09:40.086 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 440737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-18T17:09:40.086 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ 2023-10-18T17:09:40.086 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 54049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-18T17:09:40.087 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 2592433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-18T17:09:40.087 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-18T17:09:40.087 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 31729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-18T17:09:40.087 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 35897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-18T17:09:40.087 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/omfs/ 2023-10-18T17:09:40.088 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 53433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/omfs/omfs.ko 2023-10-18T17:09:40.088 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/ 2023-10-18T17:09:40.088 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 352153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-18T17:09:40.088 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ 2023-10-18T17:09:40.088 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 54809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-18T17:09:40.089 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx4/ 2023-10-18T17:09:40.089 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx4/qnx4.ko 2023-10-18T17:09:40.089 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx6/ 2023-10-18T17:09:40.089 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 46689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx6/qnx6.ko 2023-10-18T17:09:40.089 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/ 2023-10-18T17:09:40.090 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_tree.ko 2023-10-18T17:09:40.090 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_v1.ko 2023-10-18T17:09:40.090 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_v2.ko 2023-10-18T17:09:40.090 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/ 2023-10-18T17:09:40.090 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 532673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-18T17:09:40.091 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/ 2023-10-18T17:09:40.091 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-18T17:09:40.091 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/ 2023-10-18T17:09:40.091 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/ 2023-10-18T17:09:40.091 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 2668121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-18T17:09:40.092 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/ 2023-10-18T17:09:40.092 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-18T17:09:40.092 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-18T17:09:40.092 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/ 2023-10-18T17:09:40.092 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 134641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-18T17:09:40.093 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/ 2023-10-18T17:09:40.093 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 90721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-18T17:09:40.093 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/ 2023-10-18T17:09:40.093 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 247737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-18T17:09:40.093 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ 2023-10-18T17:09:40.093 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 162497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-18T17:09:40.094 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/ 2023-10-18T17:09:40.094 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 4010729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-18T17:09:40.094 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/ 2023-10-18T17:09:40.094 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/locking/ 2023-10-18T17:09:40.094 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 75489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/locking/locktorture.ko 2023-10-18T17:09:40.095 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/time/ 2023-10-18T17:09:40.095 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/time/test_udelay.ko 2023-10-18T17:09:40.095 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 60553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-18T17:09:40.095 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ 2023-10-18T17:09:40.095 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 6833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-18T17:09:40.096 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 6529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc7.ko 2023-10-18T17:09:40.096 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-18T17:09:40.096 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/ 2023-10-18T17:09:40.096 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-18T17:09:40.096 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 37081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-18T17:09:40.097 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/interval_tree_test.ko 2023-10-18T17:09:40.097 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-18T17:09:40.097 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-18T17:09:40.097 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/ 2023-10-18T17:09:40.097 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-18T17:09:40.098 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-18T17:09:40.098 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/ 2023-10-18T17:09:40.098 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 6617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-18T17:09:40.098 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/memory-notifier-error-inject.ko 2023-10-18T17:09:40.098 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/notifier-error-inject.ko 2023-10-18T17:09:40.099 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/percpu_test.ko 2023-10-18T17:09:40.099 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/pm-notifier-error-inject.ko 2023-10-18T17:09:40.099 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/ 2023-10-18T17:09:40.099 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 143433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-18T17:09:40.099 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/rbtree_test.ko 2023-10-18T17:09:40.100 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/ 2023-10-18T17:09:40.100 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-18T17:09:40.100 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 38841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test-kstrtox.ko 2023-10-18T17:09:40.100 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test-string_helpers.ko 2023-10-18T17:09:40.100 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 4760425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_bpf.ko 2023-10-18T17:09:40.101 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 49089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_firmware.ko 2023-10-18T17:09:40.101 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 6369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_module.ko 2023-10-18T17:09:40.101 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_user_copy.ko 2023-10-18T17:09:40.101 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-18T17:09:40.101 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-18T17:09:40.102 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-18T17:09:40.102 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/xz/ 2023-10-18T17:09:40.102 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/xz/xz_dec_test.ko 2023-10-18T17:09:40.102 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/ 2023-10-18T17:09:40.102 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-18T17:09:40.103 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ 2023-10-18T17:09:40.103 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/ 2023-10-18T17:09:40.103 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 55737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-18T17:09:40.103 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-18T17:09:40.103 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-18T17:09:40.104 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-18T17:09:40.104 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 6985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-18T17:09:40.104 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-18T17:09:40.104 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-18T17:09:40.104 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-18T17:09:40.105 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/ 2023-10-18T17:09:40.105 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-18T17:09:40.105 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-18T17:09:40.105 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-18T17:09:40.105 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-18T17:09:40.105 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-18T17:09:40.106 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/ 2023-10-18T17:09:40.106 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 81737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-18T17:09:40.106 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/ 2023-10-18T17:09:40.106 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 198337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-18T17:09:40.107 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 35977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-18T17:09:40.107 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-18T17:09:40.107 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 32337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-18T17:09:40.107 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/ 2023-10-18T17:09:40.107 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 649297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-18T17:09:40.107 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/ 2023-10-18T17:09:40.108 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 63809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-18T17:09:40.108 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 777689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-18T17:09:40.108 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ 2023-10-18T17:09:40.108 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-18T17:09:40.108 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-18T17:09:40.109 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-18T17:09:40.109 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-18T17:09:40.109 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-18T17:09:40.109 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-18T17:09:40.109 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-18T17:09:40.110 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-18T17:09:40.110 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-18T17:09:40.110 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-18T17:09:40.110 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-18T17:09:40.110 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-18T17:09:40.111 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-18T17:09:40.111 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-18T17:09:40.111 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-18T17:09:40.111 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-18T17:09:40.111 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-18T17:09:40.112 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-18T17:09:40.112 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-18T17:09:40.112 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-18T17:09:40.112 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 55929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-18T17:09:40.112 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-18T17:09:40.112 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-18T17:09:40.113 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/ 2023-10-18T17:09:40.113 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 1047017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-18T17:09:40.113 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/ 2023-10-18T17:09:40.113 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 125697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-18T17:09:40.113 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/ 2023-10-18T17:09:40.114 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 194209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-18T17:09:40.114 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-18T17:09:40.114 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 57881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-18T17:09:40.114 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 60337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-18T17:09:40.114 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/ 2023-10-18T17:09:40.115 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 390473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-18T17:09:40.115 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-18T17:09:40.115 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-18T17:09:40.115 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-18T17:09:40.115 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-18T17:09:40.116 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/hsr/ 2023-10-18T17:09:40.116 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 99729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/hsr/hsr.ko 2023-10-18T17:09:40.116 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ 2023-10-18T17:09:40.116 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ 2023-10-18T17:09:40.116 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 45233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-18T17:09:40.117 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 254625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-18T17:09:40.117 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 47289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-18T17:09:40.117 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ 2023-10-18T17:09:40.117 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-18T17:09:40.117 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 38905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-18T17:09:40.117 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 48401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-18T17:09:40.118 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-18T17:09:40.118 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 48657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-18T17:09:40.118 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 60633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-18T17:09:40.118 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 61225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-18T17:09:40.118 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-18T17:09:40.119 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-18T17:09:40.119 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-18T17:09:40.119 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ 2023-10-18T17:09:40.119 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 37641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-18T17:09:40.119 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-18T17:09:40.120 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-18T17:09:40.120 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 41673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ip_tables.ko 2023-10-18T17:09:40.120 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-18T17:09:40.120 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-10-18T17:09:40.120 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-18T17:09:40.121 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-18T17:09:40.121 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-18T17:09:40.121 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-10-18T17:09:40.121 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-18T17:09:40.121 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-18T17:09:40.122 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-18T17:09:40.122 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-18T17:09:40.122 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-18T17:09:40.122 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-18T17:09:40.122 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-18T17:09:40.123 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-18T17:09:40.123 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-18T17:09:40.123 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-10-18T17:09:40.123 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-18T17:09:40.123 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-18T17:09:40.124 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-18T17:09:40.124 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-18T17:09:40.124 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-18T17:09:40.124 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-18T17:09:40.124 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-18T17:09:40.124 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-18T17:09:40.125 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-18T17:09:40.125 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-18T17:09:40.125 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-18T17:09:40.125 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-18T17:09:40.125 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-18T17:09:40.126 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-18T17:09:40.126 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-18T17:09:40.126 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-18T17:09:40.126 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-18T17:09:40.126 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-18T17:09:40.127 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-18T17:09:40.127 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-18T17:09:40.127 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 41665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-18T17:09:40.127 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-18T17:09:40.127 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ 2023-10-18T17:09:40.128 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-18T17:09:40.128 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 39537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-18T17:09:40.128 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-18T17:09:40.128 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 80897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_gre.ko 2023-10-18T17:09:40.128 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 93577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-18T17:09:40.129 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-18T17:09:40.129 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 53273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-18T17:09:40.129 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-18T17:09:40.129 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/mip6.ko 2023-10-18T17:09:40.129 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ 2023-10-18T17:09:40.129 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 42169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-18T17:09:40.130 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-10-18T17:09:40.130 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-18T17:09:40.130 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-18T17:09:40.130 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-18T17:09:40.130 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-18T17:09:40.131 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-18T17:09:40.131 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-18T17:09:40.131 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-18T17:09:40.131 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-18T17:09:40.131 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-18T17:09:40.132 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-18T17:09:40.132 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-18T17:09:40.132 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-18T17:09:40.132 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-18T17:09:40.132 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-18T17:09:40.132 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-18T17:09:40.133 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 39113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-18T17:09:40.133 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-18T17:09:40.133 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-18T17:09:40.133 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-18T17:09:40.134 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-18T17:09:40.134 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-18T17:09:40.134 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-18T17:09:40.134 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-18T17:09:40.134 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 74073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-18T17:09:40.134 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-18T17:09:40.135 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-18T17:09:40.135 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/ 2023-10-18T17:09:40.135 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 82833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-18T17:09:40.135 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/ 2023-10-18T17:09:40.135 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 125281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-18T17:09:40.136 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-18T17:09:40.136 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 25953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-18T17:09:40.136 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 35569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-18T17:09:40.136 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-18T17:09:40.136 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-18T17:09:40.137 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 53241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-18T17:09:40.137 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/lapb/ 2023-10-18T17:09:40.137 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 47977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/lapb/lapb.ko 2023-10-18T17:09:40.137 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/ 2023-10-18T17:09:40.137 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-18T17:09:40.138 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 267777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc2.ko 2023-10-18T17:09:40.138 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/ 2023-10-18T17:09:40.138 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 290417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-18T17:09:40.138 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/ 2023-10-18T17:09:40.138 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-18T17:09:40.139 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ 2023-10-18T17:09:40.139 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ 2023-10-18T17:09:40.139 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 119585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-18T17:09:40.139 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-18T17:09:40.139 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-18T17:09:40.140 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-18T17:09:40.140 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 100297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-18T17:09:40.140 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 101441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-18T17:09:40.140 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 102817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-18T17:09:40.140 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 103481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-18T17:09:40.140 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 112849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-18T17:09:40.141 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 60329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-18T17:09:40.141 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 109593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-18T17:09:40.141 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 113129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-18T17:09:40.141 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 112585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-18T17:09:40.142 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 111585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-18T17:09:40.142 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 114465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-18T17:09:40.142 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-18T17:09:40.142 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ 2023-10-18T17:09:40.142 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 411729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-18T17:09:40.143 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-18T17:09:40.143 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-18T17:09:40.143 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-18T17:09:40.143 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-18T17:09:40.143 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-18T17:09:40.143 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-18T17:09:40.144 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-18T17:09:40.144 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-18T17:09:40.144 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-18T17:09:40.144 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-18T17:09:40.144 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-18T17:09:40.145 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-18T17:09:40.145 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-18T17:09:40.145 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 49257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-18T17:09:40.145 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 408257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-18T17:09:40.145 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-18T17:09:40.146 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-18T17:09:40.146 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-18T17:09:40.146 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 118145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-18T17:09:40.146 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-18T17:09:40.146 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-18T17:09:40.147 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 107297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-18T17:09:40.147 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-18T17:09:40.147 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-18T17:09:40.147 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 66641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-18T17:09:40.147 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-18T17:09:40.148 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-18T17:09:40.148 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-18T17:09:40.148 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 89473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-18T17:09:40.148 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-18T17:09:40.148 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 37129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-18T17:09:40.149 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 95417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-18T17:09:40.149 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-18T17:09:40.149 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-18T17:09:40.149 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-18T17:09:40.149 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-18T17:09:40.150 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-18T17:09:40.150 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 44065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-18T17:09:40.150 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 615313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-18T17:09:40.150 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 42561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-18T17:09:40.150 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-18T17:09:40.151 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-10-18T17:09:40.151 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 39785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-18T17:09:40.151 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-18T17:09:40.151 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 49377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-18T17:09:40.151 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-18T17:09:40.152 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-18T17:09:40.152 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 40721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-18T17:09:40.152 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-18T17:09:40.152 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-18T17:09:40.152 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-18T17:09:40.153 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-18T17:09:40.153 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-18T17:09:40.153 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-18T17:09:40.153 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-18T17:09:40.153 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-18T17:09:40.154 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-18T17:09:40.154 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_osf.ko 2023-10-18T17:09:40.154 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-18T17:09:40.154 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-18T17:09:40.154 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-18T17:09:40.155 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-18T17:09:40.155 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-18T17:09:40.155 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_synproxy.ko 2023-10-18T17:09:40.155 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tproxy.ko 2023-10-18T17:09:40.155 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 89313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/x_tables.ko 2023-10-18T17:09:40.156 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-18T17:09:40.156 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-18T17:09:40.156 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-18T17:09:40.156 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-18T17:09:40.156 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 18169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-18T17:09:40.156 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-18T17:09:40.157 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-18T17:09:40.157 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-18T17:09:40.157 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 38873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-18T17:09:40.157 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-18T17:09:40.157 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-18T17:09:40.158 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-18T17:09:40.158 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-18T17:09:40.158 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-18T17:09:40.158 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-18T17:09:40.158 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-18T17:09:40.159 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-18T17:09:40.159 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 14337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-18T17:09:40.159 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-18T17:09:40.159 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-18T17:09:40.159 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-18T17:09:40.159 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-18T17:09:40.160 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-18T17:09:40.160 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-18T17:09:40.160 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-18T17:09:40.160 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-18T17:09:40.160 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-18T17:09:40.161 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-18T17:09:40.161 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-18T17:09:40.161 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-18T17:09:40.161 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-18T17:09:40.161 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-18T17:09:40.162 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-18T17:09:40.162 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-18T17:09:40.162 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-18T17:09:40.162 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-18T17:09:40.162 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-18T17:09:40.163 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-18T17:09:40.163 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-18T17:09:40.163 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 43289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-18T17:09:40.163 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-18T17:09:40.163 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-18T17:09:40.164 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-18T17:09:40.164 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-18T17:09:40.164 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-18T17:09:40.164 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-18T17:09:40.164 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-18T17:09:40.164 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-18T17:09:40.165 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-18T17:09:40.165 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-18T17:09:40.165 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-18T17:09:40.165 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-18T17:09:40.165 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-18T17:09:40.166 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-18T17:09:40.166 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-18T17:09:40.166 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-18T17:09:40.166 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-18T17:09:40.166 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-18T17:09:40.167 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-18T17:09:40.167 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-18T17:09:40.167 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-18T17:09:40.167 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-18T17:09:40.167 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-18T17:09:40.168 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-18T17:09:40.168 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 16089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-18T17:09:40.168 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-18T17:09:40.168 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-18T17:09:40.168 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-18T17:09:40.168 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 8553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-18T17:09:40.169 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpudp.ko 2023-10-18T17:09:40.169 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-18T17:09:40.169 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-18T17:09:40.169 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/ 2023-10-18T17:09:40.169 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-18T17:09:40.170 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/ 2023-10-18T17:09:40.170 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 12425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-18T17:09:40.170 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/ 2023-10-18T17:09:40.170 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 380033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-18T17:09:40.170 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-18T17:09:40.171 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-18T17:09:40.171 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 11793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-18T17:09:40.171 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/ 2023-10-18T17:09:40.171 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-18T17:09:40.171 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/ 2023-10-18T17:09:40.172 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 110201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/phonet.ko 2023-10-18T17:09:40.172 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 54697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/pn_pep.ko 2023-10-18T17:09:40.172 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/ 2023-10-18T17:09:40.172 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 251481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-18T17:09:40.172 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 164937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-18T17:09:40.173 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 67377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-18T17:09:40.173 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rxrpc/ 2023-10-18T17:09:40.173 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 819657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rxrpc/rxrpc.ko 2023-10-18T17:09:40.173 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/ 2023-10-18T17:09:40.173 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 32241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-18T17:09:40.174 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-18T17:09:40.174 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-18T17:09:40.174 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-18T17:09:40.174 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-18T17:09:40.174 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 43449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-18T17:09:40.175 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 31961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-18T17:09:40.175 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-18T17:09:40.175 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 35297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-18T17:09:40.175 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-18T17:09:40.175 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-18T17:09:40.175 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-18T17:09:40.176 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_cgroup.ko 2023-10-18T17:09:40.176 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 31401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-18T17:09:40.176 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 31769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-18T17:09:40.176 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 38489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-18T17:09:40.176 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 61409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-18T17:09:40.177 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-18T17:09:40.177 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 13409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-18T17:09:40.177 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-18T17:09:40.177 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-18T17:09:40.177 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-18T17:09:40.178 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-18T17:09:40.178 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 21649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-18T17:09:40.178 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-18T17:09:40.178 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 34633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-18T17:09:40.178 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 33609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-18T17:09:40.179 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 31617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq_codel.ko 2023-10-18T17:09:40.179 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 35433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-18T17:09:40.179 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 49601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-18T17:09:40.179 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-18T17:09:40.179 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 66393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-18T17:09:40.180 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-18T17:09:40.180 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 30273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-18T17:09:40.180 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-18T17:09:40.180 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-18T17:09:40.180 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 36137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-18T17:09:40.180 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 27497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-18T17:09:40.181 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-18T17:09:40.181 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-18T17:09:40.181 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 48793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-18T17:09:40.181 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 32905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-18T17:09:40.181 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 26881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-18T17:09:40.182 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 31353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-18T17:09:40.182 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-18T17:09:40.182 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 28105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-18T17:09:40.182 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/ 2023-10-18T17:09:40.182 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 929745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-18T17:09:40.183 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 19033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-18T17:09:40.183 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/ 2023-10-18T17:09:40.183 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/ 2023-10-18T17:09:40.183 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 336529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-18T17:09:40.183 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 54737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-18T17:09:40.184 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 1520161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-18T17:09:40.184 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/ 2023-10-18T17:09:40.184 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 707721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-18T17:09:40.184 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/ 2023-10-18T17:09:40.184 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-18T17:09:40.185 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 862641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-18T17:09:40.185 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/ 2023-10-18T17:09:40.185 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-18T17:09:40.185 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/ 2023-10-18T17:09:40.185 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 85337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-18T17:09:40.186 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 68049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-18T17:09:40.186 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 96193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-18T17:09:40.186 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 10705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-18T17:09:40.186 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 17521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-18T17:09:40.186 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/x25/ 2023-10-18T17:09:40.187 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 125177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/x25/x25.ko 2023-10-18T17:09:40.187 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/ 2023-10-18T17:09:40.187 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 22657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_algo.ko 2023-10-18T17:09:40.187 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 20649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-18T17:09:40.187 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 102257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_user.ko 2023-10-18T17:09:40.187 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/ 2023-10-18T17:09:40.188 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/ 2023-10-18T17:09:40.188 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 15537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-18T17:09:40.188 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 639863 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-18T17:09:40.188 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 623919 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-18T17:09:40.188 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 7663 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-18T17:09:40.189 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 23428 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-18T17:09:40.189 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 9821 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-18T17:09:40.189 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 70004 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-18T17:09:40.189 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 146313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-18T17:09:40.189 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 232548 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-18T17:09:40.190 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 210 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-18T17:09:40.190 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 72606 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-18T17:09:40.190 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 879 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-18T17:09:40.190 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 254438 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-18T17:09:40.190 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 309363 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-18T17:09:40.191 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/ 2023-10-18T17:09:40.191 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/share/ 2023-10-18T17:09:40.191 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/share/doc/ 2023-10-18T17:09:40.191 INFO:teuthology.orchestra.run.smithi158.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/ 2023-10-18T17:09:40.191 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 174 2023-10-10 19:59 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/changelog.Debian.gz 2023-10-18T17:09:40.191 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-r--r-- root/root 691 2023-10-10 19:59 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/copyright 2023-10-18T17:09:40.192 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-18T17:09:40.193 INFO:teuthology.task.kernel:searching for kernel 6.6.0-rc5-g47672119149b 2023-10-18T17:09:40.193 DEBUG:teuthology.orchestra.run.smithi158:> egrep '(submenu|menuentry.*6.6.0-rc5-g47672119149b).*{' /boot/grub/grub.cfg 2023-10-18T17:09:40.202 INFO:teuthology.orchestra.run.smithi158.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-18T17:09:40.202 INFO:teuthology.orchestra.run.smithi158.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g47672119149b' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g47672119149b-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-18T17:09:40.202 INFO:teuthology.orchestra.run.smithi158.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g47672119149b (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g47672119149b-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-18T17:09:40.203 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-10-18T17:09:40.203 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-rc5-g47672119149b 2023-10-18T17:09:40.203 DEBUG:teuthology.orchestra.run.smithi158:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-10-18T17:09:40.247 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi158.front.sepia.ceph.com to complete... 2023-10-18T17:09:41.039 INFO:teuthology.orchestra.run.smithi158.stderr:Sourcing file `/etc/default/grub' 2023-10-18T17:09:41.043 INFO:teuthology.orchestra.run.smithi158.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-18T17:09:41.053 INFO:teuthology.orchestra.run.smithi158.stderr:Generating grub configuration file ... 2023-10-18T17:09:41.286 INFO:teuthology.orchestra.run.smithi158.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-18T17:09:41.297 INFO:teuthology.orchestra.run.smithi158.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-18T17:09:41.653 INFO:teuthology.orchestra.run.smithi158.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-18T17:09:41.665 INFO:teuthology.orchestra.run.smithi158.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-18T17:09:42.926 INFO:teuthology.orchestra.run.smithi158.stderr:done 2023-10-18T17:10:14.060 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-18T17:10:14.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-18T17:10:14.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:10:48.699 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-18T17:10:57.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-18T17:10:57.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:11:00.762 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-18T17:11:12.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-18T17:11:12.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:11:31.194 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-18T17:11:46.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-18T17:11:46.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:11:46.200 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-18T17:12:04.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-18T17:12:04.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:12:04.466 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-10-18T17:12:05.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-18T17:12:05.192 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-rc5-g47672119149b"... 2023-10-18T17:12:05.192 DEBUG:teuthology.orchestra.run.smithi158:> uname -r 2023-10-18T17:12:05.252 INFO:teuthology.orchestra.run.smithi158.stdout:6.6.0-rc5-g47672119149b 2023-10-18T17:12:05.253 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-18T17:12:05.253 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-18T17:12:05.253 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-18T17:12:06.255 DEBUG:teuthology.parallel:result is None 2023-10-18T17:12:06.255 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-18T17:12:06.265 INFO:teuthology.task.internal:Creating test directory... 2023-10-18T17:12:06.266 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-18T17:12:06.335 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-18T17:12:06.346 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-18T17:12:06.364 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-18T17:12:06.389 INFO:teuthology.task.internal:Creating archive directory... 2023-10-18T17:12:06.390 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-18T17:12:06.398 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-18T17:12:06.427 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-18T17:12:06.439 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-18T17:12:06.439 DEBUG:teuthology.orchestra.run.smithi183:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-18T17:12:06.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T17:12:06.445 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-18T17:12:06.470 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-18T17:12:06.540 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T17:12:06.554 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T17:12:06.558 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T17:12:06.586 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T17:12:06.591 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-18T17:12:06.607 INFO:teuthology.task.internal:Configuring sudo... 2023-10-18T17:12:06.608 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-18T17:12:06.616 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-18T17:12:06.646 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-18T17:12:06.656 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-18T17:12:06.657 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-18T17:12:06.694 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-18T17:12:06.705 DEBUG:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T17:12:06.769 DEBUG:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T17:12:06.830 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:12:06.831 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-18T17:12:06.923 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T17:12:06.930 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T17:12:06.978 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:12:06.979 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-18T17:12:07.010 DEBUG:teuthology.orchestra.run.smithi158:> sudo service rsyslog restart 2023-10-18T17:12:07.017 DEBUG:teuthology.orchestra.run.smithi183:> sudo service rsyslog restart 2023-10-18T17:12:07.146 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-18T17:12:07.158 INFO:teuthology.task.internal:Starting timer... 2023-10-18T17:12:07.158 INFO:teuthology.run_tasks:Running task pcp... 2023-10-18T17:12:07.179 INFO:teuthology.run_tasks:Running task selinux... 2023-10-18T17:12:07.190 DEBUG:teuthology.task.selinux:Excluding smithi158: OS 'ubuntu' does not support SELinux 2023-10-18T17:12:07.191 DEBUG:teuthology.task.selinux:Excluding smithi183: OS 'ubuntu' does not support SELinux 2023-10-18T17:12:07.191 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-18T17:12:07.191 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-18T17:12:07.192 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-18T17:12:07.192 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-18T17:12:07.204 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-18T17:12:07.209 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-18T17:12:07.335 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-18T17:12:07.354 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-18T17:12:07.356 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi158.front.sepia.ceph.com,smithi183.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-18T17:19:55.458 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi158.front.sepia.ceph.com'), Remote(name='ubuntu@smithi183.front.sepia.ceph.com')] 2023-10-18T17:19:55.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-18T17:19:55.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:19:55.564 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-10-18T17:19:55.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-18T17:19:55.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-18T17:19:55.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:19:55.862 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-10-18T17:19:55.983 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-18T17:19:55.984 INFO:teuthology.run_tasks:Running task clock... 2023-10-18T17:19:55.996 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-18T17:19:55.997 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-18T17:19:55.997 DEBUG:teuthology.orchestra.run.smithi158:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T17:19:56.005 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-18T17:19:56.006 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T17:19:56.041 INFO:teuthology.orchestra.run.smithi183.stdout:18 Oct 17:19:56 ntpd[23169]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-18T17:19:56.041 INFO:teuthology.orchestra.run.smithi183.stdout:18 Oct 17:19:56 ntpd[23169]: Command line: ntpd -gq 2023-10-18T17:19:56.042 INFO:teuthology.orchestra.run.smithi183.stdout:18 Oct 17:19:56 ntpd[23169]: proto: precision = 0.052 usec (-24) 2023-10-18T17:19:56.042 INFO:teuthology.orchestra.run.smithi183.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-18T17:19:56.043 INFO:teuthology.orchestra.run.smithi183.stdout:18 Oct 17:19:56 ntpd[23169]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-18T17:19:56.043 INFO:teuthology.orchestra.run.smithi183.stdout:18 Oct 17:19:56 ntpd[23169]: restrict ::: KOD does nothing without LIMITED. 2023-10-18T17:19:56.044 INFO:teuthology.orchestra.run.smithi183.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-18T17:19:56.044 INFO:teuthology.orchestra.run.smithi183.stdout:18 Oct 17:19:56 ntpd[23169]: Listen and drop on 0 v6wildcard [::]:123 2023-10-18T17:19:56.045 INFO:teuthology.orchestra.run.smithi183.stdout:18 Oct 17:19:56 ntpd[23169]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-18T17:19:56.045 INFO:teuthology.orchestra.run.smithi183.stdout:18 Oct 17:19:56 ntpd[23169]: Listen normally on 2 lo 127.0.0.1:123 2023-10-18T17:19:56.045 INFO:teuthology.orchestra.run.smithi183.stdout:18 Oct 17:19:56 ntpd[23169]: Listen normally on 3 enp3s0f1 172.21.15.183:123 2023-10-18T17:19:56.045 INFO:teuthology.orchestra.run.smithi183.stdout:18 Oct 17:19:56 ntpd[23169]: Listen normally on 4 lo [::1]:123 2023-10-18T17:19:56.046 INFO:teuthology.orchestra.run.smithi183.stdout:18 Oct 17:19:56 ntpd[23169]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8085%5]:123 2023-10-18T17:19:56.046 INFO:teuthology.orchestra.run.smithi183.stdout:18 Oct 17:19:56 ntpd[23169]: Listening on routing socket on fd #22 for interface updates 2023-10-18T17:19:56.072 INFO:teuthology.orchestra.run.smithi158.stdout:18 Oct 17:19:56 ntpd[22760]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-18T17:19:56.072 INFO:teuthology.orchestra.run.smithi158.stdout:18 Oct 17:19:56 ntpd[22760]: Command line: ntpd -gq 2023-10-18T17:19:56.074 INFO:teuthology.orchestra.run.smithi158.stdout:18 Oct 17:19:56 ntpd[22760]: proto: precision = 0.041 usec (-24) 2023-10-18T17:19:56.075 INFO:teuthology.orchestra.run.smithi158.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-18T17:19:56.075 INFO:teuthology.orchestra.run.smithi158.stdout:18 Oct 17:19:56 ntpd[22760]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-18T17:19:56.076 INFO:teuthology.orchestra.run.smithi158.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-18T17:19:56.077 INFO:teuthology.orchestra.run.smithi158.stdout:18 Oct 17:19:56 ntpd[22760]: restrict ::: KOD does nothing without LIMITED. 2023-10-18T17:19:56.077 INFO:teuthology.orchestra.run.smithi158.stdout:18 Oct 17:19:56 ntpd[22760]: Listen and drop on 0 v6wildcard [::]:123 2023-10-18T17:19:56.077 INFO:teuthology.orchestra.run.smithi158.stdout:18 Oct 17:19:56 ntpd[22760]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-18T17:19:56.078 INFO:teuthology.orchestra.run.smithi158.stdout:18 Oct 17:19:56 ntpd[22760]: Listen normally on 2 lo 127.0.0.1:123 2023-10-18T17:19:56.078 INFO:teuthology.orchestra.run.smithi158.stdout:18 Oct 17:19:56 ntpd[22760]: Listen normally on 3 enp3s0f1 172.21.15.158:123 2023-10-18T17:19:56.078 INFO:teuthology.orchestra.run.smithi158.stdout:18 Oct 17:19:56 ntpd[22760]: Listen normally on 4 lo [::1]:123 2023-10-18T17:19:56.078 INFO:teuthology.orchestra.run.smithi158.stdout:18 Oct 17:19:56 ntpd[22760]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:726f%5]:123 2023-10-18T17:19:56.078 INFO:teuthology.orchestra.run.smithi158.stdout:18 Oct 17:19:56 ntpd[22760]: Listening on routing socket on fd #22 for interface updates 2023-10-18T17:19:57.042 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:19:57 ntpd[23169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:19:57.042 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:19:57 ntpd[23169]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:19:57.042 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:19:57 ntpd[23169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:19:57.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:19:57 ntpd[23169]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:19:57.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:19:57 ntpd[23169]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T17:19:57.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:19:57 ntpd[23169]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T17:19:57.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:57 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:19:57.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:57 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:19:57.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:57 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:19:57.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:57 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:19:57.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:57 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:19:57.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:57 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:19:57.076 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:57 ntpd[22760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T17:19:57.076 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:57 ntpd[22760]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T17:19:59.042 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:19:59 ntpd[23169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:19:59.042 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:19:59 ntpd[23169]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:19:59.042 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:19:59 ntpd[23169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:19:59.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:19:59 ntpd[23169]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:19:59.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:19:59 ntpd[23169]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T17:19:59.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:19:59 ntpd[23169]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T17:19:59.073 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:59 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:19:59.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:59 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:19:59.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:59 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:19:59.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:59 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:19:59.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:59 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:19:59.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:59 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:19:59.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:59 ntpd[22760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T17:19:59.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:59 ntpd[22760]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T17:19:59.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:59 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:19:59.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:59 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:19:59.076 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:59 ntpd[22760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T17:19:59.076 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:19:59 ntpd[22760]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T17:20:00.042 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:00 ntpd[23169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:00.042 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:00 ntpd[23169]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:00.042 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:00 ntpd[23169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:00.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:00 ntpd[23169]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:00.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:00 ntpd[23169]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T17:20:00.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:00 ntpd[23169]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T17:20:00.073 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:00 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:00.073 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:00 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:00.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:00 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:00.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:00 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:00.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:00 ntpd[22760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T17:20:00.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:00 ntpd[22760]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T17:20:01.042 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:01 ntpd[23169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:01.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:01 ntpd[23169]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:01.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:01 ntpd[23169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:01.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:01 ntpd[23169]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:01.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:01 ntpd[23169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:01.044 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:01 ntpd[23169]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:01.044 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:01 ntpd[23169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:01.044 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:01 ntpd[23169]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:01.044 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:01 ntpd[23169]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T17:20:01.044 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:01 ntpd[23169]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T17:20:01.045 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:01 ntpd[23169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:01.045 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:01 ntpd[23169]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:01.045 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:01 ntpd[23169]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T17:20:01.045 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:01 ntpd[23169]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T17:20:01.073 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:01 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:01.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:01 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:01.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:01 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:01.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:01 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:01.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:01 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:01.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:01 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:01.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:01 ntpd[22760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T17:20:01.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:01 ntpd[22760]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T17:20:01.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:01 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:01.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:01 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:01.076 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:01 ntpd[22760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T17:20:01.076 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:01 ntpd[22760]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T17:20:02.042 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:02 ntpd[23169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:02.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:02 ntpd[23169]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:02.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:02 ntpd[23169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:02.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:02 ntpd[23169]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:02.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:02 ntpd[23169]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T17:20:02.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:02 ntpd[23169]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T17:20:02.073 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:02 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:02.073 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:02 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:02.073 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:02 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:02.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:02 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:02.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:02 ntpd[22760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T17:20:02.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:02 ntpd[22760]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T17:20:03.042 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:03 ntpd[23169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:03.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:03 ntpd[23169]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:03.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:03 ntpd[23169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:03.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:03 ntpd[23169]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:03.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:03 ntpd[23169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:03.043 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:03 ntpd[23169]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:03.044 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:03 ntpd[23169]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T17:20:03.044 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:03 ntpd[23169]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T17:20:03.044 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:03 ntpd[23169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:03.044 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:03 ntpd[23169]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:03.045 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:03 ntpd[23169]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T17:20:03.045 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:03 ntpd[23169]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T17:20:03.045 INFO:teuthology.orchestra.run.smithi183.stdout:18 Oct 17:20:03 ntpd[23169]: ntpd: time slew +0.001514 s 2023-10-18T17:20:03.045 INFO:teuthology.orchestra.run.smithi183.stdout:ntpd: time slew +0.001514s 2023-10-18T17:20:03.046 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:03 ntpd[23169]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-18T17:20:03.046 INFO:teuthology.orchestra.run.smithi183.stderr:18 Oct 17:20:03 ntpd[23169]: can't open /var/log/ntpstats/loopstats.20231018: Permission denied 2023-10-18T17:20:03.073 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:03 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:03.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:03 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:03.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:03 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:03.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:03 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:03.074 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:03 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:03.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:03 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:03.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:03 ntpd[22760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T17:20:03.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:03 ntpd[22760]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T17:20:03.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:03 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T17:20:03.075 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:03 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T17:20:03.076 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:03 ntpd[22760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T17:20:03.076 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:03 ntpd[22760]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T17:20:03.076 INFO:teuthology.orchestra.run.smithi158.stdout:18 Oct 17:20:03 ntpd[22760]: ntpd: time slew -0.003193 s 2023-10-18T17:20:03.076 INFO:teuthology.orchestra.run.smithi158.stdout:ntpd: time slew -0.003193s 2023-10-18T17:20:03.077 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:03 ntpd[22760]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-18T17:20:03.077 INFO:teuthology.orchestra.run.smithi158.stderr:18 Oct 17:20:03 ntpd[22760]: can't open /var/log/ntpstats/loopstats.20231018: Permission denied 2023-10-18T17:20:03.116 INFO:teuthology.orchestra.run.smithi183.stdout: remote refid st t when poll reach delay offset jitter 2023-10-18T17:20:03.116 INFO:teuthology.orchestra.run.smithi183.stdout:============================================================================== 2023-10-18T17:20:03.117 INFO:teuthology.orchestra.run.smithi183.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-18T17:20:03.117 INFO:teuthology.orchestra.run.smithi183.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-18T17:20:03.117 INFO:teuthology.orchestra.run.smithi183.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-18T17:20:03.117 INFO:teuthology.orchestra.run.smithi183.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-18T17:20:03.215 INFO:teuthology.orchestra.run.smithi158.stdout: remote refid st t when poll reach delay offset jitter 2023-10-18T17:20:03.216 INFO:teuthology.orchestra.run.smithi158.stdout:============================================================================== 2023-10-18T17:20:03.216 INFO:teuthology.orchestra.run.smithi158.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-18T17:20:03.216 INFO:teuthology.orchestra.run.smithi158.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-18T17:20:03.216 INFO:teuthology.orchestra.run.smithi158.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-18T17:20:03.217 INFO:teuthology.orchestra.run.smithi158.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-18T17:20:03.218 INFO:teuthology.run_tasks:Running task install... 2023-10-18T17:20:03.231 DEBUG:teuthology.task.install:project ceph 2023-10-18T17:20:03.232 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5'}} 2023-10-18T17:20:03.232 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5'} 2023-10-18T17:20:03.233 INFO:teuthology.task.install:Using flavor: default 2023-10-18T17:20:03.239 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-18T17:20:03.239 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-18T17:20:03.240 DEBUG:teuthology.orchestra.run.smithi158:> sudo apt-key list | grep Ceph 2023-10-18T17:20:03.241 DEBUG:teuthology.orchestra.run.smithi183:> sudo apt-key list | grep Ceph 2023-10-18T17:20:03.343 INFO:teuthology.orchestra.run.smithi183.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-18T17:20:03.402 INFO:teuthology.orchestra.run.smithi183.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-18T17:20:03.402 INFO:teuthology.orchestra.run.smithi183.stdout:uid [ unknown] Ceph.com (release key) 2023-10-18T17:20:03.403 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-18T17:20:03.404 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-18T17:20:03.404 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T17:20:03.487 INFO:teuthology.orchestra.run.smithi158.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-18T17:20:03.553 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default/ 2023-10-18T17:20:03.554 INFO:teuthology.task.install.deb:Package version is 16.2.14-100-gb4ddd52c-1focal 2023-10-18T17:20:03.633 INFO:teuthology.orchestra.run.smithi158.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-18T17:20:03.634 INFO:teuthology.orchestra.run.smithi158.stdout:uid [ unknown] Ceph.com (release key) 2023-10-18T17:20:03.638 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-18T17:20:03.638 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-18T17:20:03.639 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T17:20:03.728 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:20:03.729 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-18T17:20:03.745 DEBUG:teuthology.orchestra.run.smithi183:> sudo apt-get update 2023-10-18T17:20:03.857 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default/ 2023-10-18T17:20:03.857 INFO:teuthology.task.install.deb:Package version is 16.2.14-100-gb4ddd52c-1focal 2023-10-18T17:20:03.888 INFO:teuthology.orchestra.run.smithi183.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-18T17:20:03.895 INFO:teuthology.orchestra.run.smithi183.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-18T17:20:03.916 INFO:teuthology.orchestra.run.smithi183.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-18T17:20:03.964 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:20:03.964 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-18T17:20:03.998 DEBUG:teuthology.orchestra.run.smithi158:> sudo apt-get update 2023-10-18T17:20:04.001 INFO:teuthology.orchestra.run.smithi183.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal InRelease 2023-10-18T17:20:04.001 INFO:teuthology.orchestra.run.smithi183.stdout:Hit:5 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-18T17:20:04.040 INFO:teuthology.orchestra.run.smithi183.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal Release [7,680 B] 2023-10-18T17:20:04.079 INFO:teuthology.orchestra.run.smithi183.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal Release.gpg 2023-10-18T17:20:04.118 INFO:teuthology.orchestra.run.smithi183.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main i386 Packages [3,084 B] 2023-10-18T17:20:04.170 INFO:teuthology.orchestra.run.smithi183.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 Packages [17.2 kB] 2023-10-18T17:20:04.323 INFO:teuthology.orchestra.run.smithi158.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal InRelease 2023-10-18T17:20:04.345 INFO:teuthology.orchestra.run.smithi158.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal Release [7,680 B] 2023-10-18T17:20:04.370 INFO:teuthology.orchestra.run.smithi158.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal Release.gpg 2023-10-18T17:20:04.406 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-18T17:20:04.406 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:5 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-18T17:20:04.406 INFO:teuthology.orchestra.run.smithi158.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 Packages [17.2 kB] 2023-10-18T17:20:04.448 INFO:teuthology.orchestra.run.smithi158.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main i386 Packages [3,084 B] 2023-10-18T17:20:04.460 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-18T17:20:04.541 INFO:teuthology.orchestra.run.smithi183.stdout:Fetched 27.9 kB in 1s (44.1 kB/s) 2023-10-18T17:20:04.542 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-18T17:20:05.583 INFO:teuthology.orchestra.run.smithi183.stdout:Reading package lists... 2023-10-18T17:20:05.608 DEBUG:teuthology.orchestra.run.smithi183:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.2.14-100-gb4ddd52c-1focal cephadm=16.2.14-100-gb4ddd52c-1focal ceph-mds=16.2.14-100-gb4ddd52c-1focal ceph-mgr=16.2.14-100-gb4ddd52c-1focal ceph-common=16.2.14-100-gb4ddd52c-1focal ceph-fuse=16.2.14-100-gb4ddd52c-1focal ceph-test=16.2.14-100-gb4ddd52c-1focal radosgw=16.2.14-100-gb4ddd52c-1focal python3-rados=16.2.14-100-gb4ddd52c-1focal python3-rgw=16.2.14-100-gb4ddd52c-1focal python3-cephfs=16.2.14-100-gb4ddd52c-1focal python3-rbd=16.2.14-100-gb4ddd52c-1focal libcephfs2=16.2.14-100-gb4ddd52c-1focal libcephfs-dev=16.2.14-100-gb4ddd52c-1focal librados2=16.2.14-100-gb4ddd52c-1focal librbd1=16.2.14-100-gb4ddd52c-1focal rbd-fuse=16.2.14-100-gb4ddd52c-1focal python3-cephfs=16.2.14-100-gb4ddd52c-1focal cephfs-shell=16.2.14-100-gb4ddd52c-1focal cephfs-top=16.2.14-100-gb4ddd52c-1focal cephfs-mirror=16.2.14-100-gb4ddd52c-1focal 2023-10-18T17:20:05.678 INFO:teuthology.orchestra.run.smithi183.stdout:Reading package lists... 2023-10-18T17:20:05.842 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 27.9 kB in 2s (18.5 kB/s) 2023-10-18T17:20:05.879 INFO:teuthology.orchestra.run.smithi183.stdout:Building dependency tree... 2023-10-18T17:20:05.879 INFO:teuthology.orchestra.run.smithi183.stdout:Reading state information... 2023-10-18T17:20:06.050 INFO:teuthology.orchestra.run.smithi183.stdout:The following packages were automatically installed and are no longer required: 2023-10-18T17:20:06.050 INFO:teuthology.orchestra.run.smithi183.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-18T17:20:06.051 INFO:teuthology.orchestra.run.smithi183.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-18T17:20:06.051 INFO:teuthology.orchestra.run.smithi183.stdout:The following additional packages will be installed: 2023-10-18T17:20:06.051 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-18T17:20:06.052 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq libjaeger 2023-10-18T17:20:06.052 INFO:teuthology.orchestra.run.smithi183.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2023-10-18T17:20:06.053 INFO:teuthology.orchestra.run.smithi183.stdout: liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 2023-10-18T17:20:06.053 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2023-10-18T17:20:06.053 INFO:teuthology.orchestra.run.smithi183.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-10-18T17:20:06.053 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-10-18T17:20:06.053 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2023-10-18T17:20:06.054 INFO:teuthology.orchestra.run.smithi183.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-10-18T17:20:06.054 INFO:teuthology.orchestra.run.smithi183.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-10-18T17:20:06.054 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2023-10-18T17:20:06.054 INFO:teuthology.orchestra.run.smithi183.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-18T17:20:06.054 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-18T17:20:06.055 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-18T17:20:06.055 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-18T17:20:06.055 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-18T17:20:06.055 INFO:teuthology.orchestra.run.smithi183.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-18T17:20:06.055 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-18T17:20:06.056 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2023-10-18T17:20:06.056 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet 2023-10-18T17:20:06.056 INFO:teuthology.orchestra.run.smithi183.stdout:Suggested packages: 2023-10-18T17:20:06.057 INFO:teuthology.orchestra.run.smithi183.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-18T17:20:06.057 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-18T17:20:06.057 INFO:teuthology.orchestra.run.smithi183.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-18T17:20:06.057 INFO:teuthology.orchestra.run.smithi183.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-18T17:20:06.057 INFO:teuthology.orchestra.run.smithi183.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-18T17:20:06.058 INFO:teuthology.orchestra.run.smithi183.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-18T17:20:06.058 INFO:teuthology.orchestra.run.smithi183.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-18T17:20:06.058 INFO:teuthology.orchestra.run.smithi183.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-18T17:20:06.058 INFO:teuthology.orchestra.run.smithi183.stdout:Recommended packages: 2023-10-18T17:20:06.058 INFO:teuthology.orchestra.run.smithi183.stdout: btrfs-tools 2023-10-18T17:20:06.165 INFO:teuthology.orchestra.run.smithi183.stdout:The following NEW packages will be installed: 2023-10-18T17:20:06.166 INFO:teuthology.orchestra.run.smithi183.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-18T17:20:06.166 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-18T17:20:06.166 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test cephadm cephfs-mirror 2023-10-18T17:20:06.167 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 libjaeger libjq1 2023-10-18T17:20:06.167 INFO:teuthology.orchestra.run.smithi183.stdout: libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d liblttng-ust0 2023-10-18T17:20:06.168 INFO:teuthology.orchestra.run.smithi183.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-10-18T17:20:06.168 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2023-10-18T17:20:06.168 INFO:teuthology.orchestra.run.smithi183.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-10-18T17:20:06.168 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-18T17:20:06.168 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2023-10-18T17:20:06.169 INFO:teuthology.orchestra.run.smithi183.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-10-18T17:20:06.169 INFO:teuthology.orchestra.run.smithi183.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-10-18T17:20:06.169 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2023-10-18T17:20:06.169 INFO:teuthology.orchestra.run.smithi183.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-18T17:20:06.170 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-18T17:20:06.172 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-18T17:20:06.172 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-18T17:20:06.172 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-18T17:20:06.172 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-18T17:20:06.173 INFO:teuthology.orchestra.run.smithi183.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-18T17:20:06.173 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-18T17:20:06.173 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2023-10-18T17:20:06.173 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse socat xmlstarlet 2023-10-18T17:20:06.174 INFO:teuthology.orchestra.run.smithi183.stdout:The following packages will be upgraded: 2023-10-18T17:20:06.174 INFO:teuthology.orchestra.run.smithi183.stdout: librados2 librbd1 2023-10-18T17:20:06.359 INFO:teuthology.orchestra.run.smithi183.stdout:2 upgraded, 104 newly installed, 0 to remove and 256 not upgraded. 2023-10-18T17:20:06.360 INFO:teuthology.orchestra.run.smithi183.stdout:Need to get 174 MB of archives. 2023-10-18T17:20:06.360 INFO:teuthology.orchestra.run.smithi183.stdout:After this operation, 805 MB of additional disk space will be used. 2023-10-18T17:20:06.360 INFO:teuthology.orchestra.run.smithi183.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 16.2.14-100-gb4ddd52c-1focal [3,964 B] 2023-10-18T17:20:06.361 INFO:teuthology.orchestra.run.smithi183.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-18T17:20:06.435 INFO:teuthology.orchestra.run.smithi183.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 16.2.14-100-gb4ddd52c-1focal [3,382 kB] 2023-10-18T17:20:06.444 INFO:teuthology.orchestra.run.smithi183.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-18T17:20:06.479 INFO:teuthology.orchestra.run.smithi183.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-18T17:20:06.602 INFO:teuthology.orchestra.run.smithi183.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-18T17:20:06.731 INFO:teuthology.orchestra.run.smithi183.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 16.2.14-100-gb4ddd52c-1focal [3,389 kB] 2023-10-18T17:20:06.743 INFO:teuthology.orchestra.run.smithi183.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-18T17:20:06.752 INFO:teuthology.orchestra.run.smithi183.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-18T17:20:06.797 INFO:teuthology.orchestra.run.smithi183.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-18T17:20:06.808 INFO:teuthology.orchestra.run.smithi183.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-18T17:20:06.874 INFO:teuthology.orchestra.run.smithi183.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 16.2.14-100-gb4ddd52c-1focal [729 kB] 2023-10-18T17:20:06.890 INFO:teuthology.orchestra.run.smithi183.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 16.2.14-100-gb4ddd52c-1focal [413 kB] 2023-10-18T17:20:06.891 INFO:teuthology.orchestra.run.smithi183.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2023-10-18T17:20:06.909 INFO:teuthology.orchestra.run.smithi183.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-18T17:20:06.915 INFO:teuthology.orchestra.run.smithi183.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-18T17:20:06.955 INFO:teuthology.orchestra.run.smithi183.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 16.2.14-100-gb4ddd52c-1focal [22.2 kB] 2023-10-18T17:20:06.960 INFO:teuthology.orchestra.run.smithi183.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 16.2.14-100-gb4ddd52c-1focal [212 kB] 2023-10-18T17:20:06.965 INFO:teuthology.orchestra.run.smithi183.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 16.2.14-100-gb4ddd52c-1focal [38.4 kB] 2023-10-18T17:20:06.978 INFO:teuthology.orchestra.run.smithi183.stdout:Get:20 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 16.2.14-100-gb4ddd52c-1focal [387 kB] 2023-10-18T17:20:06.996 INFO:teuthology.orchestra.run.smithi183.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 16.2.14-100-gb4ddd52c-1focal [3,689 kB] 2023-10-18T17:20:07.041 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2023-10-18T17:20:07.077 DEBUG:teuthology.orchestra.run.smithi158:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.2.14-100-gb4ddd52c-1focal cephadm=16.2.14-100-gb4ddd52c-1focal ceph-mds=16.2.14-100-gb4ddd52c-1focal ceph-mgr=16.2.14-100-gb4ddd52c-1focal ceph-common=16.2.14-100-gb4ddd52c-1focal ceph-fuse=16.2.14-100-gb4ddd52c-1focal ceph-test=16.2.14-100-gb4ddd52c-1focal radosgw=16.2.14-100-gb4ddd52c-1focal python3-rados=16.2.14-100-gb4ddd52c-1focal python3-rgw=16.2.14-100-gb4ddd52c-1focal python3-cephfs=16.2.14-100-gb4ddd52c-1focal python3-rbd=16.2.14-100-gb4ddd52c-1focal libcephfs2=16.2.14-100-gb4ddd52c-1focal libcephfs-dev=16.2.14-100-gb4ddd52c-1focal librados2=16.2.14-100-gb4ddd52c-1focal librbd1=16.2.14-100-gb4ddd52c-1focal rbd-fuse=16.2.14-100-gb4ddd52c-1focal python3-cephfs=16.2.14-100-gb4ddd52c-1focal cephfs-shell=16.2.14-100-gb4ddd52c-1focal cephfs-top=16.2.14-100-gb4ddd52c-1focal cephfs-mirror=16.2.14-100-gb4ddd52c-1focal 2023-10-18T17:20:07.100 INFO:teuthology.orchestra.run.smithi183.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-18T17:20:07.144 INFO:teuthology.orchestra.run.smithi183.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 16.2.14-100-gb4ddd52c-1focal [116 kB] 2023-10-18T17:20:07.150 INFO:teuthology.orchestra.run.smithi183.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 16.2.14-100-gb4ddd52c-1focal [448 kB] 2023-10-18T17:20:07.165 INFO:teuthology.orchestra.run.smithi183.stdout:Get:25 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 16.2.14-100-gb4ddd52c-1focal [22.6 MB] 2023-10-18T17:20:07.193 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2023-10-18T17:20:07.345 INFO:teuthology.orchestra.run.smithi183.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-18T17:20:07.377 INFO:teuthology.orchestra.run.smithi183.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-18T17:20:07.377 INFO:teuthology.orchestra.run.smithi158.stdout:Building dependency tree... 2023-10-18T17:20:07.378 INFO:teuthology.orchestra.run.smithi158.stdout:Reading state information... 2023-10-18T17:20:07.533 INFO:teuthology.orchestra.run.smithi183.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-18T17:20:07.540 INFO:teuthology.orchestra.run.smithi183.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-18T17:20:07.543 INFO:teuthology.orchestra.run.smithi158.stdout:The following packages were automatically installed and are no longer required: 2023-10-18T17:20:07.544 INFO:teuthology.orchestra.run.smithi158.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-18T17:20:07.545 INFO:teuthology.orchestra.run.smithi158.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-18T17:20:07.545 INFO:teuthology.orchestra.run.smithi158.stdout:The following additional packages will be installed: 2023-10-18T17:20:07.545 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-18T17:20:07.546 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq libjaeger 2023-10-18T17:20:07.546 INFO:teuthology.orchestra.run.smithi158.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2023-10-18T17:20:07.546 INFO:teuthology.orchestra.run.smithi158.stdout: liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 2023-10-18T17:20:07.546 INFO:teuthology.orchestra.run.smithi158.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2023-10-18T17:20:07.547 INFO:teuthology.orchestra.run.smithi158.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-10-18T17:20:07.547 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-10-18T17:20:07.547 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2023-10-18T17:20:07.547 INFO:teuthology.orchestra.run.smithi158.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-10-18T17:20:07.548 INFO:teuthology.orchestra.run.smithi158.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-10-18T17:20:07.548 INFO:teuthology.orchestra.run.smithi158.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2023-10-18T17:20:07.548 INFO:teuthology.orchestra.run.smithi158.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-18T17:20:07.548 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-18T17:20:07.548 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-18T17:20:07.548 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-18T17:20:07.549 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-18T17:20:07.549 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-18T17:20:07.549 INFO:teuthology.orchestra.run.smithi158.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-18T17:20:07.550 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2023-10-18T17:20:07.550 INFO:teuthology.orchestra.run.smithi158.stdout: xmlstarlet 2023-10-18T17:20:07.550 INFO:teuthology.orchestra.run.smithi183.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-18T17:20:07.551 INFO:teuthology.orchestra.run.smithi158.stdout:Suggested packages: 2023-10-18T17:20:07.551 INFO:teuthology.orchestra.run.smithi158.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-18T17:20:07.551 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-18T17:20:07.551 INFO:teuthology.orchestra.run.smithi158.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-18T17:20:07.551 INFO:teuthology.orchestra.run.smithi158.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-18T17:20:07.552 INFO:teuthology.orchestra.run.smithi158.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-18T17:20:07.552 INFO:teuthology.orchestra.run.smithi158.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-18T17:20:07.552 INFO:teuthology.orchestra.run.smithi158.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-18T17:20:07.552 INFO:teuthology.orchestra.run.smithi158.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-18T17:20:07.552 INFO:teuthology.orchestra.run.smithi158.stdout:Recommended packages: 2023-10-18T17:20:07.553 INFO:teuthology.orchestra.run.smithi158.stdout: btrfs-tools 2023-10-18T17:20:07.554 INFO:teuthology.orchestra.run.smithi183.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-18T17:20:07.582 INFO:teuthology.orchestra.run.smithi183.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-18T17:20:07.586 INFO:teuthology.orchestra.run.smithi183.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-18T17:20:07.590 INFO:teuthology.orchestra.run.smithi183.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-18T17:20:07.617 INFO:teuthology.orchestra.run.smithi183.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-18T17:20:07.758 INFO:teuthology.orchestra.run.smithi158.stdout:The following NEW packages will be installed: 2023-10-18T17:20:07.758 INFO:teuthology.orchestra.run.smithi158.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-18T17:20:07.758 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-18T17:20:07.759 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test cephadm cephfs-mirror 2023-10-18T17:20:07.760 INFO:teuthology.orchestra.run.smithi158.stdout: cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 libjaeger libjq1 2023-10-18T17:20:07.760 INFO:teuthology.orchestra.run.smithi158.stdout: libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d liblttng-ust0 2023-10-18T17:20:07.760 INFO:teuthology.orchestra.run.smithi158.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-10-18T17:20:07.760 INFO:teuthology.orchestra.run.smithi158.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2023-10-18T17:20:07.760 INFO:teuthology.orchestra.run.smithi158.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-10-18T17:20:07.761 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-18T17:20:07.761 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2023-10-18T17:20:07.761 INFO:teuthology.orchestra.run.smithi158.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-10-18T17:20:07.761 INFO:teuthology.orchestra.run.smithi158.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-10-18T17:20:07.762 INFO:teuthology.orchestra.run.smithi158.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2023-10-18T17:20:07.762 INFO:teuthology.orchestra.run.smithi158.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-18T17:20:07.762 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-18T17:20:07.762 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-18T17:20:07.763 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-18T17:20:07.763 INFO:teuthology.orchestra.run.smithi158.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-18T17:20:07.763 INFO:teuthology.orchestra.run.smithi158.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-18T17:20:07.763 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-18T17:20:07.763 INFO:teuthology.orchestra.run.smithi158.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-18T17:20:07.764 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2023-10-18T17:20:07.764 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-fuse socat xmlstarlet 2023-10-18T17:20:07.764 INFO:teuthology.orchestra.run.smithi158.stdout:The following packages will be upgraded: 2023-10-18T17:20:07.765 INFO:teuthology.orchestra.run.smithi158.stdout: librados2 librbd1 2023-10-18T17:20:07.788 INFO:teuthology.orchestra.run.smithi183.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-18T17:20:07.858 INFO:teuthology.orchestra.run.smithi158.stdout:2 upgraded, 104 newly installed, 0 to remove and 256 not upgraded. 2023-10-18T17:20:07.859 INFO:teuthology.orchestra.run.smithi158.stdout:Need to get 174 MB of archives. 2023-10-18T17:20:07.859 INFO:teuthology.orchestra.run.smithi158.stdout:After this operation, 805 MB of additional disk space will be used. 2023-10-18T17:20:07.859 INFO:teuthology.orchestra.run.smithi158.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-18T17:20:07.881 INFO:teuthology.orchestra.run.smithi158.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-18T17:20:07.891 INFO:teuthology.orchestra.run.smithi158.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-18T17:20:07.933 INFO:teuthology.orchestra.run.smithi158.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-18T17:20:07.973 INFO:teuthology.orchestra.run.smithi158.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-18T17:20:07.976 INFO:teuthology.orchestra.run.smithi158.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-18T17:20:08.000 INFO:teuthology.orchestra.run.smithi158.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-18T17:20:08.005 INFO:teuthology.orchestra.run.smithi158.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-18T17:20:08.035 INFO:teuthology.orchestra.run.smithi158.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 16.2.14-100-gb4ddd52c-1focal [3,964 B] 2023-10-18T17:20:08.041 INFO:teuthology.orchestra.run.smithi158.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2023-10-18T17:20:08.048 INFO:teuthology.orchestra.run.smithi158.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-18T17:20:08.051 INFO:teuthology.orchestra.run.smithi158.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-18T17:20:08.063 INFO:teuthology.orchestra.run.smithi158.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-18T17:20:08.068 INFO:teuthology.orchestra.run.smithi158.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-18T17:20:08.069 INFO:teuthology.orchestra.run.smithi158.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-18T17:20:08.084 INFO:teuthology.orchestra.run.smithi158.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-18T17:20:08.085 INFO:teuthology.orchestra.run.smithi158.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-18T17:20:08.086 INFO:teuthology.orchestra.run.smithi158.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-18T17:20:08.087 INFO:teuthology.orchestra.run.smithi158.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-18T17:20:08.105 INFO:teuthology.orchestra.run.smithi183.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-18T17:20:08.116 INFO:teuthology.orchestra.run.smithi158.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-18T17:20:08.117 INFO:teuthology.orchestra.run.smithi158.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-18T17:20:08.117 INFO:teuthology.orchestra.run.smithi158.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-18T17:20:08.121 INFO:teuthology.orchestra.run.smithi158.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-18T17:20:08.121 INFO:teuthology.orchestra.run.smithi158.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-18T17:20:08.123 INFO:teuthology.orchestra.run.smithi158.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-18T17:20:08.149 INFO:teuthology.orchestra.run.smithi158.stdout:Get:26 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 16.2.14-100-gb4ddd52c-1focal [3,382 kB] 2023-10-18T17:20:08.150 INFO:teuthology.orchestra.run.smithi158.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-18T17:20:08.152 INFO:teuthology.orchestra.run.smithi158.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-18T17:20:08.163 INFO:teuthology.orchestra.run.smithi158.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-18T17:20:08.163 INFO:teuthology.orchestra.run.smithi158.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-18T17:20:08.173 INFO:teuthology.orchestra.run.smithi158.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-18T17:20:08.173 INFO:teuthology.orchestra.run.smithi183.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-18T17:20:08.174 INFO:teuthology.orchestra.run.smithi158.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-18T17:20:08.175 INFO:teuthology.orchestra.run.smithi158.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-18T17:20:08.179 INFO:teuthology.orchestra.run.smithi158.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-18T17:20:08.181 INFO:teuthology.orchestra.run.smithi158.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-18T17:20:08.181 INFO:teuthology.orchestra.run.smithi158.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-18T17:20:08.185 INFO:teuthology.orchestra.run.smithi183.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-18T17:20:08.193 INFO:teuthology.orchestra.run.smithi158.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-18T17:20:08.195 INFO:teuthology.orchestra.run.smithi158.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-18T17:20:08.198 INFO:teuthology.orchestra.run.smithi158.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-18T17:20:08.199 INFO:teuthology.orchestra.run.smithi158.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-18T17:20:08.217 INFO:teuthology.orchestra.run.smithi158.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-18T17:20:08.372 INFO:teuthology.orchestra.run.smithi183.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-18T17:20:08.373 INFO:teuthology.orchestra.run.smithi183.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-18T17:20:08.378 INFO:teuthology.orchestra.run.smithi183.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-18T17:20:08.383 INFO:teuthology.orchestra.run.smithi183.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-18T17:20:08.396 INFO:teuthology.orchestra.run.smithi183.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-18T17:20:08.420 INFO:teuthology.orchestra.run.smithi183.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-18T17:20:08.431 INFO:teuthology.orchestra.run.smithi183.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-18T17:20:08.458 INFO:teuthology.orchestra.run.smithi158.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-18T17:20:08.495 INFO:teuthology.orchestra.run.smithi158.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-18T17:20:08.496 INFO:teuthology.orchestra.run.smithi158.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-18T17:20:08.535 INFO:teuthology.orchestra.run.smithi158.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-18T17:20:08.536 INFO:teuthology.orchestra.run.smithi158.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-18T17:20:08.536 INFO:teuthology.orchestra.run.smithi158.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-18T17:20:08.537 INFO:teuthology.orchestra.run.smithi158.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-18T17:20:08.537 INFO:teuthology.orchestra.run.smithi158.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-18T17:20:08.538 INFO:teuthology.orchestra.run.smithi158.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-18T17:20:08.549 INFO:teuthology.orchestra.run.smithi158.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-18T17:20:08.552 INFO:teuthology.orchestra.run.smithi158.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-18T17:20:08.553 INFO:teuthology.orchestra.run.smithi158.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-18T17:20:08.571 INFO:teuthology.orchestra.run.smithi158.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-18T17:20:08.578 INFO:teuthology.orchestra.run.smithi158.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-18T17:20:08.582 INFO:teuthology.orchestra.run.smithi158.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-18T17:20:08.585 INFO:teuthology.orchestra.run.smithi158.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-18T17:20:08.586 INFO:teuthology.orchestra.run.smithi158.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-18T17:20:08.589 INFO:teuthology.orchestra.run.smithi158.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-18T17:20:08.592 INFO:teuthology.orchestra.run.smithi158.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-18T17:20:08.592 INFO:teuthology.orchestra.run.smithi158.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-18T17:20:08.595 INFO:teuthology.orchestra.run.smithi158.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-18T17:20:08.596 INFO:teuthology.orchestra.run.smithi158.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-18T17:20:08.596 INFO:teuthology.orchestra.run.smithi183.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-18T17:20:08.607 INFO:teuthology.orchestra.run.smithi183.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 16.2.14-100-gb4ddd52c-1focal [5,914 kB] 2023-10-18T17:20:08.610 INFO:teuthology.orchestra.run.smithi158.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-18T17:20:08.612 INFO:teuthology.orchestra.run.smithi158.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-18T17:20:08.614 INFO:teuthology.orchestra.run.smithi158.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-18T17:20:08.633 INFO:teuthology.orchestra.run.smithi158.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-18T17:20:08.633 INFO:teuthology.orchestra.run.smithi158.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-18T17:20:08.637 INFO:teuthology.orchestra.run.smithi158.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-18T17:20:08.638 INFO:teuthology.orchestra.run.smithi158.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-18T17:20:08.639 INFO:teuthology.orchestra.run.smithi158.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-18T17:20:08.640 INFO:teuthology.orchestra.run.smithi158.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-18T17:20:08.641 INFO:teuthology.orchestra.run.smithi158.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-18T17:20:08.657 INFO:teuthology.orchestra.run.smithi158.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-18T17:20:08.766 INFO:teuthology.orchestra.run.smithi183.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 16.2.14-100-gb4ddd52c-1focal [204 kB] 2023-10-18T17:20:08.770 INFO:teuthology.orchestra.run.smithi183.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 16.2.14-100-gb4ddd52c-1focal [126 kB] 2023-10-18T17:20:08.773 INFO:teuthology.orchestra.run.smithi183.stdout:Get:51 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 16.2.14-100-gb4ddd52c-1focal [1,538 kB] 2023-10-18T17:20:08.838 INFO:teuthology.orchestra.run.smithi183.stdout:Get:52 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 16.2.14-100-gb4ddd52c-1focal [6,998 kB] 2023-10-18T17:20:08.935 INFO:teuthology.orchestra.run.smithi183.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-18T17:20:08.992 INFO:teuthology.orchestra.run.smithi183.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-18T17:20:09.057 INFO:teuthology.orchestra.run.smithi183.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-18T17:20:09.063 INFO:teuthology.orchestra.run.smithi183.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-18T17:20:09.078 INFO:teuthology.orchestra.run.smithi183.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-18T17:20:09.094 INFO:teuthology.orchestra.run.smithi158.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 16.2.14-100-gb4ddd52c-1focal [3,389 kB] 2023-10-18T17:20:09.118 INFO:teuthology.orchestra.run.smithi183.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 16.2.14-100-gb4ddd52c-1focal [26.2 MB] 2023-10-18T17:20:09.607 INFO:teuthology.orchestra.run.smithi183.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-18T17:20:09.622 INFO:teuthology.orchestra.run.smithi158.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 16.2.14-100-gb4ddd52c-1focal [729 kB] 2023-10-18T17:20:09.653 INFO:teuthology.orchestra.run.smithi183.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-18T17:20:09.655 INFO:teuthology.orchestra.run.smithi183.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-18T17:20:09.687 INFO:teuthology.orchestra.run.smithi158.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 16.2.14-100-gb4ddd52c-1focal [413 kB] 2023-10-18T17:20:09.729 INFO:teuthology.orchestra.run.smithi183.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-18T17:20:09.730 INFO:teuthology.orchestra.run.smithi183.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-18T17:20:09.753 INFO:teuthology.orchestra.run.smithi158.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 16.2.14-100-gb4ddd52c-1focal [22.2 kB] 2023-10-18T17:20:09.754 INFO:teuthology.orchestra.run.smithi158.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 16.2.14-100-gb4ddd52c-1focal [212 kB] 2023-10-18T17:20:09.761 INFO:teuthology.orchestra.run.smithi158.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 16.2.14-100-gb4ddd52c-1focal [38.4 kB] 2023-10-18T17:20:09.762 INFO:teuthology.orchestra.run.smithi158.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 16.2.14-100-gb4ddd52c-1focal [387 kB] 2023-10-18T17:20:09.828 INFO:teuthology.orchestra.run.smithi158.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 16.2.14-100-gb4ddd52c-1focal [3,689 kB] 2023-10-18T17:20:09.894 INFO:teuthology.orchestra.run.smithi183.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-18T17:20:10.089 INFO:teuthology.orchestra.run.smithi183.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-18T17:20:10.134 INFO:teuthology.orchestra.run.smithi183.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-18T17:20:10.197 INFO:teuthology.orchestra.run.smithi183.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-18T17:20:10.217 INFO:teuthology.orchestra.run.smithi183.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-18T17:20:10.281 INFO:teuthology.orchestra.run.smithi158.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 16.2.14-100-gb4ddd52c-1focal [116 kB] 2023-10-18T17:20:10.285 INFO:teuthology.orchestra.run.smithi158.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 16.2.14-100-gb4ddd52c-1focal [448 kB] 2023-10-18T17:20:10.296 INFO:teuthology.orchestra.run.smithi183.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-18T17:20:10.306 INFO:teuthology.orchestra.run.smithi183.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-18T17:20:10.328 INFO:teuthology.orchestra.run.smithi158.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 16.2.14-100-gb4ddd52c-1focal [22.6 MB] 2023-10-18T17:20:10.379 INFO:teuthology.orchestra.run.smithi183.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-18T17:20:10.380 INFO:teuthology.orchestra.run.smithi183.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 16.2.14-100-gb4ddd52c-1focal [4,052 B] 2023-10-18T17:20:10.446 INFO:teuthology.orchestra.run.smithi183.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 16.2.14-100-gb4ddd52c-1focal [835 kB] 2023-10-18T17:20:10.446 INFO:teuthology.orchestra.run.smithi183.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-18T17:20:10.460 INFO:teuthology.orchestra.run.smithi183.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 16.2.14-100-gb4ddd52c-1focal [2,361 kB] 2023-10-18T17:20:10.478 INFO:teuthology.orchestra.run.smithi183.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-18T17:20:10.489 INFO:teuthology.orchestra.run.smithi183.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 16.2.14-100-gb4ddd52c-1focal [76.4 kB] 2023-10-18T17:20:10.490 INFO:teuthology.orchestra.run.smithi183.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 16.2.14-100-gb4ddd52c-1focal [100 kB] 2023-10-18T17:20:10.493 INFO:teuthology.orchestra.run.smithi183.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 16.2.14-100-gb4ddd52c-1focal [2,824 kB] 2023-10-18T17:20:10.495 INFO:teuthology.orchestra.run.smithi183.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-18T17:20:10.635 INFO:teuthology.orchestra.run.smithi183.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 16.2.14-100-gb4ddd52c-1focal [7,877 kB] 2023-10-18T17:20:10.665 INFO:teuthology.orchestra.run.smithi183.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-18T17:20:11.012 INFO:teuthology.orchestra.run.smithi183.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 16.2.14-100-gb4ddd52c-1focal [4,168 B] 2023-10-18T17:20:11.013 INFO:teuthology.orchestra.run.smithi183.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 16.2.14-100-gb4ddd52c-1focal [49.3 MB] 2023-10-18T17:20:11.149 INFO:teuthology.orchestra.run.smithi183.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-18T17:20:11.199 INFO:teuthology.orchestra.run.smithi183.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-18T17:20:11.203 INFO:teuthology.orchestra.run.smithi183.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-18T17:20:11.275 INFO:teuthology.orchestra.run.smithi183.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-18T17:20:11.276 INFO:teuthology.orchestra.run.smithi183.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-18T17:20:11.281 INFO:teuthology.orchestra.run.smithi183.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-18T17:20:11.283 INFO:teuthology.orchestra.run.smithi183.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-18T17:20:11.297 INFO:teuthology.orchestra.run.smithi183.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-18T17:20:11.411 INFO:teuthology.orchestra.run.smithi183.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-18T17:20:11.412 INFO:teuthology.orchestra.run.smithi183.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-18T17:20:11.578 INFO:teuthology.orchestra.run.smithi183.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-18T17:20:11.744 INFO:teuthology.orchestra.run.smithi183.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-18T17:20:11.958 INFO:teuthology.orchestra.run.smithi183.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-18T17:20:12.006 INFO:teuthology.orchestra.run.smithi183.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-18T17:20:12.018 INFO:teuthology.orchestra.run.smithi183.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-18T17:20:12.081 INFO:teuthology.orchestra.run.smithi183.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-18T17:20:12.538 INFO:teuthology.orchestra.run.smithi158.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 16.2.14-100-gb4ddd52c-1focal [5,914 kB] 2023-10-18T17:20:13.138 INFO:teuthology.orchestra.run.smithi158.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 16.2.14-100-gb4ddd52c-1focal [204 kB] 2023-10-18T17:20:13.143 INFO:teuthology.orchestra.run.smithi158.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 16.2.14-100-gb4ddd52c-1focal [126 kB] 2023-10-18T17:20:13.146 INFO:teuthology.orchestra.run.smithi158.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 16.2.14-100-gb4ddd52c-1focal [1,538 kB] 2023-10-18T17:20:13.327 INFO:teuthology.orchestra.run.smithi158.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 16.2.14-100-gb4ddd52c-1focal [6,998 kB] 2023-10-18T17:20:13.642 INFO:teuthology.orchestra.run.smithi183.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 16.2.14-100-gb4ddd52c-1focal [237 kB] 2023-10-18T17:20:13.646 INFO:teuthology.orchestra.run.smithi183.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 16.2.14-100-gb4ddd52c-1focal [17.4 kB] 2023-10-18T17:20:13.646 INFO:teuthology.orchestra.run.smithi183.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 16.2.14-100-gb4ddd52c-1focal [13.2 kB] 2023-10-18T17:20:13.647 INFO:teuthology.orchestra.run.smithi183.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 16.2.14-100-gb4ddd52c-1focal [21.5 kB] 2023-10-18T17:20:13.647 INFO:teuthology.orchestra.run.smithi183.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 16.2.14-100-gb4ddd52c-1focal [11.3 MB] 2023-10-18T17:20:13.975 INFO:teuthology.orchestra.run.smithi158.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 16.2.14-100-gb4ddd52c-1focal [26.2 MB] 2023-10-18T17:20:14.210 INFO:teuthology.orchestra.run.smithi183.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 16.2.14-100-gb4ddd52c-1focal [78.5 kB] 2023-10-18T17:20:14.825 INFO:teuthology.orchestra.run.smithi183.stdout:Fetched 174 MB in 8s (21.6 MB/s) 2023-10-18T17:20:14.952 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-18T17:20:14.996 INFO:teuthology.orchestra.run.smithi183.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 105332 files and directories currently installed.) 2023-10-18T17:20:14.999 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-18T17:20:15.075 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-18T17:20:15.353 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-18T17:20:15.368 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-18T17:20:15.436 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-18T17:20:15.686 INFO:teuthology.orchestra.run.smithi158.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 16.2.14-100-gb4ddd52c-1focal [4,052 B] 2023-10-18T17:20:15.687 INFO:teuthology.orchestra.run.smithi158.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 16.2.14-100-gb4ddd52c-1focal [835 kB] 2023-10-18T17:20:15.730 INFO:teuthology.orchestra.run.smithi158.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 16.2.14-100-gb4ddd52c-1focal [2,361 kB] 2023-10-18T17:20:15.739 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-cmd2. 2023-10-18T17:20:15.752 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-18T17:20:15.788 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-18T17:20:15.857 INFO:teuthology.orchestra.run.smithi158.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 16.2.14-100-gb4ddd52c-1focal [76.4 kB] 2023-10-18T17:20:15.860 INFO:teuthology.orchestra.run.smithi158.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 16.2.14-100-gb4ddd52c-1focal [100 kB] 2023-10-18T17:20:15.867 INFO:teuthology.orchestra.run.smithi158.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 16.2.14-100-gb4ddd52c-1focal [2,824 kB] 2023-10-18T17:20:16.019 INFO:teuthology.orchestra.run.smithi158.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 16.2.14-100-gb4ddd52c-1focal [7,877 kB] 2023-10-18T17:20:16.091 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libjaeger. 2023-10-18T17:20:16.107 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../003-libjaeger_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:16.149 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libjaeger (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:16.461 INFO:teuthology.orchestra.run.smithi158.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 16.2.14-100-gb4ddd52c-1focal [4,168 B] 2023-10-18T17:20:16.461 INFO:teuthology.orchestra.run.smithi158.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 16.2.14-100-gb4ddd52c-1focal [49.3 MB] 2023-10-18T17:20:16.477 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-18T17:20:16.491 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../004-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-18T17:20:16.569 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-18T17:20:16.928 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../005-librbd1_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:17.048 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking librbd1 (16.2.14-100-gb4ddd52c-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-18T17:20:17.732 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../006-librados2_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:17.878 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking librados2 (16.2.14-100-gb4ddd52c-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-18T17:20:18.548 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libcephfs2. 2023-10-18T17:20:18.562 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../007-libcephfs2_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:18.606 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libcephfs2 (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:18.984 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-rados. 2023-10-18T17:20:18.998 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../008-python3-rados_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:19.042 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-rados (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:19.131 INFO:teuthology.orchestra.run.smithi158.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 16.2.14-100-gb4ddd52c-1focal [237 kB] 2023-10-18T17:20:19.133 INFO:teuthology.orchestra.run.smithi158.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 16.2.14-100-gb4ddd52c-1focal [17.4 kB] 2023-10-18T17:20:19.133 INFO:teuthology.orchestra.run.smithi158.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 16.2.14-100-gb4ddd52c-1focal [13.2 kB] 2023-10-18T17:20:19.133 INFO:teuthology.orchestra.run.smithi158.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 16.2.14-100-gb4ddd52c-1focal [21.5 kB] 2023-10-18T17:20:19.134 INFO:teuthology.orchestra.run.smithi158.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 16.2.14-100-gb4ddd52c-1focal [11.3 MB] 2023-10-18T17:20:19.395 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-18T17:20:19.410 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../009-python3-ceph-argparse_16.2.14-100-gb4ddd52c-1focal_all.deb ... 2023-10-18T17:20:19.453 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-ceph-argparse (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:19.729 INFO:teuthology.orchestra.run.smithi158.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 16.2.14-100-gb4ddd52c-1focal [78.5 kB] 2023-10-18T17:20:19.739 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-cephfs. 2023-10-18T17:20:19.752 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../010-python3-cephfs_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:19.789 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-cephfs (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:20.150 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-18T17:20:20.163 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../011-python3-ceph-common_16.2.14-100-gb4ddd52c-1focal_all.deb ... 2023-10-18T17:20:20.209 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-ceph-common (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:20.520 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-prettytable. 2023-10-18T17:20:20.532 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-5_all.deb ... 2023-10-18T17:20:20.570 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-18T17:20:20.664 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 174 MB in 12s (14.5 MB/s) 2023-10-18T17:20:20.830 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-18T17:20:20.830 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-rbd. 2023-10-18T17:20:20.845 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../013-python3-rbd_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:20.888 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-rbd (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:20.901 INFO:teuthology.orchestra.run.smithi158.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107758 files and directories currently installed.) 2023-10-18T17:20:20.904 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-18T17:20:20.942 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-18T17:20:21.233 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-18T17:20:21.249 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../014-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-18T17:20:21.308 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-18T17:20:21.320 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-18T17:20:21.341 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-18T17:20:21.378 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-18T17:20:21.661 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-18T17:20:21.674 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../015-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-18T17:20:21.719 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-18T17:20:21.740 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cmd2. 2023-10-18T17:20:21.762 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-18T17:20:21.806 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-18T17:20:22.073 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-18T17:20:22.088 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../016-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-18T17:20:22.131 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-18T17:20:22.143 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libjaeger. 2023-10-18T17:20:22.162 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../003-libjaeger_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:22.201 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libjaeger (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:22.500 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package librgw2. 2023-10-18T17:20:22.514 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../017-librgw2_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:22.550 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking librgw2 (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:22.570 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-18T17:20:22.590 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../004-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-18T17:20:22.670 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-18T17:20:23.186 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-rgw. 2023-10-18T17:20:23.199 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../018-python3-rgw_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:23.252 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-rgw (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:23.254 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../005-librbd1_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:23.374 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librbd1 (16.2.14-100-gb4ddd52c-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-18T17:20:23.580 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libleveldb1d:amd64. 2023-10-18T17:20:23.594 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../019-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2023-10-18T17:20:23.638 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2023-10-18T17:20:24.008 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package liboath0. 2023-10-18T17:20:24.022 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../020-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-18T17:20:24.066 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-18T17:20:24.121 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../006-librados2_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:24.237 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librados2 (16.2.14-100-gb4ddd52c-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-18T17:20:24.402 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libradosstriper1. 2023-10-18T17:20:24.417 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../021-libradosstriper1_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:24.461 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libradosstriper1 (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:24.947 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-common. 2023-10-18T17:20:24.958 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libcephfs2. 2023-10-18T17:20:24.962 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../022-ceph-common_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:24.978 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../007-libcephfs2_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:25.005 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-common (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:25.024 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libcephfs2 (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:25.435 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-rados. 2023-10-18T17:20:25.458 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../008-python3-rados_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:25.502 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-rados (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:25.906 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-18T17:20:25.926 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../009-python3-ceph-argparse_16.2.14-100-gb4ddd52c-1focal_all.deb ... 2023-10-18T17:20:25.955 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-ceph-argparse (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:26.325 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cephfs. 2023-10-18T17:20:26.346 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../010-python3-cephfs_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:26.391 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cephfs (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:26.778 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-18T17:20:26.799 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../011-python3-ceph-common_16.2.14-100-gb4ddd52c-1focal_all.deb ... 2023-10-18T17:20:26.884 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-ceph-common (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:27.255 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-prettytable. 2023-10-18T17:20:27.275 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-5_all.deb ... 2023-10-18T17:20:27.286 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-base. 2023-10-18T17:20:27.302 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../023-ceph-base_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:27.330 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-18T17:20:27.354 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-base (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:27.617 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-rbd. 2023-10-18T17:20:27.637 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../013-python3-rbd_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:27.708 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-rbd (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:28.145 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-18T17:20:28.164 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../014-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-18T17:20:28.210 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-18T17:20:28.332 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-cryptography. 2023-10-18T17:20:28.346 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../024-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-18T17:20:28.390 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-18T17:20:28.572 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-18T17:20:28.592 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../015-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-18T17:20:28.630 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-18T17:20:28.802 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-openssl. 2023-10-18T17:20:28.815 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../025-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-18T17:20:28.852 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-18T17:20:29.008 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-18T17:20:29.029 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../016-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-18T17:20:29.066 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-18T17:20:29.138 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-18T17:20:29.151 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../026-ceph-mgr-modules-core_16.2.14-100-gb4ddd52c-1focal_all.deb ... 2023-10-18T17:20:29.188 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mgr-modules-core (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:29.470 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package librgw2. 2023-10-18T17:20:29.490 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../017-librgw2_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:29.528 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librgw2 (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:29.551 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-18T17:20:29.563 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../027-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-18T17:20:29.601 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-18T17:20:29.903 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-18T17:20:29.918 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-18T17:20:29.962 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-18T17:20:30.218 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-rgw. 2023-10-18T17:20:30.236 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../018-python3-rgw_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:30.272 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-rgw (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:30.315 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-jwt. 2023-10-18T17:20:30.328 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../029-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-18T17:20:30.365 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-18T17:20:30.625 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libleveldb1d:amd64. 2023-10-18T17:20:30.638 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../019-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2023-10-18T17:20:30.668 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-logutils. 2023-10-18T17:20:30.682 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-10-18T17:20:30.691 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2023-10-18T17:20:30.726 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-18T17:20:31.062 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-18T17:20:31.078 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-18T17:20:31.111 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package liboath0. 2023-10-18T17:20:31.120 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-18T17:20:31.124 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../020-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-18T17:20:31.161 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-18T17:20:31.449 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-mako. 2023-10-18T17:20:31.464 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-18T17:20:31.507 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-18T17:20:31.530 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libradosstriper1. 2023-10-18T17:20:31.548 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../021-libradosstriper1_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:31.580 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libradosstriper1 (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:31.835 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-18T17:20:31.847 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-18T17:20:31.885 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-18T17:20:32.092 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-common. 2023-10-18T17:20:32.112 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../022-ceph-common_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:32.142 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-common (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:32.212 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-18T17:20:32.226 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-18T17:20:32.271 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-18T17:20:32.590 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-webob. 2023-10-18T17:20:32.605 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-18T17:20:32.648 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-18T17:20:32.985 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-18T17:20:33.000 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-18T17:20:33.043 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-18T17:20:33.370 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-bs4. 2023-10-18T17:20:33.383 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-10-18T17:20:33.420 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-18T17:20:33.807 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-waitress. 2023-10-18T17:20:33.823 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-18T17:20:33.868 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-18T17:20:34.176 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-tempita. 2023-10-18T17:20:34.189 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-10-18T17:20:34.226 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-18T17:20:34.464 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-base. 2023-10-18T17:20:34.485 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../023-ceph-base_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:34.521 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-paste. 2023-10-18T17:20:34.537 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-18T17:20:34.543 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-base (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:34.579 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-18T17:20:34.949 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-18T17:20:34.963 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-18T17:20:35.007 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-18T17:20:35.318 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-18T17:20:35.333 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-18T17:20:35.376 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-18T17:20:35.569 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cryptography. 2023-10-18T17:20:35.589 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../024-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-18T17:20:35.660 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-18T17:20:35.713 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-webtest. 2023-10-18T17:20:35.726 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-10-18T17:20:35.762 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-18T17:20:36.090 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pecan. 2023-10-18T17:20:36.097 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-openssl. 2023-10-18T17:20:36.103 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-18T17:20:36.117 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../025-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-18T17:20:36.140 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-18T17:20:36.155 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-18T17:20:36.487 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-18T17:20:36.499 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-18T17:20:36.502 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-18T17:20:36.522 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../026-ceph-mgr-modules-core_16.2.14-100-gb4ddd52c-1focal_all.deb ... 2023-10-18T17:20:36.545 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-18T17:20:36.566 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-modules-core (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:36.898 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-18T17:20:36.914 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../046-libsqlite3-mod-ceph_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:36.956 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libsqlite3-mod-ceph (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:36.988 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-18T17:20:37.007 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../027-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-18T17:20:37.045 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-18T17:20:37.334 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mgr. 2023-10-18T17:20:37.350 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../047-ceph-mgr_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:37.392 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mgr (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:37.424 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-18T17:20:37.446 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-18T17:20:37.490 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-18T17:20:37.919 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-jwt. 2023-10-18T17:20:37.939 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../029-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-18T17:20:37.977 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-18T17:20:38.663 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mon. 2023-10-18T17:20:38.676 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../048-ceph-mon_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:38.712 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mon (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:39.122 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-logutils. 2023-10-18T17:20:39.142 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-10-18T17:20:39.180 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-18T17:20:39.542 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-18T17:20:39.563 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-18T17:20:39.616 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-18T17:20:39.816 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-osd. 2023-10-18T17:20:39.830 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../049-ceph-osd_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:39.874 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-osd (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:39.978 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-mako. 2023-10-18T17:20:39.998 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-18T17:20:40.036 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-18T17:20:40.398 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-18T17:20:40.418 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-18T17:20:40.455 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-18T17:20:40.817 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-18T17:20:40.837 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-18T17:20:40.875 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-18T17:20:41.228 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-webob. 2023-10-18T17:20:41.250 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-18T17:20:41.294 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-18T17:20:41.689 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-18T17:20:41.709 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-18T17:20:41.747 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-18T17:20:42.116 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-bs4. 2023-10-18T17:20:42.134 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-10-18T17:20:42.183 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-18T17:20:42.570 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-waitress. 2023-10-18T17:20:42.579 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph. 2023-10-18T17:20:42.589 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-18T17:20:42.594 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../050-ceph_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:42.632 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-18T17:20:42.637 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:42.982 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-fuse. 2023-10-18T17:20:42.990 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-tempita. 2023-10-18T17:20:42.995 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../051-ceph-fuse_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:43.010 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-10-18T17:20:43.031 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-fuse (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:43.047 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-18T17:20:43.402 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-paste. 2023-10-18T17:20:43.470 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-18T17:20:43.470 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-18T17:20:43.485 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mds. 2023-10-18T17:20:43.499 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../052-ceph-mds_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:43.543 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mds (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:43.862 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-18T17:20:43.879 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-18T17:20:43.919 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-18T17:20:44.289 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-18T17:20:44.302 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-18T17:20:44.347 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-18T17:20:44.396 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package cephadm. 2023-10-18T17:20:44.410 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../053-cephadm_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:44.454 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking cephadm (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:44.734 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-webtest. 2023-10-18T17:20:44.747 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-10-18T17:20:44.792 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-18T17:20:44.798 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-jinja2. 2023-10-18T17:20:44.815 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../054-python3-jinja2_2.10.1-2_all.deb ... 2023-10-18T17:20:44.857 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-18T17:20:45.153 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pecan. 2023-10-18T17:20:45.160 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-18T17:20:45.166 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-18T17:20:45.174 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../055-ceph-mgr-cephadm_16.2.14-100-gb4ddd52c-1focal_all.deb ... 2023-10-18T17:20:45.211 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-18T17:20:45.251 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mgr-cephadm (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:45.579 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-18T17:20:45.595 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../056-python3-repoze.lru_0.7-2_all.deb ... 2023-10-18T17:20:45.633 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-18T17:20:45.637 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-18T17:20:45.651 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-18T17:20:45.690 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-18T17:20:45.907 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libjs-underscore. 2023-10-18T17:20:45.923 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../057-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-18T17:20:45.965 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-18T17:20:46.094 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-18T17:20:46.115 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../046-libsqlite3-mod-ceph_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:46.169 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libsqlite3-mod-ceph (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:46.234 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-18T17:20:46.249 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../058-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-18T17:20:46.292 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-18T17:20:46.598 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr. 2023-10-18T17:20:46.618 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../047-ceph-mgr_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:46.645 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-routes. 2023-10-18T17:20:46.655 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:46.658 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../059-python3-routes_2.4.1-2_all.deb ... 2023-10-18T17:20:46.703 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-18T17:20:47.064 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-18T17:20:47.078 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../060-ceph-mgr-dashboard_16.2.14-100-gb4ddd52c-1focal_all.deb ... 2023-10-18T17:20:47.126 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mgr-dashboard (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:47.209 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mon. 2023-10-18T17:20:47.228 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../048-ceph-mon_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:47.267 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mon (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:48.105 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-decorator. 2023-10-18T17:20:48.121 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../061-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-18T17:20:48.162 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-18T17:20:48.371 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-osd. 2023-10-18T17:20:48.391 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../049-ceph-osd_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:48.429 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-osd (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:48.498 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-18T17:20:48.512 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../062-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-18T17:20:48.548 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-18T17:20:48.893 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-scipy. 2023-10-18T17:20:48.906 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../063-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-18T17:20:48.942 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-18T17:20:50.260 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-18T17:20:50.274 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-18T17:20:50.318 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-18T17:20:50.834 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph. 2023-10-18T17:20:50.855 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../050-ceph_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:50.882 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-joblib. 2023-10-18T17:20:50.896 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../065-python3-joblib_0.14.0-3_all.deb ... 2023-10-18T17:20:50.925 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:50.942 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-18T17:20:51.262 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-fuse. 2023-10-18T17:20:51.280 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../051-ceph-fuse_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:51.304 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-sklearn. 2023-10-18T17:20:51.320 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../066-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-18T17:20:51.345 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-fuse (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:51.362 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-18T17:20:51.848 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mds. 2023-10-18T17:20:51.868 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../052-ceph-mds_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:51.906 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mds (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:52.119 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-18T17:20:52.132 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_16.2.14-100-gb4ddd52c-1focal_all.deb ... 2023-10-18T17:20:52.177 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mgr-diskprediction-local (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:52.480 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package cephadm. 2023-10-18T17:20:52.502 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../053-cephadm_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:52.568 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking cephadm (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:52.933 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-jinja2. 2023-10-18T17:20:52.953 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../054-python3-jinja2_2.10.1-2_all.deb ... 2023-10-18T17:20:53.016 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-18T17:20:53.288 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-cachetools. 2023-10-18T17:20:53.305 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../068-python3-cachetools_4.0.0-1_all.deb ... 2023-10-18T17:20:53.327 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-18T17:20:53.339 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../055-ceph-mgr-cephadm_16.2.14-100-gb4ddd52c-1focal_all.deb ... 2023-10-18T17:20:53.346 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-18T17:20:53.400 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-cephadm (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:53.657 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-18T17:20:53.673 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../069-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-18T17:20:53.716 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-18T17:20:53.773 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-18T17:20:53.791 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../056-python3-repoze.lru_0.7-2_all.deb ... 2023-10-18T17:20:53.855 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-18T17:20:54.044 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-18T17:20:54.061 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../070-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-18T17:20:54.102 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-18T17:20:54.447 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-rsa. 2023-10-18T17:20:54.462 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../071-python3-rsa_4.0-3_all.deb ... 2023-10-18T17:20:54.467 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libjs-underscore. 2023-10-18T17:20:54.484 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../057-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-18T17:20:54.505 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-18T17:20:54.525 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-18T17:20:54.833 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-google-auth. 2023-10-18T17:20:54.849 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../072-python3-google-auth_1.5.1-2_all.deb ... 2023-10-18T17:20:54.878 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-18T17:20:54.891 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-18T17:20:54.898 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../058-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-18T17:20:54.935 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-18T17:20:55.211 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-blinker. 2023-10-18T17:20:55.226 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../073-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-18T17:20:55.269 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-18T17:20:55.331 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-routes. 2023-10-18T17:20:55.348 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../059-python3-routes_2.4.1-2_all.deb ... 2023-10-18T17:20:55.388 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-18T17:20:55.614 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-18T17:20:55.628 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../074-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-18T17:20:55.672 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-18T17:20:55.759 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-18T17:20:55.780 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../060-ceph-mgr-dashboard_16.2.14-100-gb4ddd52c-1focal_all.deb ... 2023-10-18T17:20:55.825 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-dashboard (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:56.026 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-18T17:20:56.039 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../075-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-18T17:20:56.083 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-18T17:20:56.395 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-websocket. 2023-10-18T17:20:56.410 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../076-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-18T17:20:56.453 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-18T17:20:56.798 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-18T17:20:56.812 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../077-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-18T17:20:56.856 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-18T17:20:57.009 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-decorator. 2023-10-18T17:20:57.030 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../061-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-18T17:20:57.075 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-18T17:20:57.420 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-18T17:20:57.427 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-18T17:20:57.442 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../078-ceph-mgr-k8sevents_16.2.14-100-gb4ddd52c-1focal_all.deb ... 2023-10-18T17:20:57.445 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../062-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-18T17:20:57.485 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mgr-k8sevents (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:20:57.486 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-18T17:20:57.830 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-18T17:20:57.843 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../079-libonig5_6.9.4-1_amd64.deb ... 2023-10-18T17:20:57.873 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-scipy. 2023-10-18T17:20:57.894 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../063-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-18T17:20:57.896 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-18T17:20:57.930 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-18T17:20:58.271 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-18T17:20:58.288 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../080-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-18T17:20:58.332 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-18T17:20:58.697 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package jq. 2023-10-18T17:20:58.711 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../081-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-18T17:20:58.755 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-18T17:20:59.041 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package socat. 2023-10-18T17:20:59.055 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../082-socat_1.7.3.3-2_amd64.deb ... 2023-10-18T17:20:59.099 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-18T17:20:59.415 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-18T17:20:59.429 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-18T17:20:59.453 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package xmlstarlet. 2023-10-18T17:20:59.466 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../083-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-18T17:20:59.473 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-18T17:20:59.511 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-18T17:20:59.858 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-test. 2023-10-18T17:20:59.874 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../084-ceph-test_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:20:59.915 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-test (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:00.094 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-joblib. 2023-10-18T17:21:00.112 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../065-python3-joblib_0.14.0-3_all.deb ... 2023-10-18T17:21:00.151 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-18T17:21:00.581 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-sklearn. 2023-10-18T17:21:00.602 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../066-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-18T17:21:00.680 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-18T17:21:01.514 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-18T17:21:01.528 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_16.2.14-100-gb4ddd52c-1focal_all.deb ... 2023-10-18T17:21:01.572 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-diskprediction-local (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:02.850 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cachetools. 2023-10-18T17:21:02.872 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../068-python3-cachetools_4.0.0-1_all.deb ... 2023-10-18T17:21:02.958 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-18T17:21:03.318 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-18T17:21:03.337 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../069-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-18T17:21:03.378 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-18T17:21:03.790 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-18T17:21:03.810 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../070-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-18T17:21:03.848 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-18T17:21:04.211 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-18T17:21:04.226 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../085-cephfs-mirror_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:21:04.234 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-rsa. 2023-10-18T17:21:04.255 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../071-python3-rsa_4.0-3_all.deb ... 2023-10-18T17:21:04.260 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking cephfs-mirror (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:04.292 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-18T17:21:04.622 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-colorama. 2023-10-18T17:21:04.636 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../086-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-18T17:21:04.662 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-google-auth. 2023-10-18T17:21:04.680 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-18T17:21:04.681 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../072-python3-google-auth_1.5.1-2_all.deb ... 2023-10-18T17:21:04.720 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-18T17:21:04.942 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package cephfs-shell. 2023-10-18T17:21:04.958 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../087-cephfs-shell_16.2.14-100-gb4ddd52c-1focal_all.deb ... 2023-10-18T17:21:04.991 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking cephfs-shell (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:05.099 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-blinker. 2023-10-18T17:21:05.120 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../073-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-18T17:21:05.165 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-18T17:21:05.202 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package cephfs-top. 2023-10-18T17:21:05.215 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../088-cephfs-top_16.2.14-100-gb4ddd52c-1focal_all.deb ... 2023-10-18T17:21:05.260 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking cephfs-top (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:05.502 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-18T17:21:05.523 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../074-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-18T17:21:05.568 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-18T17:21:05.571 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-18T17:21:05.586 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../089-libcephfs-dev_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:21:05.630 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libcephfs-dev (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:05.964 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-18T17:21:05.987 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../075-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-18T17:21:06.030 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-18T17:21:06.041 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package nvme-cli. 2023-10-18T17:21:06.057 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-18T17:21:06.117 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-18T17:21:06.385 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-websocket. 2023-10-18T17:21:06.404 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../076-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-18T17:21:06.443 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-18T17:21:06.446 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-18T17:21:06.462 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../091-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-18T17:21:06.496 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-18T17:21:06.824 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-attr. 2023-10-18T17:21:06.838 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../092-python3-attr_19.3.0-2_all.deb ... 2023-10-18T17:21:06.841 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-18T17:21:06.862 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../077-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-18T17:21:06.882 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-18T17:21:06.906 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-18T17:21:07.177 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-webencodings. 2023-10-18T17:21:07.191 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../093-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-18T17:21:07.227 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-18T17:21:07.496 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-html5lib. 2023-10-18T17:21:07.513 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../094-python3-html5lib_1.0.1-2_all.deb ... 2023-10-18T17:21:07.554 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-18T17:21:07.595 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-18T17:21:07.613 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../078-ceph-mgr-k8sevents_16.2.14-100-gb4ddd52c-1focal_all.deb ... 2023-10-18T17:21:07.652 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-k8sevents (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:07.924 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-18T17:21:07.938 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../095-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-18T17:21:07.982 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-18T17:21:08.031 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-18T17:21:08.051 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../079-libonig5_6.9.4-1_amd64.deb ... 2023-10-18T17:21:08.097 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-18T17:21:08.402 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-packaging. 2023-10-18T17:21:08.416 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../096-python3-packaging_20.3-1_all.deb ... 2023-10-18T17:21:08.452 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-18T17:21:08.500 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-18T17:21:08.523 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../080-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-18T17:21:08.566 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-18T17:21:08.764 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pastescript. 2023-10-18T17:21:08.779 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../097-python3-pastescript_2.0.2-4_all.deb ... 2023-10-18T17:21:08.822 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-18T17:21:08.980 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package jq. 2023-10-18T17:21:09.003 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../081-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-18T17:21:09.047 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-18T17:21:09.167 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pluggy. 2023-10-18T17:21:09.182 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../098-python3-pluggy_0.13.0-2_all.deb ... 2023-10-18T17:21:09.225 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-18T17:21:09.350 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package socat. 2023-10-18T17:21:09.371 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../082-socat_1.7.3.3-2_amd64.deb ... 2023-10-18T17:21:09.416 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-18T17:21:09.537 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-psutil. 2023-10-18T17:21:09.553 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../099-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-18T17:21:09.594 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-18T17:21:09.796 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package xmlstarlet. 2023-10-18T17:21:09.816 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../083-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-18T17:21:09.853 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-18T17:21:09.926 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-py. 2023-10-18T17:21:09.942 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../100-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-18T17:21:09.984 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-18T17:21:10.277 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-test. 2023-10-18T17:21:10.289 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../084-ceph-test_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:21:10.334 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-test (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:10.346 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-18T17:21:10.362 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-18T17:21:10.404 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-18T17:21:10.749 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pytest. 2023-10-18T17:21:10.763 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../102-python3-pytest_4.6.9-1_all.deb ... 2023-10-18T17:21:10.807 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-18T17:21:11.143 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-simplejson. 2023-10-18T17:21:11.158 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../103-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-18T17:21:11.226 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-18T17:21:11.664 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package radosgw. 2023-10-18T17:21:11.679 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../104-radosgw_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:21:11.722 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking radosgw (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:12.850 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package rbd-fuse. 2023-10-18T17:21:12.863 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../105-rbd-fuse_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:21:12.909 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking rbd-fuse (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:13.273 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-18T17:21:13.583 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2023-10-18T17:21:13.710 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-18T17:21:13.811 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-18T17:21:13.988 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up cephadm (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:14.505 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-18T17:21:14.530 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../085-cephfs-mirror_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:21:14.604 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking cephfs-mirror (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:14.642 INFO:teuthology.orchestra.run.smithi183.stdout:Adding system user cephadm....done 2023-10-18T17:21:14.967 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-colorama. 2023-10-18T17:21:14.987 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../086-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-18T17:21:15.058 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-18T17:21:15.120 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-18T17:21:15.353 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package cephfs-shell. 2023-10-18T17:21:15.373 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../087-cephfs-shell_16.2.14-100-gb4ddd52c-1focal_all.deb ... 2023-10-18T17:21:15.452 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking cephfs-shell (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:15.472 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-18T17:21:15.739 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package cephfs-top. 2023-10-18T17:21:15.756 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../088-cephfs-top_16.2.14-100-gb4ddd52c-1focal_all.deb ... 2023-10-18T17:21:15.765 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-18T17:21:15.796 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking cephfs-top (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:15.924 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-18T17:21:16.100 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-18T17:21:16.121 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../089-libcephfs-dev_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:21:16.158 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libcephfs-dev (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:16.268 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-18T17:21:16.612 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package nvme-cli. 2023-10-18T17:21:16.630 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-18T17:21:16.677 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-18T17:21:16.733 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-18T17:21:16.962 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-18T17:21:17.184 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-18T17:21:17.197 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../091-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-18T17:21:17.242 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-18T17:21:17.280 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-18T17:21:17.589 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-18T17:21:17.612 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-attr. 2023-10-18T17:21:17.636 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../092-python3-attr_19.3.0-2_all.deb ... 2023-10-18T17:21:17.678 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-18T17:21:17.882 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-18T17:21:18.074 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-webencodings. 2023-10-18T17:21:18.094 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../093-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-18T17:21:18.140 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-18T17:21:18.183 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-ceph-argparse (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:18.459 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-18T17:21:18.502 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-html5lib. 2023-10-18T17:21:18.523 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../094-python3-html5lib_1.0.1-2_all.deb ... 2023-10-18T17:21:18.560 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-18T17:21:18.567 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-18T17:21:18.836 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-18T17:21:18.946 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-18T17:21:18.967 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../095-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-18T17:21:19.012 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-18T17:21:19.120 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-18T17:21:19.413 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-18T17:21:19.533 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-packaging. 2023-10-18T17:21:19.553 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../096-python3-packaging_20.3-1_all.deb ... 2023-10-18T17:21:19.615 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-18T17:21:19.790 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-18T17:21:19.944 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pastescript. 2023-10-18T17:21:19.965 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../097-python3-pastescript_2.0.2-4_all.deb ... 2023-10-18T17:21:20.043 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-18T17:21:20.082 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-18T17:21:20.434 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-18T17:21:20.447 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pluggy. 2023-10-18T17:21:20.469 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../098-python3-pluggy_0.13.0-2_all.deb ... 2023-10-18T17:21:20.513 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-18T17:21:20.727 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libjaeger (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:20.828 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-18T17:21:20.908 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-psutil. 2023-10-18T17:21:20.931 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../099-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-18T17:21:20.974 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-18T17:21:21.165 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-18T17:21:21.361 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-py. 2023-10-18T17:21:21.382 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../100-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-18T17:21:21.427 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-18T17:21:21.466 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-18T17:21:21.759 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-18T17:21:21.831 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-18T17:21:21.852 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-18T17:21:21.860 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-18T17:21:21.897 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-18T17:21:22.128 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-18T17:21:22.267 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pytest. 2023-10-18T17:21:22.288 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../102-python3-pytest_4.6.9-1_all.deb ... 2023-10-18T17:21:22.333 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-18T17:21:22.538 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-18T17:21:22.720 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-simplejson. 2023-10-18T17:21:22.741 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../103-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-18T17:21:22.778 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-18T17:21:22.840 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-18T17:21:23.202 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-18T17:21:23.341 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package radosgw. 2023-10-18T17:21:23.361 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../104-radosgw_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:21:23.406 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking radosgw (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:23.548 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-18T17:21:23.674 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-ceph-common (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:24.008 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-18T17:21:24.351 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-18T17:21:24.454 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-18T17:21:24.613 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-18T17:21:24.619 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package rbd-fuse. 2023-10-18T17:21:24.638 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../105-rbd-fuse_16.2.14-100-gb4ddd52c-1focal_amd64.deb ... 2023-10-18T17:21:24.676 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking rbd-fuse (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:24.923 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-18T17:21:25.323 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-18T17:21:25.348 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-18T17:21:25.525 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-18T17:21:25.724 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2023-10-18T17:21:25.835 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-18T17:21:25.850 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-18T17:21:26.010 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-18T17:21:26.103 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-18T17:21:26.237 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up cephadm (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:26.396 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-18T17:21:26.538 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-18T17:21:26.823 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-18T17:21:26.998 INFO:teuthology.orchestra.run.smithi158.stdout:Adding system user cephadm....done 2023-10-18T17:21:27.166 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-18T17:21:27.210 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-18T17:21:27.492 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-18T17:21:27.645 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-18T17:21:27.857 INFO:teuthology.orchestra.run.smithi183.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-18T17:21:27.988 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-18T17:21:28.094 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-18T17:21:28.156 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-18T17:21:28.195 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-18T17:21:28.504 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-18T17:21:28.575 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-18T17:21:28.898 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-18T17:21:29.024 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-18T17:21:29.072 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-18T17:21:29.149 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-18T17:21:29.434 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-18T17:21:29.517 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-18T17:21:29.777 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-18T17:21:29.810 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up librados2 (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:29.911 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-18T17:21:30.153 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-18T17:21:30.529 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-18T17:21:30.905 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-ceph-argparse (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:31.298 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-18T17:21:31.333 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up librgw2 (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:31.449 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-18T17:21:31.459 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libsqlite3-mod-ceph (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:31.593 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-18T17:21:31.694 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-18T17:21:31.809 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-18T17:21:32.096 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-18T17:21:32.201 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-18T17:21:32.414 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-18T17:21:32.569 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-18T17:21:32.723 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-18T17:21:33.066 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libcephfs2 (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:33.070 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-18T17:21:33.192 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-18T17:21:33.456 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-18T17:21:33.552 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libradosstriper1 (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:33.653 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-18T17:21:33.915 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-18T17:21:33.971 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-18T17:21:34.301 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libjaeger (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:34.426 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-18T17:21:34.835 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-18T17:21:35.018 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up librbd1 (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:35.118 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-18T17:21:35.199 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-18T17:21:35.219 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-18T17:21:35.320 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-18T17:21:35.567 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-18T17:21:35.622 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-18T17:21:35.693 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-18T17:21:35.940 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mgr-modules-core (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:36.045 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-18T17:21:36.065 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-fuse (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:36.322 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-18T17:21:36.322 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-18T17:21:36.547 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-18T17:21:36.775 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libcephfs-dev (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:36.892 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-18T17:21:36.923 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-18T17:21:37.185 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-18T17:21:37.391 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-18T17:21:37.495 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-18T17:21:37.837 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-18T17:21:37.855 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-rados (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:37.963 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-ceph-common (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:37.998 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up cephfs-top (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:38.201 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-rbd (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:38.327 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up rbd-fuse (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:38.381 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-18T17:21:38.561 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-18T17:21:38.854 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-18T17:21:38.883 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-18T17:21:39.009 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-18T17:21:39.152 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-18T17:21:39.165 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-rgw (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:39.290 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-cephfs (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:39.545 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-18T17:21:39.560 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up cephfs-shell (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:39.720 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-18T17:21:39.929 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-18T17:21:40.055 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-18T17:21:40.540 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-18T17:21:40.648 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-common (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:40.883 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-18T17:21:41.193 INFO:teuthology.orchestra.run.smithi183.stdout:Adding group ceph....done 2023-10-18T17:21:41.276 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-18T17:21:41.427 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-18T17:21:41.611 INFO:teuthology.orchestra.run.smithi183.stdout:Adding system user ceph....done 2023-10-18T17:21:41.786 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-18T17:21:41.787 INFO:teuthology.orchestra.run.smithi183.stdout:Setting system user ceph properties....done 2023-10-18T17:21:41.807 INFO:teuthology.orchestra.run.smithi183.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-18T17:21:41.949 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-18T17:21:42.190 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-18T17:21:42.258 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-18T17:21:42.605 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-18T17:21:42.685 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up cephfs-mirror (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:42.913 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-18T17:21:42.914 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-18T17:21:42.966 INFO:teuthology.orchestra.run.smithi158.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-18T17:21:43.325 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-18T17:21:43.369 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-test (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:43.476 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-18T17:21:43.495 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up radosgw (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:43.766 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-18T17:21:43.767 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-18T17:21:43.877 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-18T17:21:44.328 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-18T17:21:44.414 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-base (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:44.454 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-18T17:21:44.581 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-18T17:21:44.775 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-18T17:21:45.015 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-18T17:21:45.199 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mds (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:45.418 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librados2 (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:45.422 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-18T17:21:45.422 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-18T17:21:45.562 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-18T17:21:45.850 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mgr (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:46.079 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-18T17:21:46.080 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-18T17:21:46.518 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-osd (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:47.041 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-18T17:21:47.041 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-18T17:21:47.393 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librgw2 (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:47.471 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mgr-k8sevents (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:47.519 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libsqlite3-mod-ceph (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:47.597 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mgr-diskprediction-local (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:47.665 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-18T17:21:47.723 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mon (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:47.792 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-18T17:21:47.972 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-18T17:21:47.972 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-18T17:21:48.268 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-18T17:21:48.425 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mgr-cephadm (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:48.542 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:48.651 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mgr-dashboard (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:48.653 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-18T17:21:48.795 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-18T17:21:49.013 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-18T17:21:49.096 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-18T17:21:49.422 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libcephfs2 (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:49.548 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-18T17:21:49.986 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libradosstriper1 (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:50.145 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-18T17:21:50.876 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-18T17:21:51.949 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-18T17:21:52.198 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librbd1 (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:52.324 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-18T17:21:52.380 INFO:teuthology.orchestra.run.smithi183.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-18T17:21:52.382 DEBUG:teuthology.orchestra.run.smithi183:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-18T17:21:52.448 INFO:teuthology.orchestra.run.smithi183.stdout:Reading package lists... 2023-10-18T17:21:52.458 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-18T17:21:52.618 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-18T17:21:52.650 INFO:teuthology.orchestra.run.smithi183.stdout:Building dependency tree... 2023-10-18T17:21:52.651 INFO:teuthology.orchestra.run.smithi183.stdout:Reading state information... 2023-10-18T17:21:52.843 INFO:teuthology.orchestra.run.smithi183.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-18T17:21:52.843 INFO:teuthology.orchestra.run.smithi183.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-18T17:21:52.843 INFO:teuthology.orchestra.run.smithi183.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-18T17:21:52.844 INFO:teuthology.orchestra.run.smithi183.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-18T17:21:52.844 INFO:teuthology.orchestra.run.smithi183.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-18T17:21:52.844 INFO:teuthology.orchestra.run.smithi183.stdout:The following packages were automatically installed and are no longer required: 2023-10-18T17:21:52.845 INFO:teuthology.orchestra.run.smithi183.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-18T17:21:52.845 INFO:teuthology.orchestra.run.smithi183.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-18T17:21:52.846 INFO:teuthology.orchestra.run.smithi183.stdout:The following additional packages will be installed: 2023-10-18T17:21:52.846 INFO:teuthology.orchestra.run.smithi183.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-18T17:21:52.846 INFO:teuthology.orchestra.run.smithi183.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-18T17:21:52.846 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-18T17:21:52.846 INFO:teuthology.orchestra.run.smithi183.stdout: usb-modeswitch-data wpasupplicant 2023-10-18T17:21:52.847 INFO:teuthology.orchestra.run.smithi183.stdout:Suggested packages: 2023-10-18T17:21:52.847 INFO:teuthology.orchestra.run.smithi183.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-18T17:21:52.847 INFO:teuthology.orchestra.run.smithi183.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-18T17:21:52.891 INFO:teuthology.orchestra.run.smithi183.stdout:The following NEW packages will be installed: 2023-10-18T17:21:52.891 INFO:teuthology.orchestra.run.smithi183.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-18T17:21:52.892 INFO:teuthology.orchestra.run.smithi183.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-18T17:21:52.892 INFO:teuthology.orchestra.run.smithi183.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-18T17:21:52.892 INFO:teuthology.orchestra.run.smithi183.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-18T17:21:52.893 INFO:teuthology.orchestra.run.smithi183.stdout:The following packages will be upgraded: 2023-10-18T17:21:52.894 INFO:teuthology.orchestra.run.smithi183.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-18T17:21:52.961 INFO:teuthology.orchestra.run.smithi183.stdout:6 upgraded, 23 newly installed, 0 to remove and 250 not upgraded. 2023-10-18T17:21:52.962 INFO:teuthology.orchestra.run.smithi183.stdout:Need to get 10.4 MB of archives. 2023-10-18T17:21:52.962 INFO:teuthology.orchestra.run.smithi183.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-18T17:21:52.962 INFO:teuthology.orchestra.run.smithi183.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-18T17:21:53.010 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-18T17:21:53.263 INFO:teuthology.orchestra.run.smithi183.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-18T17:21:53.264 INFO:teuthology.orchestra.run.smithi183.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-18T17:21:53.265 INFO:teuthology.orchestra.run.smithi183.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-18T17:21:53.273 INFO:teuthology.orchestra.run.smithi183.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-18T17:21:53.274 INFO:teuthology.orchestra.run.smithi183.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-18T17:21:53.359 INFO:teuthology.orchestra.run.smithi183.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-18T17:21:53.360 INFO:teuthology.orchestra.run.smithi183.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-18T17:21:53.364 INFO:teuthology.orchestra.run.smithi183.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-18T17:21:53.366 INFO:teuthology.orchestra.run.smithi183.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-18T17:21:53.367 INFO:teuthology.orchestra.run.smithi183.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-18T17:21:53.369 INFO:teuthology.orchestra.run.smithi183.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-18T17:21:53.384 INFO:teuthology.orchestra.run.smithi183.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-18T17:21:53.388 INFO:teuthology.orchestra.run.smithi183.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-18T17:21:53.388 INFO:teuthology.orchestra.run.smithi183.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-18T17:21:53.400 INFO:teuthology.orchestra.run.smithi183.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-18T17:21:53.420 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-modules-core (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:53.430 INFO:teuthology.orchestra.run.smithi183.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-18T17:21:53.438 INFO:teuthology.orchestra.run.smithi183.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-18T17:21:53.452 INFO:teuthology.orchestra.run.smithi183.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-18T17:21:53.452 INFO:teuthology.orchestra.run.smithi183.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-18T17:21:53.517 INFO:teuthology.orchestra.run.smithi183.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-18T17:21:53.517 INFO:teuthology.orchestra.run.smithi183.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-18T17:21:53.533 INFO:teuthology.orchestra.run.smithi183.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-18T17:21:53.546 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-fuse (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:53.576 INFO:teuthology.orchestra.run.smithi183.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-18T17:21:53.629 INFO:teuthology.orchestra.run.smithi183.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-18T17:21:53.635 INFO:teuthology.orchestra.run.smithi183.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-18T17:21:53.636 INFO:teuthology.orchestra.run.smithi183.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-18T17:21:53.636 INFO:teuthology.orchestra.run.smithi183.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-18T17:21:53.637 INFO:teuthology.orchestra.run.smithi183.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-18T17:21:53.812 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-18T17:21:53.813 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-18T17:21:53.957 INFO:teuthology.orchestra.run.smithi183.stdout:Preconfiguring packages ... 2023-10-18T17:21:54.094 INFO:teuthology.orchestra.run.smithi183.stdout:Fetched 10.4 MB in 1s (14.2 MB/s) 2023-10-18T17:21:54.393 INFO:teuthology.orchestra.run.smithi183.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 112853 files and directories currently installed.) 2023-10-18T17:21:54.396 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-18T17:21:54.567 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-18T17:21:54.664 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libcephfs-dev (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:54.790 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-18T17:21:55.167 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-18T17:21:55.560 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-18T17:21:55.705 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-18T17:21:56.020 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-rados (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:56.146 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up cephfs-top (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:56.391 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-rbd (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:56.517 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up rbd-fuse (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:56.643 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-18T17:21:57.053 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-18T17:21:57.095 INFO:teuthology.orchestra.run.smithi183.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 112853 files and directories currently installed.) 2023-10-18T17:21:57.098 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-18T17:21:57.247 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-18T17:21:57.463 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-rgw (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:57.623 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cephfs (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:57.650 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-18T17:21:57.853 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-18T17:21:58.016 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up cephfs-shell (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:58.142 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-18T17:21:58.178 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-18T17:21:58.625 INFO:teuthology.orchestra.run.smithi183.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 112853 files and directories currently installed.) 2023-10-18T17:21:58.629 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-18T17:21:58.769 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-18T17:21:59.245 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-18T17:21:59.296 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-common (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:21:59.374 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-18T17:21:59.912 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-18T17:21:59.919 INFO:teuthology.orchestra.run.smithi158.stdout:Adding group ceph....done 2023-10-18T17:22:00.078 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-18T17:22:00.410 INFO:teuthology.orchestra.run.smithi158.stdout:Adding system user ceph....done 2023-10-18T17:22:00.557 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-18T17:22:00.574 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-18T17:22:00.640 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-18T17:22:00.655 INFO:teuthology.orchestra.run.smithi158.stdout:Setting system user ceph properties....done 2023-10-18T17:22:00.690 INFO:teuthology.orchestra.run.smithi158.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-18T17:22:00.890 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-18T17:22:00.985 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package dump. 2023-10-18T17:22:00.999 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-18T17:22:01.043 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking dump (0.4b46-6) ... 2023-10-18T17:22:01.424 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-18T17:22:01.531 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package indent. 2023-10-18T17:22:01.548 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-18T17:22:01.606 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-18T17:22:01.942 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-18T17:22:01.957 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-18T17:22:02.000 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-18T17:22:02.348 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up cephfs-mirror (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:22:02.362 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-18T17:22:02.378 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-18T17:22:02.420 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-18T17:22:02.611 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-18T17:22:02.611 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-18T17:22:02.697 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-18T17:22:02.711 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-18T17:22:02.756 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-18T17:22:03.117 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-18T17:22:03.133 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T17:22:03.175 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-18T17:22:03.424 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-test (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:22:03.453 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-18T17:22:03.466 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T17:22:03.544 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-18T17:22:03.550 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up radosgw (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:22:03.871 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-18T17:22:03.871 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-18T17:22:03.880 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-18T17:22:03.895 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T17:22:03.938 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-18T17:22:04.325 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-18T17:22:04.339 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-18T17:22:04.383 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-18T17:22:04.744 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-18T17:22:04.758 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-18T17:22:04.802 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-18T17:22:05.094 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-base (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:22:05.146 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-18T17:22:05.159 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T17:22:05.196 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-18T17:22:05.516 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-18T17:22:05.530 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T17:22:05.574 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-18T17:22:05.582 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-18T17:22:05.843 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-18T17:22:05.858 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-18T17:22:05.901 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-18T17:22:06.438 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-18T17:22:06.454 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-18T17:22:06.479 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mds (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:22:06.496 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-18T17:22:06.757 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-18T17:22:06.757 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-18T17:22:07.203 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package modemmanager. 2023-10-18T17:22:07.220 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T17:22:07.268 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-18T17:22:07.613 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:22:07.883 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-18T17:22:07.884 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-18T17:22:07.914 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package wpasupplicant. 2023-10-18T17:22:07.928 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-18T17:22:07.973 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-18T17:22:08.519 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package network-manager. 2023-10-18T17:22:08.536 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-18T17:22:08.601 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-18T17:22:08.756 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-osd (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:22:09.334 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ppp. 2023-10-18T17:22:09.351 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-18T17:22:09.632 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-18T17:22:09.632 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-18T17:22:09.658 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-18T17:22:10.033 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package pptp-linux. 2023-10-18T17:22:10.049 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-18T17:22:10.091 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-18T17:22:10.461 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-18T17:22:10.475 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-18T17:22:10.499 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-k8sevents (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:22:10.536 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-18T17:22:10.626 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-diskprediction-local (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:22:10.777 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mon (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:22:10.822 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-18T17:22:10.838 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-18T17:22:10.880 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-18T17:22:11.074 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-18T17:22:11.074 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-18T17:22:11.300 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-18T17:22:11.315 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-18T17:22:11.369 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-18T17:22:11.658 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-18T17:22:11.970 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-cephadm (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:22:12.097 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-18T17:22:12.154 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:22:12.223 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-18T17:22:12.280 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-dashboard (16.2.14-100-gb4ddd52c-1focal) ... 2023-10-18T17:22:12.433 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-18T17:22:12.441 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-18T17:22:12.908 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-18T17:22:13.051 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-18T17:22:13.052 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-18T17:22:13.537 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-18T17:22:13.664 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-18T17:22:13.799 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-18T17:22:13.925 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-18T17:22:14.051 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-18T17:22:14.202 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-18T17:22:15.163 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-18T17:22:15.399 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up dump (0.4b46-6) ... 2023-10-18T17:22:15.494 INFO:teuthology.orchestra.run.smithi183.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-18T17:22:15.559 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-18T17:22:15.677 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-18T17:22:15.803 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-18T17:22:15.962 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-18T17:22:16.139 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-18T17:22:16.265 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-18T17:22:16.391 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-18T17:22:16.542 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-18T17:22:16.710 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-18T17:22:16.819 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-18T17:22:17.554 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:22:17.554 INFO:teuthology.orchestra.run.smithi183.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-18T17:22:17.555 INFO:teuthology.orchestra.run.smithi183.stdout:which means they are currently configured by ifupdown: 2023-10-18T17:22:17.555 INFO:teuthology.orchestra.run.smithi183.stdout:- enp3s0f1 2023-10-18T17:22:17.555 INFO:teuthology.orchestra.run.smithi183.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-18T17:22:17.555 INFO:teuthology.orchestra.run.smithi183.stdout:remove their configuration from /etc/network/interfaces. 2023-10-18T17:22:17.555 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:22:17.712 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-18T17:22:18.039 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-18T17:22:18.095 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-18T17:22:18.582 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-18T17:22:18.712 INFO:teuthology.orchestra.run.smithi158.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-18T17:22:18.718 DEBUG:teuthology.orchestra.run.smithi158:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-18T17:22:18.847 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2023-10-18T17:22:19.049 INFO:teuthology.orchestra.run.smithi158.stdout:Building dependency tree... 2023-10-18T17:22:19.050 INFO:teuthology.orchestra.run.smithi158.stdout:Reading state information... 2023-10-18T17:22:19.059 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-18T17:22:19.182 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-18T17:22:19.251 INFO:teuthology.orchestra.run.smithi158.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-18T17:22:19.252 INFO:teuthology.orchestra.run.smithi158.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-18T17:22:19.252 INFO:teuthology.orchestra.run.smithi158.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-18T17:22:19.252 INFO:teuthology.orchestra.run.smithi158.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-18T17:22:19.252 INFO:teuthology.orchestra.run.smithi158.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-18T17:22:19.252 INFO:teuthology.orchestra.run.smithi158.stdout:The following packages were automatically installed and are no longer required: 2023-10-18T17:22:19.253 INFO:teuthology.orchestra.run.smithi158.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-18T17:22:19.254 INFO:teuthology.orchestra.run.smithi158.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-18T17:22:19.254 INFO:teuthology.orchestra.run.smithi158.stdout:The following additional packages will be installed: 2023-10-18T17:22:19.254 INFO:teuthology.orchestra.run.smithi158.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-18T17:22:19.254 INFO:teuthology.orchestra.run.smithi158.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-18T17:22:19.255 INFO:teuthology.orchestra.run.smithi158.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-18T17:22:19.255 INFO:teuthology.orchestra.run.smithi158.stdout: usb-modeswitch-data wpasupplicant 2023-10-18T17:22:19.255 INFO:teuthology.orchestra.run.smithi158.stdout:Suggested packages: 2023-10-18T17:22:19.256 INFO:teuthology.orchestra.run.smithi158.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-18T17:22:19.256 INFO:teuthology.orchestra.run.smithi158.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-18T17:22:19.325 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-18T17:22:19.345 INFO:teuthology.orchestra.run.smithi158.stdout:The following NEW packages will be installed: 2023-10-18T17:22:19.346 INFO:teuthology.orchestra.run.smithi158.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-18T17:22:19.346 INFO:teuthology.orchestra.run.smithi158.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-18T17:22:19.347 INFO:teuthology.orchestra.run.smithi158.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-18T17:22:19.347 INFO:teuthology.orchestra.run.smithi158.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-18T17:22:19.348 INFO:teuthology.orchestra.run.smithi158.stdout:The following packages will be upgraded: 2023-10-18T17:22:19.349 INFO:teuthology.orchestra.run.smithi158.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-18T17:22:19.418 INFO:teuthology.orchestra.run.smithi158.stdout:6 upgraded, 23 newly installed, 0 to remove and 250 not upgraded. 2023-10-18T17:22:19.419 INFO:teuthology.orchestra.run.smithi158.stdout:Need to get 10.4 MB of archives. 2023-10-18T17:22:19.419 INFO:teuthology.orchestra.run.smithi158.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-18T17:22:19.419 INFO:teuthology.orchestra.run.smithi158.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-18T17:22:19.476 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-18T17:22:19.555 INFO:teuthology.orchestra.run.smithi158.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-18T17:22:19.557 INFO:teuthology.orchestra.run.smithi158.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-18T17:22:19.558 INFO:teuthology.orchestra.run.smithi158.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-18T17:22:19.563 INFO:teuthology.orchestra.run.smithi158.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-18T17:22:19.565 INFO:teuthology.orchestra.run.smithi158.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-18T17:22:19.582 INFO:teuthology.orchestra.run.smithi158.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-18T17:22:19.583 INFO:teuthology.orchestra.run.smithi158.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-18T17:22:19.585 INFO:teuthology.orchestra.run.smithi158.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-18T17:22:19.586 INFO:teuthology.orchestra.run.smithi158.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-18T17:22:19.586 INFO:teuthology.orchestra.run.smithi158.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-18T17:22:19.588 INFO:teuthology.orchestra.run.smithi158.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-18T17:22:19.589 INFO:teuthology.orchestra.run.smithi158.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-18T17:22:19.591 INFO:teuthology.orchestra.run.smithi158.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-18T17:22:19.592 INFO:teuthology.orchestra.run.smithi158.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-18T17:22:19.602 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-18T17:22:19.605 INFO:teuthology.orchestra.run.smithi158.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-18T17:22:19.606 INFO:teuthology.orchestra.run.smithi158.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-18T17:22:19.612 INFO:teuthology.orchestra.run.smithi158.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-18T17:22:19.621 INFO:teuthology.orchestra.run.smithi158.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-18T17:22:19.622 INFO:teuthology.orchestra.run.smithi158.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-18T17:22:19.639 INFO:teuthology.orchestra.run.smithi158.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-18T17:22:19.639 INFO:teuthology.orchestra.run.smithi158.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-18T17:22:19.649 INFO:teuthology.orchestra.run.smithi158.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-18T17:22:19.661 INFO:teuthology.orchestra.run.smithi158.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-18T17:22:19.679 INFO:teuthology.orchestra.run.smithi158.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-18T17:22:19.682 INFO:teuthology.orchestra.run.smithi158.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-18T17:22:19.683 INFO:teuthology.orchestra.run.smithi158.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-18T17:22:19.683 INFO:teuthology.orchestra.run.smithi158.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-18T17:22:19.683 INFO:teuthology.orchestra.run.smithi158.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-18T17:22:19.728 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-18T17:22:20.000 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-18T17:22:20.001 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-18T17:22:20.108 INFO:teuthology.orchestra.run.smithi158.stdout:Preconfiguring packages ... 2023-10-18T17:22:20.309 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 10.4 MB in 0s (32.0 MB/s) 2023-10-18T17:22:20.506 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-18T17:22:20.648 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-18T17:22:20.662 INFO:teuthology.orchestra.run.smithi158.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115279 files and directories currently installed.) 2023-10-18T17:22:20.666 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-18T17:22:20.799 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-18T17:22:20.856 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-18T17:22:20.951 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-18T17:22:21.252 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-18T17:22:22.512 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-18T17:22:24.543 INFO:teuthology.orchestra.run.smithi158.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115279 files and directories currently installed.) 2023-10-18T17:22:24.546 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-18T17:22:24.713 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-18T17:22:25.199 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-18T17:22:25.288 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-18T17:22:25.370 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-18T17:22:25.396 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-18T17:22:25.746 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-18T17:22:26.249 INFO:teuthology.orchestra.run.smithi183.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-18T17:22:26.252 DEBUG:teuthology.parallel:result is None 2023-10-18T17:22:26.270 INFO:teuthology.orchestra.run.smithi158.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115279 files and directories currently installed.) 2023-10-18T17:22:26.273 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-18T17:22:26.428 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-18T17:22:26.937 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-18T17:22:27.075 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-18T17:22:27.633 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-18T17:22:27.772 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-18T17:22:28.395 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-18T17:22:28.409 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-18T17:22:28.460 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-18T17:22:28.863 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package dump. 2023-10-18T17:22:28.877 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-18T17:22:28.921 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking dump (0.4b46-6) ... 2023-10-18T17:22:29.258 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package indent. 2023-10-18T17:22:29.281 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-18T17:22:29.325 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-18T17:22:29.711 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-18T17:22:29.729 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-18T17:22:29.769 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-18T17:22:30.173 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-18T17:22:30.196 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-18T17:22:30.239 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-18T17:22:30.559 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-18T17:22:30.580 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-18T17:22:30.625 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-18T17:22:31.012 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-18T17:22:31.033 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T17:22:31.070 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-18T17:22:31.370 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-18T17:22:31.393 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T17:22:31.436 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-18T17:22:31.806 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-18T17:22:31.825 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T17:22:31.864 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-18T17:22:32.286 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-18T17:22:32.306 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-18T17:22:32.350 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-18T17:22:32.711 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-18T17:22:32.732 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-18T17:22:32.778 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-18T17:22:33.198 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-18T17:22:33.221 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T17:22:33.264 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-18T17:22:33.658 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-18T17:22:33.679 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T17:22:33.725 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-18T17:22:34.052 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-18T17:22:34.074 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-18T17:22:34.127 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-18T17:22:34.706 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-18T17:22:34.727 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-18T17:22:34.772 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-18T17:22:35.201 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package modemmanager. 2023-10-18T17:22:35.221 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T17:22:35.283 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-18T17:22:35.948 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package wpasupplicant. 2023-10-18T17:22:35.969 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-18T17:22:36.014 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-18T17:22:36.620 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package network-manager. 2023-10-18T17:22:36.641 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-18T17:22:36.732 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-18T17:22:37.569 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ppp. 2023-10-18T17:22:37.587 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-18T17:22:38.071 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-18T17:22:38.465 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package pptp-linux. 2023-10-18T17:22:38.485 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-18T17:22:38.523 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-18T17:22:38.969 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-18T17:22:38.989 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-18T17:22:39.077 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-18T17:22:39.397 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-18T17:22:39.417 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-18T17:22:39.454 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-18T17:22:39.883 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-18T17:22:39.902 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-18T17:22:39.965 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-18T17:22:40.357 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-18T17:22:40.722 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-18T17:22:40.847 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-18T17:22:40.998 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-18T17:22:41.436 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-18T17:22:41.437 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-18T17:22:42.376 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-18T17:22:42.511 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-18T17:22:42.670 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-18T17:22:42.796 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-18T17:22:42.922 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-18T17:22:43.082 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-18T17:22:44.352 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-18T17:22:44.788 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up dump (0.4b46-6) ... 2023-10-18T17:22:44.890 INFO:teuthology.orchestra.run.smithi158.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-18T17:22:44.956 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-18T17:22:45.115 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-18T17:22:45.258 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-18T17:22:45.384 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-18T17:22:45.602 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-18T17:22:45.736 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-18T17:22:45.887 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-18T17:22:46.014 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-18T17:22:46.181 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-18T17:22:46.332 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-18T17:22:47.525 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:22:47.525 INFO:teuthology.orchestra.run.smithi158.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-18T17:22:47.525 INFO:teuthology.orchestra.run.smithi158.stdout:which means they are currently configured by ifupdown: 2023-10-18T17:22:47.526 INFO:teuthology.orchestra.run.smithi158.stdout:- enp3s0f1 2023-10-18T17:22:47.526 INFO:teuthology.orchestra.run.smithi158.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-18T17:22:47.526 INFO:teuthology.orchestra.run.smithi158.stdout:remove their configuration from /etc/network/interfaces. 2023-10-18T17:22:47.526 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:22:47.764 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-18T17:22:48.337 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-18T17:22:49.304 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-18T17:22:50.304 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-18T17:22:50.429 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-18T17:22:50.613 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-18T17:22:50.739 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-18T17:22:50.890 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-18T17:22:51.016 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-18T17:22:51.340 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-18T17:22:51.341 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-18T17:22:52.294 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-18T17:22:52.912 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-18T17:22:53.055 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-18T17:22:53.256 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-18T17:22:53.758 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-18T17:23:00.793 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-18T17:23:00.901 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-18T17:23:02.137 INFO:teuthology.orchestra.run.smithi158.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-18T17:23:02.142 DEBUG:teuthology.parallel:result is None 2023-10-18T17:23:02.143 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T17:23:02.293 DEBUG:teuthology.orchestra.run.smithi158:> dpkg-query -W -f '${Version}' ceph 2023-10-18T17:23:02.338 INFO:teuthology.orchestra.run.smithi158.stdout:16.2.14-100-gb4ddd52c-1focal 2023-10-18T17:23:02.339 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-100-gb4ddd52c-1focal 2023-10-18T17:23:02.339 INFO:teuthology.task.install:The correct ceph version 16.2.14-100-gb4ddd52c-1focal is installed. 2023-10-18T17:23:02.340 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T17:23:02.486 DEBUG:teuthology.orchestra.run.smithi183:> dpkg-query -W -f '${Version}' ceph 2023-10-18T17:23:02.511 INFO:teuthology.orchestra.run.smithi183.stdout:16.2.14-100-gb4ddd52c-1focal 2023-10-18T17:23:02.511 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-100-gb4ddd52c-1focal 2023-10-18T17:23:02.511 INFO:teuthology.task.install:The correct ceph version 16.2.14-100-gb4ddd52c-1focal is installed. 2023-10-18T17:23:02.512 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-18T17:23:02.512 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:02.513 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-18T17:23:02.548 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:02.549 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-18T17:23:02.568 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-18T17:23:02.569 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:02.569 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/daemon-helper 2023-10-18T17:23:02.626 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-18T17:23:02.700 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:02.700 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/daemon-helper 2023-10-18T17:23:02.716 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-18T17:23:02.727 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-18T17:23:02.728 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:02.728 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-18T17:23:02.776 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-18T17:23:02.857 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:02.857 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-18T17:23:02.873 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-18T17:23:02.931 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-18T17:23:02.932 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:02.932 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/stdin-killer 2023-10-18T17:23:02.967 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-18T17:23:03.047 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:03.047 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/stdin-killer 2023-10-18T17:23:03.063 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-18T17:23:03.120 INFO:teuthology.run_tasks:Running task ceph... 2023-10-18T17:23:03.182 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-18T17:23:03.182 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 777 /var/log/ceph 2023-10-18T17:23:03.190 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 777 /var/log/ceph 2023-10-18T17:23:03.219 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-18T17:23:03.220 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-18T17:23:03.270 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-18T17:23:03.296 INFO:tasks.ceph:Creating extra log directories... 2023-10-18T17:23:03.297 DEBUG:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-18T17:23:03.346 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-18T17:23:03.381 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-18T17:23:03.381 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-18T17:23:03.381 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-18T17:23:03.382 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:03.382 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-18T17:23:03.439 DEBUG:teuthology.orchestra.run.smithi158:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-18T17:23:03.565 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:03.566 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-18T17:23:03.573 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-18T17:23:03.657 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-18T17:23:03.657 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'but it is still running', 'objects unfound and apparently lost', 'MDS_SLOW_METADATA_IO', 'MDS_TRIM'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-18T17:23:03.658 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429128', 'branch': 'wip-vshankar-testing-pacific-20231016.091648', 'description': 'fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/snaps}}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7429128', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-pacific-20231016.091648'}, 'ceph': {'cephfs': {'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'but it is still running', 'objects unfound and apparently lost', 'MDS_SLOW_METADATA_IO', 'MDS_TRIM'], 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-pacific-20231016.091648', 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 7825, 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5', 'sleep_before_teardown': 0, 'subset': '33/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-pacific-20231016.091648', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5', 'targets': {'smithi158.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi183.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5'}}, {'ceph': None}, {'kclient': None}, {'thrashosds': None}, {'workunit': {'clients': {'all': ['fs/snaps']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-16_12:48:28', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-18T17:23:03.658 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-18T17:23:03.666 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-18T17:23:03.678 DEBUG:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/run/ceph 2023-10-18T17:23:03.729 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/run/ceph 2023-10-18T17:23:03.759 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:03.759 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/scratch_devs of=/dev/stdout 2023-10-18T17:23:03.817 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-18T17:23:03.818 DEBUG:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_1 2023-10-18T17:23:03.879 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-18T17:23:03.879 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T17:23:03.879 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 5h/5d Inode: 497 Links: 1 2023-10-18T17:23:03.879 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T17:23:03.880 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2023-10-18 17:18:02.063559949 +0000 2023-10-18T17:23:03.880 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2023-10-18 17:18:01.591570834 +0000 2023-10-18T17:23:03.880 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2023-10-18 17:18:01.591570834 +0000 2023-10-18T17:23:03.880 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2023-10-18T17:23:03.880 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-18T17:23:03.953 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2023-10-18T17:23:03.954 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2023-10-18T17:23:03.954 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000568397 s, 901 kB/s 2023-10-18T17:23:03.957 DEBUG:teuthology.orchestra.run.smithi158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-18T17:23:04.024 DEBUG:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_2 2023-10-18T17:23:04.090 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-18T17:23:04.091 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T17:23:04.091 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 5h/5d Inode: 502 Links: 1 2023-10-18T17:23:04.091 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T17:23:04.091 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2023-10-18 17:18:02.823542422 +0000 2023-10-18T17:23:04.091 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2023-10-18 17:18:02.351553306 +0000 2023-10-18T17:23:04.091 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2023-10-18 17:18:02.351553306 +0000 2023-10-18T17:23:04.092 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2023-10-18T17:23:04.092 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-18T17:23:04.168 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2023-10-18T17:23:04.168 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2023-10-18T17:23:04.168 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000591894 s, 865 kB/s 2023-10-18T17:23:04.171 DEBUG:teuthology.orchestra.run.smithi158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-18T17:23:04.237 DEBUG:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_3 2023-10-18T17:23:04.296 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-18T17:23:04.297 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T17:23:04.297 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 5h/5d Inode: 510 Links: 1 2023-10-18T17:23:04.297 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T17:23:04.297 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2023-10-18 17:18:03.607524341 +0000 2023-10-18T17:23:04.297 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2023-10-18 17:18:03.099536057 +0000 2023-10-18T17:23:04.298 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2023-10-18 17:18:03.099536057 +0000 2023-10-18T17:23:04.298 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2023-10-18T17:23:04.298 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-18T17:23:04.370 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2023-10-18T17:23:04.371 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2023-10-18T17:23:04.371 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000408419 s, 1.3 MB/s 2023-10-18T17:23:04.374 DEBUG:teuthology.orchestra.run.smithi158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-18T17:23:04.436 DEBUG:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_4 2023-10-18T17:23:04.497 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-18T17:23:04.497 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T17:23:04.497 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 5h/5d Inode: 513 Links: 1 2023-10-18T17:23:04.498 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T17:23:04.498 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2023-10-18 17:18:04.387506354 +0000 2023-10-18T17:23:04.498 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2023-10-18 17:18:03.907517423 +0000 2023-10-18T17:23:04.498 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2023-10-18 17:18:03.907517423 +0000 2023-10-18T17:23:04.499 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2023-10-18T17:23:04.499 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-18T17:23:04.572 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2023-10-18T17:23:04.573 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2023-10-18T17:23:04.573 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000376631 s, 1.4 MB/s 2023-10-18T17:23:04.574 DEBUG:teuthology.orchestra.run.smithi158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-18T17:23:04.645 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T17:23:04.645 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:04.646 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/scratch_devs of=/dev/stdout 2023-10-18T17:23:04.653 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-18T17:23:04.654 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_1 2023-10-18T17:23:04.704 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-18T17:23:04.705 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T17:23:04.705 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 360 Links: 1 2023-10-18T17:23:04.705 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T17:23:04.705 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-10-18 17:16:24.418909571 +0000 2023-10-18T17:23:04.706 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-10-18 17:16:24.142916453 +0000 2023-10-18T17:23:04.706 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-10-18 17:16:24.142916453 +0000 2023-10-18T17:23:04.706 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2023-10-18T17:23:04.706 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-18T17:23:04.721 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-10-18T17:23:04.721 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-10-18T17:23:04.721 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000330581 s, 1.5 MB/s 2023-10-18T17:23:04.722 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-18T17:23:04.773 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_2 2023-10-18T17:23:04.780 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-18T17:23:04.780 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T17:23:04.780 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 365 Links: 1 2023-10-18T17:23:04.780 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T17:23:04.781 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-10-18 17:16:24.910897305 +0000 2023-10-18T17:23:04.781 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-10-18 17:16:24.630904285 +0000 2023-10-18T17:23:04.781 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-10-18 17:16:24.630904285 +0000 2023-10-18T17:23:04.781 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2023-10-18T17:23:04.781 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-18T17:23:04.795 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-10-18T17:23:04.795 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-10-18T17:23:04.796 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000369826 s, 1.4 MB/s 2023-10-18T17:23:04.796 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-18T17:23:04.845 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_3 2023-10-18T17:23:04.852 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-18T17:23:04.852 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T17:23:04.853 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 371 Links: 1 2023-10-18T17:23:04.853 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T17:23:04.853 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-10-18 17:16:25.178890625 +0000 2023-10-18T17:23:04.853 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-10-18 17:16:25.170890826 +0000 2023-10-18T17:23:04.853 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-10-18 17:16:25.170890826 +0000 2023-10-18T17:23:04.854 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2023-10-18T17:23:04.854 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-18T17:23:04.866 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-10-18T17:23:04.866 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-10-18T17:23:04.866 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000393271 s, 1.3 MB/s 2023-10-18T17:23:04.867 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-18T17:23:04.918 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_4 2023-10-18T17:23:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-18T17:23:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T17:23:04.926 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 380 Links: 1 2023-10-18T17:23:04.926 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T17:23:04.926 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-10-18 17:16:25.946871482 +0000 2023-10-18T17:23:04.926 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-10-18 17:16:25.662878560 +0000 2023-10-18T17:23:04.927 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-10-18 17:16:25.662878560 +0000 2023-10-18T17:23:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2023-10-18T17:23:04.927 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-18T17:23:04.941 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-10-18T17:23:04.941 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-10-18T17:23:04.941 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000374166 s, 1.4 MB/s 2023-10-18T17:23:04.942 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-18T17:23:04.993 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-18T17:23:04.994 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi158.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-18T17:23:04.994 INFO:tasks.ceph:Generating config... 2023-10-18T17:23:04.995 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-18T17:23:04.995 INFO:tasks.ceph:[client] debug client = 20 2023-10-18T17:23:04.996 INFO:tasks.ceph:[client] debug ms = 1 2023-10-18T17:23:04.996 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-18T17:23:04.996 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-18T17:23:04.996 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-18T17:23:04.997 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-18T17:23:04.997 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-18T17:23:04.997 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2023-10-18T17:23:04.998 INFO:tasks.ceph:[mds] mds bal merge size = 5 2023-10-18T17:23:04.998 INFO:tasks.ceph:[mds] mds bal split bits = 3 2023-10-18T17:23:04.998 INFO:tasks.ceph:[mds] mds bal split size = 100 2023-10-18T17:23:04.998 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-18T17:23:04.999 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-18T17:23:04.999 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = False 2023-10-18T17:23:04.999 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-18T17:23:04.999 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-18T17:23:05.000 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2023-10-18T17:23:05.000 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-18T17:23:05.000 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-18T17:23:05.000 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-18T17:23:05.001 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-18T17:23:05.001 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-18T17:23:05.001 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-18T17:23:05.001 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-18T17:23:05.002 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-18T17:23:05.002 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-18T17:23:05.002 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-18T17:23:05.003 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-18T17:23:05.003 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-18T17:23:05.003 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-18T17:23:05.003 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-18T17:23:05.004 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-18T17:23:05.004 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-18T17:23:05.004 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-18T17:23:05.004 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-18T17:23:05.005 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-18T17:23:05.005 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-18T17:23:05.005 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-18T17:23:05.005 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-18T17:23:05.006 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-18T17:23:05.006 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-10-18T17:23:05.006 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-18T17:23:05.007 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-18T17:23:05.007 INFO:tasks.ceph:Setting up mon.a... 2023-10-18T17:23:05.007 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-18T17:23:05.094 INFO:teuthology.orchestra.run.smithi158.stdout:creating /etc/ceph/ceph.keyring 2023-10-18T17:23:05.100 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-18T17:23:05.166 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-18T17:23:05.198 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.158'), ('mon.b', '172.21.15.183'), ('mon.c', '[v2:172.21.15.183:3301,v1:172.21.15.183:6790]')] 2023-10-18T17:23:05.199 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.158,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-18T17:23:05.200 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:05.200 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-18T17:23:05.256 DEBUG:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.158 --add b 172.21.15.183 --addv c '[v2:172.21.15.183:3301,v1:172.21.15.183:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-18T17:23:05.358 INFO:teuthology.orchestra.run.smithi158.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-18T17:23:05.358 INFO:teuthology.orchestra.run.smithi158.stdout:monmaptool: generated fsid ca4bb219-38c8-4c5b-a49c-213b123db018 2023-10-18T17:23:05.359 INFO:teuthology.orchestra.run.smithi158.stdout:epoch 0 2023-10-18T17:23:05.359 INFO:teuthology.orchestra.run.smithi158.stdout:fsid ca4bb219-38c8-4c5b-a49c-213b123db018 2023-10-18T17:23:05.359 INFO:teuthology.orchestra.run.smithi158.stdout:last_changed 2023-10-18T17:23:05.351983+0000 2023-10-18T17:23:05.359 INFO:teuthology.orchestra.run.smithi158.stdout:created 2023-10-18T17:23:05.351983+0000 2023-10-18T17:23:05.359 INFO:teuthology.orchestra.run.smithi158.stdout:min_mon_release 0 (unknown) 2023-10-18T17:23:05.360 INFO:teuthology.orchestra.run.smithi158.stdout:election_strategy: 1 2023-10-18T17:23:05.360 INFO:teuthology.orchestra.run.smithi158.stdout:0: [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] mon.a 2023-10-18T17:23:05.360 INFO:teuthology.orchestra.run.smithi158.stdout:1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.b 2023-10-18T17:23:05.360 INFO:teuthology.orchestra.run.smithi158.stdout:2: [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] mon.c 2023-10-18T17:23:05.360 INFO:teuthology.orchestra.run.smithi158.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-18T17:23:05.362 DEBUG:teuthology.orchestra.run.smithi158:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-18T17:23:05.381 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ca4bb219-38c8-4c5b-a49c-213b123db018... 2023-10-18T17:23:05.382 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-18T17:23:05.430 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-18T17:23:05.467 INFO:teuthology.orchestra.run.smithi183.stdout:[global] 2023-10-18T17:23:05.467 INFO:teuthology.orchestra.run.smithi183.stdout: chdir = "" 2023-10-18T17:23:05.467 INFO:teuthology.orchestra.run.smithi183.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-18T17:23:05.468 INFO:teuthology.orchestra.run.smithi183.stdout: auth supported = cephx 2023-10-18T17:23:05.468 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.468 INFO:teuthology.orchestra.run.smithi183.stdout: filestore xattr use omap = true 2023-10-18T17:23:05.468 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.469 INFO:teuthology.orchestra.run.smithi183.stdout: mon clock drift allowed = 1.000 2023-10-18T17:23:05.469 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.469 INFO:teuthology.orchestra.run.smithi183.stdout: osd crush chooseleaf type = 0 2023-10-18T17:23:05.469 INFO:teuthology.orchestra.run.smithi183.stdout: auth debug = true 2023-10-18T17:23:05.469 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.470 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on old message = true 2023-10-18T17:23:05.470 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on bug = true 2023-10-18T17:23:05.470 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.470 INFO:teuthology.orchestra.run.smithi183.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-18T17:23:05.471 INFO:teuthology.orchestra.run.smithi183.stdout: mon pg warn max object skew = 0 2023-10-18T17:23:05.471 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.471 INFO:teuthology.orchestra.run.smithi183.stdout: # disable pg_autoscaler by default for new pools 2023-10-18T17:23:05.471 INFO:teuthology.orchestra.run.smithi183.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-18T17:23:05.471 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.472 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default size = 2 2023-10-18T17:23:05.472 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.472 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow primary affinity = true 2023-10-18T17:23:05.472 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow pg remap = true 2023-10-18T17:23:05.472 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on legacy crush tunables = false 2023-10-18T17:23:05.473 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on crush straw calc version zero = false 2023-10-18T17:23:05.473 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on no sortbitwise = false 2023-10-18T17:23:05.473 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on osd down out interval zero = false 2023-10-18T17:23:05.473 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on too few osds = false 2023-10-18T17:23:05.474 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-18T17:23:05.474 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-18T17:23:05.474 INFO:teuthology.orchestra.run.smithi183.stdout: mon_allow_pool_size_one = true 2023-10-18T17:23:05.474 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.474 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-10-18T17:23:05.475 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.475 INFO:teuthology.orchestra.run.smithi183.stdout: osd default data pool replay window = 5 2023-10-18T17:23:05.475 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.475 INFO:teuthology.orchestra.run.smithi183.stdout: mon allow pool delete = true 2023-10-18T17:23:05.475 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.476 INFO:teuthology.orchestra.run.smithi183.stdout: mon cluster log file level = debug 2023-10-18T17:23:05.476 INFO:teuthology.orchestra.run.smithi183.stdout: debug asserts on shutdown = true 2023-10-18T17:23:05.476 INFO:teuthology.orchestra.run.smithi183.stdout: mon health detail to clog = false 2023-10-18T17:23:05.476 INFO:teuthology.orchestra.run.smithi183.stdout: mon host = "172.21.15.158,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]" 2023-10-18T17:23:05.476 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on skipped message = False 2023-10-18T17:23:05.477 INFO:teuthology.orchestra.run.smithi183.stdout: fsid = ca4bb219-38c8-4c5b-a49c-213b123db018 2023-10-18T17:23:05.477 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.477 INFO:teuthology.orchestra.run.smithi183.stdout:[osd] 2023-10-18T17:23:05.477 INFO:teuthology.orchestra.run.smithi183.stdout: osd journal size = 100 2023-10-18T17:23:05.478 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.478 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub load threshold = 5.0 2023-10-18T17:23:05.478 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub max interval = 600 2023-10-18T17:23:05.478 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.478 INFO:teuthology.orchestra.run.smithi183.stdout: osd recover clone overlap = true 2023-10-18T17:23:05.479 INFO:teuthology.orchestra.run.smithi183.stdout: osd recovery max chunk = 1048576 2023-10-18T17:23:05.479 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.479 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug shutdown = true 2023-10-18T17:23:05.479 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug op order = true 2023-10-18T17:23:05.479 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug verify stray on activate = true 2023-10-18T17:23:05.480 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.480 INFO:teuthology.orchestra.run.smithi183.stdout: osd open classes on start = true 2023-10-18T17:23:05.480 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug pg log writeout = true 2023-10-18T17:23:05.480 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.480 INFO:teuthology.orchestra.run.smithi183.stdout: osd deep scrub update digest min age = 30 2023-10-18T17:23:05.480 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.481 INFO:teuthology.orchestra.run.smithi183.stdout: osd map max advance = 10 2023-10-18T17:23:05.481 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.481 INFO:teuthology.orchestra.run.smithi183.stdout: journal zero on create = true 2023-10-18T17:23:05.481 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.481 INFO:teuthology.orchestra.run.smithi183.stdout: filestore ondisk finisher threads = 3 2023-10-18T17:23:05.482 INFO:teuthology.orchestra.run.smithi183.stdout: filestore apply finisher threads = 3 2023-10-18T17:23:05.482 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.482 INFO:teuthology.orchestra.run.smithi183.stdout: bdev debug aio = true 2023-10-18T17:23:05.482 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug misdirected ops = true 2023-10-18T17:23:05.482 INFO:teuthology.orchestra.run.smithi183.stdout: bdev async discard = True 2023-10-18T17:23:05.483 INFO:teuthology.orchestra.run.smithi183.stdout: bdev enable discard = True 2023-10-18T17:23:05.483 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore allocator = bitmap 2023-10-18T17:23:05.483 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore block size = 96636764160 2023-10-18T17:23:05.483 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore fsck on mount = True 2023-10-18T17:23:05.483 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluefs = 1/20 2023-10-18T17:23:05.484 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluestore = 1/20 2023-10-18T17:23:05.484 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-10-18T17:23:05.484 INFO:teuthology.orchestra.run.smithi183.stdout: debug osd = 20 2023-10-18T17:23:05.484 INFO:teuthology.orchestra.run.smithi183.stdout: debug rocksdb = 4/10 2023-10-18T17:23:05.484 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd backfillfull_ratio = 0.85 2023-10-18T17:23:05.485 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd full ratio = 0.9 2023-10-18T17:23:05.485 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd nearfull ratio = 0.8 2023-10-18T17:23:05.485 INFO:teuthology.orchestra.run.smithi183.stdout: osd failsafe full ratio = 0.95 2023-10-18T17:23:05.485 INFO:teuthology.orchestra.run.smithi183.stdout: osd max markdown count = 1000 2023-10-18T17:23:05.485 INFO:teuthology.orchestra.run.smithi183.stdout: osd objectstore = bluestore 2023-10-18T17:23:05.486 INFO:teuthology.orchestra.run.smithi183.stdout: osd op complaint time = 180 2023-10-18T17:23:05.486 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.486 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr] 2023-10-18T17:23:05.486 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-10-18T17:23:05.486 INFO:teuthology.orchestra.run.smithi183.stdout: debug mgr = 20 2023-10-18T17:23:05.487 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2023-10-18T17:23:05.487 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2023-10-18T17:23:05.487 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2023-10-18T17:23:05.487 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2023-10-18T17:23:05.487 INFO:teuthology.orchestra.run.smithi183.stdout: mgr/telemetry/nag = false 2023-10-18T17:23:05.488 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.488 INFO:teuthology.orchestra.run.smithi183.stdout:[mon] 2023-10-18T17:23:05.488 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-10-18T17:23:05.488 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2023-10-18T17:23:05.488 INFO:teuthology.orchestra.run.smithi183.stdout: debug paxos = 20 2023-10-18T17:23:05.489 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2023-10-18T17:23:05.489 INFO:teuthology.orchestra.run.smithi183.stdout: mon data avail warn = 5 2023-10-18T17:23:05.489 INFO:teuthology.orchestra.run.smithi183.stdout: mon mgr mkfs grace = 240 2023-10-18T17:23:05.489 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2023-10-18T17:23:05.489 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd reporter subtree level = osd 2023-10-18T17:23:05.489 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd prime pg temp = true 2023-10-18T17:23:05.490 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2023-10-18T17:23:05.490 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.490 INFO:teuthology.orchestra.run.smithi183.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-18T17:23:05.490 INFO:teuthology.orchestra.run.smithi183.stdout: auth mon ticket ttl = 660 # 11m 2023-10-18T17:23:05.491 INFO:teuthology.orchestra.run.smithi183.stdout: auth service ticket ttl = 240 # 4m 2023-10-18T17:23:05.491 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.491 INFO:teuthology.orchestra.run.smithi183.stdout: # don't complain about insecure global_id in the test suite 2023-10-18T17:23:05.491 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-18T17:23:05.491 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-18T17:23:05.491 INFO:teuthology.orchestra.run.smithi183.stdout: mon op complaint time = 120 2023-10-18T17:23:05.492 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-18T17:23:05.492 INFO:teuthology.orchestra.run.smithi183.stdout:[client] 2023-10-18T17:23:05.492 INFO:teuthology.orchestra.run.smithi183.stdout: rgw cache enabled = true 2023-10-18T17:23:05.492 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable ops log = true 2023-10-18T17:23:05.492 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable usage log = true 2023-10-18T17:23:05.493 INFO:teuthology.orchestra.run.smithi183.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-18T17:23:05.493 INFO:teuthology.orchestra.run.smithi183.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-18T17:23:05.493 INFO:teuthology.orchestra.run.smithi183.stdout: client mount timeout = 600 2023-10-18T17:23:05.493 INFO:teuthology.orchestra.run.smithi183.stdout: debug client = 20 2023-10-18T17:23:05.493 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-10-18T17:23:05.494 INFO:teuthology.orchestra.run.smithi183.stdout: rados mon op timeout = 900 2023-10-18T17:23:05.494 INFO:teuthology.orchestra.run.smithi183.stdout: rados osd op timeout = 900 2023-10-18T17:23:05.494 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.a] 2023-10-18T17:23:05.494 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.b] 2023-10-18T17:23:05.494 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.c] 2023-10-18T17:23:05.495 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.a] 2023-10-18T17:23:05.495 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.c] 2023-10-18T17:23:05.495 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.e] 2023-10-18T17:23:05.495 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.b] 2023-10-18T17:23:05.495 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.d] 2023-10-18T17:23:05.495 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.f] 2023-10-18T17:23:05.496 INFO:teuthology.orchestra.run.smithi183.stdout:[mds] 2023-10-18T17:23:05.496 INFO:teuthology.orchestra.run.smithi183.stdout: debug mds = 20 2023-10-18T17:23:05.496 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-10-18T17:23:05.496 INFO:teuthology.orchestra.run.smithi183.stdout: mds bal fragment size max = 10000 2023-10-18T17:23:05.496 INFO:teuthology.orchestra.run.smithi183.stdout: mds bal merge size = 5 2023-10-18T17:23:05.497 INFO:teuthology.orchestra.run.smithi183.stdout: mds bal split bits = 3 2023-10-18T17:23:05.497 INFO:teuthology.orchestra.run.smithi183.stdout: mds bal split size = 100 2023-10-18T17:23:05.497 INFO:teuthology.orchestra.run.smithi183.stdout: mds debug frag = True 2023-10-18T17:23:05.497 INFO:teuthology.orchestra.run.smithi183.stdout: mds debug scatterstat = True 2023-10-18T17:23:05.497 INFO:teuthology.orchestra.run.smithi183.stdout: mds oft prefetch dirfrags = False 2023-10-18T17:23:05.497 INFO:teuthology.orchestra.run.smithi183.stdout: mds op complaint time = 180 2023-10-18T17:23:05.498 INFO:teuthology.orchestra.run.smithi183.stdout: mds verify scatter = True 2023-10-18T17:23:05.498 INFO:teuthology.orchestra.run.smithi183.stdout: mds_sleep_rank_change = 5000000.0 2023-10-18T17:23:05.498 INFO:teuthology.orchestra.run.smithi183.stdout: osd op complaint time = 180 2023-10-18T17:23:05.498 INFO:teuthology.orchestra.run.smithi183.stdout: rados mon op timeout = 900 2023-10-18T17:23:05.498 INFO:teuthology.orchestra.run.smithi183.stdout: rados osd op timeout = 900 2023-10-18T17:23:05.505 INFO:teuthology.orchestra.run.smithi158.stdout:[global] 2023-10-18T17:23:05.505 INFO:teuthology.orchestra.run.smithi158.stdout: chdir = "" 2023-10-18T17:23:05.506 INFO:teuthology.orchestra.run.smithi158.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-18T17:23:05.506 INFO:teuthology.orchestra.run.smithi158.stdout: auth supported = cephx 2023-10-18T17:23:05.506 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.506 INFO:teuthology.orchestra.run.smithi158.stdout: filestore xattr use omap = true 2023-10-18T17:23:05.507 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.507 INFO:teuthology.orchestra.run.smithi158.stdout: mon clock drift allowed = 1.000 2023-10-18T17:23:05.507 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.507 INFO:teuthology.orchestra.run.smithi158.stdout: osd crush chooseleaf type = 0 2023-10-18T17:23:05.507 INFO:teuthology.orchestra.run.smithi158.stdout: auth debug = true 2023-10-18T17:23:05.508 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.508 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on old message = true 2023-10-18T17:23:05.508 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on bug = true 2023-10-18T17:23:05.508 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.508 INFO:teuthology.orchestra.run.smithi158.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-18T17:23:05.509 INFO:teuthology.orchestra.run.smithi158.stdout: mon pg warn max object skew = 0 2023-10-18T17:23:05.509 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.509 INFO:teuthology.orchestra.run.smithi158.stdout: # disable pg_autoscaler by default for new pools 2023-10-18T17:23:05.509 INFO:teuthology.orchestra.run.smithi158.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-18T17:23:05.509 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.509 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default size = 2 2023-10-18T17:23:05.510 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.510 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow primary affinity = true 2023-10-18T17:23:05.510 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow pg remap = true 2023-10-18T17:23:05.510 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on legacy crush tunables = false 2023-10-18T17:23:05.510 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on crush straw calc version zero = false 2023-10-18T17:23:05.511 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on no sortbitwise = false 2023-10-18T17:23:05.511 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on osd down out interval zero = false 2023-10-18T17:23:05.511 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on too few osds = false 2023-10-18T17:23:05.511 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-18T17:23:05.511 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-18T17:23:05.512 INFO:teuthology.orchestra.run.smithi158.stdout: mon_allow_pool_size_one = true 2023-10-18T17:23:05.512 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.512 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-10-18T17:23:05.512 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.512 INFO:teuthology.orchestra.run.smithi158.stdout: osd default data pool replay window = 5 2023-10-18T17:23:05.512 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.513 INFO:teuthology.orchestra.run.smithi158.stdout: mon allow pool delete = true 2023-10-18T17:23:05.513 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.513 INFO:teuthology.orchestra.run.smithi158.stdout: mon cluster log file level = debug 2023-10-18T17:23:05.513 INFO:teuthology.orchestra.run.smithi158.stdout: debug asserts on shutdown = true 2023-10-18T17:23:05.513 INFO:teuthology.orchestra.run.smithi158.stdout: mon health detail to clog = false 2023-10-18T17:23:05.514 INFO:teuthology.orchestra.run.smithi158.stdout: mon host = "172.21.15.158,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]" 2023-10-18T17:23:05.514 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on skipped message = False 2023-10-18T17:23:05.514 INFO:teuthology.orchestra.run.smithi158.stdout: fsid = ca4bb219-38c8-4c5b-a49c-213b123db018 2023-10-18T17:23:05.514 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.514 INFO:teuthology.orchestra.run.smithi158.stdout:[osd] 2023-10-18T17:23:05.515 INFO:teuthology.orchestra.run.smithi158.stdout: osd journal size = 100 2023-10-18T17:23:05.515 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.515 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub load threshold = 5.0 2023-10-18T17:23:05.515 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub max interval = 600 2023-10-18T17:23:05.515 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.515 INFO:teuthology.orchestra.run.smithi158.stdout: osd recover clone overlap = true 2023-10-18T17:23:05.516 INFO:teuthology.orchestra.run.smithi158.stdout: osd recovery max chunk = 1048576 2023-10-18T17:23:05.516 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.516 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug shutdown = true 2023-10-18T17:23:05.516 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug op order = true 2023-10-18T17:23:05.516 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug verify stray on activate = true 2023-10-18T17:23:05.516 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.517 INFO:teuthology.orchestra.run.smithi158.stdout: osd open classes on start = true 2023-10-18T17:23:05.517 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug pg log writeout = true 2023-10-18T17:23:05.517 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.517 INFO:teuthology.orchestra.run.smithi158.stdout: osd deep scrub update digest min age = 30 2023-10-18T17:23:05.517 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.518 INFO:teuthology.orchestra.run.smithi158.stdout: osd map max advance = 10 2023-10-18T17:23:05.518 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.518 INFO:teuthology.orchestra.run.smithi158.stdout: journal zero on create = true 2023-10-18T17:23:05.518 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.518 INFO:teuthology.orchestra.run.smithi158.stdout: filestore ondisk finisher threads = 3 2023-10-18T17:23:05.519 INFO:teuthology.orchestra.run.smithi158.stdout: filestore apply finisher threads = 3 2023-10-18T17:23:05.519 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.519 INFO:teuthology.orchestra.run.smithi158.stdout: bdev debug aio = true 2023-10-18T17:23:05.519 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug misdirected ops = true 2023-10-18T17:23:05.519 INFO:teuthology.orchestra.run.smithi158.stdout: bdev async discard = True 2023-10-18T17:23:05.520 INFO:teuthology.orchestra.run.smithi158.stdout: bdev enable discard = True 2023-10-18T17:23:05.520 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore allocator = bitmap 2023-10-18T17:23:05.520 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore block size = 96636764160 2023-10-18T17:23:05.520 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore fsck on mount = True 2023-10-18T17:23:05.520 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluefs = 1/20 2023-10-18T17:23:05.520 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluestore = 1/20 2023-10-18T17:23:05.521 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-18T17:23:05.521 INFO:teuthology.orchestra.run.smithi158.stdout: debug osd = 20 2023-10-18T17:23:05.521 INFO:teuthology.orchestra.run.smithi158.stdout: debug rocksdb = 4/10 2023-10-18T17:23:05.521 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd backfillfull_ratio = 0.85 2023-10-18T17:23:05.522 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd full ratio = 0.9 2023-10-18T17:23:05.522 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd nearfull ratio = 0.8 2023-10-18T17:23:05.522 INFO:teuthology.orchestra.run.smithi158.stdout: osd failsafe full ratio = 0.95 2023-10-18T17:23:05.522 INFO:teuthology.orchestra.run.smithi158.stdout: osd max markdown count = 1000 2023-10-18T17:23:05.522 INFO:teuthology.orchestra.run.smithi158.stdout: osd objectstore = bluestore 2023-10-18T17:23:05.523 INFO:teuthology.orchestra.run.smithi158.stdout: osd op complaint time = 180 2023-10-18T17:23:05.523 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.523 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr] 2023-10-18T17:23:05.523 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-18T17:23:05.524 INFO:teuthology.orchestra.run.smithi158.stdout: debug mgr = 20 2023-10-18T17:23:05.524 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2023-10-18T17:23:05.524 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2023-10-18T17:23:05.524 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2023-10-18T17:23:05.524 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2023-10-18T17:23:05.525 INFO:teuthology.orchestra.run.smithi158.stdout: mgr/telemetry/nag = false 2023-10-18T17:23:05.525 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.525 INFO:teuthology.orchestra.run.smithi158.stdout:[mon] 2023-10-18T17:23:05.525 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-18T17:23:05.526 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2023-10-18T17:23:05.526 INFO:teuthology.orchestra.run.smithi158.stdout: debug paxos = 20 2023-10-18T17:23:05.526 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2023-10-18T17:23:05.526 INFO:teuthology.orchestra.run.smithi158.stdout: mon data avail warn = 5 2023-10-18T17:23:05.526 INFO:teuthology.orchestra.run.smithi158.stdout: mon mgr mkfs grace = 240 2023-10-18T17:23:05.527 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2023-10-18T17:23:05.527 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd reporter subtree level = osd 2023-10-18T17:23:05.527 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd prime pg temp = true 2023-10-18T17:23:05.527 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2023-10-18T17:23:05.528 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.528 INFO:teuthology.orchestra.run.smithi158.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-18T17:23:05.528 INFO:teuthology.orchestra.run.smithi158.stdout: auth mon ticket ttl = 660 # 11m 2023-10-18T17:23:05.528 INFO:teuthology.orchestra.run.smithi158.stdout: auth service ticket ttl = 240 # 4m 2023-10-18T17:23:05.528 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.529 INFO:teuthology.orchestra.run.smithi158.stdout: # don't complain about insecure global_id in the test suite 2023-10-18T17:23:05.529 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-18T17:23:05.529 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-18T17:23:05.529 INFO:teuthology.orchestra.run.smithi158.stdout: mon op complaint time = 120 2023-10-18T17:23:05.529 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:05.530 INFO:teuthology.orchestra.run.smithi158.stdout:[client] 2023-10-18T17:23:05.530 INFO:teuthology.orchestra.run.smithi158.stdout: rgw cache enabled = true 2023-10-18T17:23:05.530 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable ops log = true 2023-10-18T17:23:05.530 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable usage log = true 2023-10-18T17:23:05.531 INFO:teuthology.orchestra.run.smithi158.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-18T17:23:05.531 INFO:teuthology.orchestra.run.smithi158.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-18T17:23:05.531 INFO:teuthology.orchestra.run.smithi158.stdout: client mount timeout = 600 2023-10-18T17:23:05.531 INFO:teuthology.orchestra.run.smithi158.stdout: debug client = 20 2023-10-18T17:23:05.531 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-18T17:23:05.532 INFO:teuthology.orchestra.run.smithi158.stdout: rados mon op timeout = 900 2023-10-18T17:23:05.532 INFO:teuthology.orchestra.run.smithi158.stdout: rados osd op timeout = 900 2023-10-18T17:23:05.532 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.a] 2023-10-18T17:23:05.532 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.b] 2023-10-18T17:23:05.533 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.c] 2023-10-18T17:23:05.533 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.a] 2023-10-18T17:23:05.533 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.c] 2023-10-18T17:23:05.533 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.e] 2023-10-18T17:23:05.533 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.b] 2023-10-18T17:23:05.533 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.d] 2023-10-18T17:23:05.534 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.f] 2023-10-18T17:23:05.534 INFO:teuthology.orchestra.run.smithi158.stdout:[mds] 2023-10-18T17:23:05.534 INFO:teuthology.orchestra.run.smithi158.stdout: debug mds = 20 2023-10-18T17:23:05.534 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-18T17:23:05.534 INFO:teuthology.orchestra.run.smithi158.stdout: mds bal fragment size max = 10000 2023-10-18T17:23:05.535 INFO:teuthology.orchestra.run.smithi158.stdout: mds bal merge size = 5 2023-10-18T17:23:05.535 INFO:teuthology.orchestra.run.smithi158.stdout: mds bal split bits = 3 2023-10-18T17:23:05.535 INFO:teuthology.orchestra.run.smithi158.stdout: mds bal split size = 100 2023-10-18T17:23:05.535 INFO:teuthology.orchestra.run.smithi158.stdout: mds debug frag = True 2023-10-18T17:23:05.535 INFO:teuthology.orchestra.run.smithi158.stdout: mds debug scatterstat = True 2023-10-18T17:23:05.535 INFO:teuthology.orchestra.run.smithi158.stdout: mds oft prefetch dirfrags = False 2023-10-18T17:23:05.536 INFO:teuthology.orchestra.run.smithi158.stdout: mds op complaint time = 180 2023-10-18T17:23:05.536 INFO:teuthology.orchestra.run.smithi158.stdout: mds verify scatter = True 2023-10-18T17:23:05.536 INFO:teuthology.orchestra.run.smithi158.stdout: mds_sleep_rank_change = 5000000.0 2023-10-18T17:23:05.536 INFO:teuthology.orchestra.run.smithi158.stdout: osd op complaint time = 180 2023-10-18T17:23:05.536 INFO:teuthology.orchestra.run.smithi158.stdout: rados mon op timeout = 900 2023-10-18T17:23:05.537 INFO:teuthology.orchestra.run.smithi158.stdout: rados osd op timeout = 900 2023-10-18T17:23:05.538 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-18T17:23:05.538 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-18T17:23:05.653 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-18T17:23:05.653 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:05.654 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-18T17:23:05.669 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:05.669 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-18T17:23:05.727 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi158.front.sepia.ceph.com 2023-10-18T17:23:05.727 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:05.728 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-18T17:23:05.728 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-18T17:23:05.829 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:05.829 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-18T17:23:05.890 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi183.front.sepia.ceph.com 2023-10-18T17:23:05.890 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:05.891 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-18T17:23:05.891 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-18T17:23:05.917 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:05.918 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-18T17:23:05.923 INFO:tasks.ceph:Setting up mon nodes... 2023-10-18T17:23:05.924 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-18T17:23:05.924 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-18T17:23:06.021 INFO:teuthology.orchestra.run.smithi158.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-18T17:23:06.028 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-18T17:23:06.092 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-18T17:23:06.095 INFO:tasks.ceph:Setting up mds nodes... 2023-10-18T17:23:06.095 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-18T17:23:06.178 INFO:teuthology.orchestra.run.smithi158.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-18T17:23:06.183 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-18T17:23:06.216 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-18T17:23:06.345 INFO:teuthology.orchestra.run.smithi158.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-18T17:23:06.351 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-18T17:23:06.383 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2023-10-18T17:23:06.523 INFO:teuthology.orchestra.run.smithi158.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2023-10-18T17:23:06.528 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2023-10-18T17:23:06.563 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-18T17:23:06.607 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-18T17:23:06.610 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-18T17:23:06.621 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-18T17:23:06.708 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-18T17:23:06.711 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-18T17:23:06.725 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2023-10-18T17:23:06.763 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2023-10-18T17:23:06.803 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2023-10-18T17:23:06.818 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-18T17:23:06.819 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-18T17:23:06.886 INFO:teuthology.orchestra.run.smithi158.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-18T17:23:06.913 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-18T17:23:06.914 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi158.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-18T17:23:06.914 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-18T17:23:06.945 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T17:23:06.945 INFO:tasks.ceph:role: osd.0 2023-10-18T17:23:06.945 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-18T17:23:06.946 DEBUG:teuthology.orchestra.run.smithi158:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-18T17:23:07.055 INFO:teuthology.orchestra.run.smithi158.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T17:23:07.055 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T17:23:07.055 INFO:teuthology.orchestra.run.smithi158.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T17:23:07.056 INFO:teuthology.orchestra.run.smithi158.stdout: = reflink=1 2023-10-18T17:23:07.056 INFO:teuthology.orchestra.run.smithi158.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T17:23:07.056 INFO:teuthology.orchestra.run.smithi158.stdout: = sunit=0 swidth=0 blks 2023-10-18T17:23:07.056 INFO:teuthology.orchestra.run.smithi158.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T17:23:07.056 INFO:teuthology.orchestra.run.smithi158.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T17:23:07.057 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T17:23:07.057 INFO:teuthology.orchestra.run.smithi158.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T17:23:07.060 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi158.front.sepia.ceph.com -o noatime 2023-10-18T17:23:07.060 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-18T17:23:07.107 DEBUG:teuthology.orchestra.run.smithi158:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-18T17:23:07.175 INFO:teuthology.orchestra.run.smithi158.stderr:sudo: /sbin/restorecon: command not found 2023-10-18T17:23:07.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T17:23:07.177 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-18T17:23:07.262 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T17:23:07.263 INFO:tasks.ceph:role: osd.1 2023-10-18T17:23:07.263 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-18T17:23:07.263 DEBUG:teuthology.orchestra.run.smithi158:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-18T17:23:07.374 INFO:teuthology.orchestra.run.smithi158.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T17:23:07.374 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T17:23:07.374 INFO:teuthology.orchestra.run.smithi158.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T17:23:07.374 INFO:teuthology.orchestra.run.smithi158.stdout: = reflink=1 2023-10-18T17:23:07.375 INFO:teuthology.orchestra.run.smithi158.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T17:23:07.375 INFO:teuthology.orchestra.run.smithi158.stdout: = sunit=0 swidth=0 blks 2023-10-18T17:23:07.375 INFO:teuthology.orchestra.run.smithi158.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T17:23:07.375 INFO:teuthology.orchestra.run.smithi158.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T17:23:07.375 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T17:23:07.375 INFO:teuthology.orchestra.run.smithi158.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T17:23:07.378 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi158.front.sepia.ceph.com -o noatime 2023-10-18T17:23:07.378 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-18T17:23:07.417 DEBUG:teuthology.orchestra.run.smithi158:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-18T17:23:07.483 INFO:teuthology.orchestra.run.smithi158.stderr:sudo: /sbin/restorecon: command not found 2023-10-18T17:23:07.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T17:23:07.484 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-18T17:23:07.568 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T17:23:07.569 INFO:tasks.ceph:role: osd.2 2023-10-18T17:23:07.569 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-18T17:23:07.569 DEBUG:teuthology.orchestra.run.smithi158:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-18T17:23:07.684 INFO:teuthology.orchestra.run.smithi158.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T17:23:07.684 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T17:23:07.684 INFO:teuthology.orchestra.run.smithi158.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T17:23:07.685 INFO:teuthology.orchestra.run.smithi158.stdout: = reflink=1 2023-10-18T17:23:07.685 INFO:teuthology.orchestra.run.smithi158.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T17:23:07.685 INFO:teuthology.orchestra.run.smithi158.stdout: = sunit=0 swidth=0 blks 2023-10-18T17:23:07.685 INFO:teuthology.orchestra.run.smithi158.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T17:23:07.685 INFO:teuthology.orchestra.run.smithi158.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T17:23:07.686 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T17:23:07.686 INFO:teuthology.orchestra.run.smithi158.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T17:23:07.688 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi158.front.sepia.ceph.com -o noatime 2023-10-18T17:23:07.689 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-18T17:23:07.730 DEBUG:teuthology.orchestra.run.smithi158:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-18T17:23:07.805 INFO:teuthology.orchestra.run.smithi158.stderr:sudo: /sbin/restorecon: command not found 2023-10-18T17:23:07.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T17:23:07.806 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-18T17:23:07.888 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T17:23:07.889 INFO:tasks.ceph:role: osd.3 2023-10-18T17:23:07.889 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-18T17:23:07.889 DEBUG:teuthology.orchestra.run.smithi158:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-18T17:23:08.001 INFO:teuthology.orchestra.run.smithi158.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T17:23:08.001 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T17:23:08.001 INFO:teuthology.orchestra.run.smithi158.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T17:23:08.001 INFO:teuthology.orchestra.run.smithi158.stdout: = reflink=1 2023-10-18T17:23:08.002 INFO:teuthology.orchestra.run.smithi158.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T17:23:08.002 INFO:teuthology.orchestra.run.smithi158.stdout: = sunit=0 swidth=0 blks 2023-10-18T17:23:08.002 INFO:teuthology.orchestra.run.smithi158.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T17:23:08.002 INFO:teuthology.orchestra.run.smithi158.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T17:23:08.003 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T17:23:08.003 INFO:teuthology.orchestra.run.smithi158.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T17:23:08.005 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi158.front.sepia.ceph.com -o noatime 2023-10-18T17:23:08.006 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-18T17:23:08.045 DEBUG:teuthology.orchestra.run.smithi158:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-18T17:23:08.111 INFO:teuthology.orchestra.run.smithi158.stderr:sudo: /sbin/restorecon: command not found 2023-10-18T17:23:08.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T17:23:08.113 DEBUG:teuthology.orchestra.run.smithi158:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T17:23:08.269 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:08.260+0000 7f9a08dc0080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-18T17:23:08.270 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:08.260+0000 7f9a08dc0080 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-18T17:23:08.270 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:08.260+0000 7f9a08dc0080 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-18T17:23:08.271 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:08.260+0000 7f9a08dc0080 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-18T17:23:08.271 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:08.260+0000 7f9a08dc0080 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-18T17:23:08.273 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:08.264+0000 7f9a08dc0080 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-18T17:23:11.810 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-18T17:23:11.845 DEBUG:teuthology.orchestra.run.smithi158:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T17:23:11.961 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:11.952+0000 7f6f040f0080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-18T17:23:11.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:11.952+0000 7f6f040f0080 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-18T17:23:11.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:11.952+0000 7f6f040f0080 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-18T17:23:11.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:11.952+0000 7f6f040f0080 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-18T17:23:11.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:11.952+0000 7f6f040f0080 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-18T17:23:11.965 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:11.956+0000 7f6f040f0080 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-18T17:23:15.511 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-18T17:23:15.547 DEBUG:teuthology.orchestra.run.smithi158:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T17:23:15.660 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:15.652+0000 7f557a4f2080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-18T17:23:15.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:15.652+0000 7f557a4f2080 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-18T17:23:15.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:15.652+0000 7f557a4f2080 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-18T17:23:15.663 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:15.652+0000 7f557a4f2080 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-18T17:23:15.663 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:15.652+0000 7f557a4f2080 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-18T17:23:15.664 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:15.656+0000 7f557a4f2080 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-18T17:23:19.201 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-18T17:23:19.236 DEBUG:teuthology.orchestra.run.smithi158:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T17:23:19.350 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:19.339+0000 7feee00e1080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-18T17:23:19.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:19.339+0000 7feee00e1080 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-18T17:23:19.352 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:19.339+0000 7feee00e1080 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-18T17:23:19.352 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:19.339+0000 7feee00e1080 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-18T17:23:19.352 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:19.339+0000 7feee00e1080 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-18T17:23:19.353 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:19.343+0000 7feee00e1080 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-18T17:23:22.896 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-18T17:23:22.929 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-18T17:23:22.946 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-18T17:23:22.946 INFO:tasks.ceph:role: osd.4 2023-10-18T17:23:22.947 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-18T17:23:22.947 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-18T17:23:23.469 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T17:23:23.469 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T17:23:23.469 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T17:23:23.470 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 2023-10-18T17:23:23.470 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T17:23:23.470 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-10-18T17:23:23.470 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T17:23:23.471 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T17:23:23.471 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T17:23:23.471 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T17:23:23.472 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-10-18T17:23:23.472 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-18T17:23:23.581 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-18T17:23:23.593 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: /sbin/restorecon: command not found 2023-10-18T17:23:23.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T17:23:23.594 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-18T17:23:23.653 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-18T17:23:23.653 INFO:tasks.ceph:role: osd.5 2023-10-18T17:23:23.653 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-18T17:23:23.654 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-18T17:23:24.150 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T17:23:24.151 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T17:23:24.151 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T17:23:24.151 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 2023-10-18T17:23:24.151 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T17:23:24.152 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-10-18T17:23:24.152 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T17:23:24.152 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T17:23:24.152 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T17:23:24.152 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T17:23:24.153 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-10-18T17:23:24.154 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-18T17:23:24.186 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-18T17:23:24.241 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: /sbin/restorecon: command not found 2023-10-18T17:23:24.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T17:23:24.243 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-18T17:23:24.254 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-18T17:23:24.254 INFO:tasks.ceph:role: osd.6 2023-10-18T17:23:24.254 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-18T17:23:24.255 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-18T17:23:24.717 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T17:23:24.717 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T17:23:24.717 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T17:23:24.718 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 2023-10-18T17:23:24.718 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T17:23:24.718 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-10-18T17:23:24.718 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T17:23:24.718 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T17:23:24.719 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T17:23:24.719 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T17:23:24.720 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-10-18T17:23:24.720 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-18T17:23:24.773 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-18T17:23:24.783 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: /sbin/restorecon: command not found 2023-10-18T17:23:24.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T17:23:24.785 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-18T17:23:24.795 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-18T17:23:24.795 INFO:tasks.ceph:role: osd.7 2023-10-18T17:23:24.795 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-18T17:23:24.795 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-18T17:23:25.338 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T17:23:25.338 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T17:23:25.338 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T17:23:25.339 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 2023-10-18T17:23:25.339 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T17:23:25.339 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-10-18T17:23:25.339 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T17:23:25.339 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T17:23:25.340 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T17:23:25.340 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T17:23:25.341 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-10-18T17:23:25.341 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-18T17:23:25.406 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-18T17:23:25.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T17:23:25.416 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: /sbin/restorecon: command not found 2023-10-18T17:23:25.416 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T17:23:25.554 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:25.553+0000 7f710bd74080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-18T17:23:25.558 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:25.553+0000 7f710bd74080 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-18T17:23:25.558 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:25.553+0000 7f710bd74080 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-18T17:23:25.558 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:25.553+0000 7f710bd74080 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-18T17:23:25.559 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:25.553+0000 7f710bd74080 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-18T17:23:25.565 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:25.561+0000 7f710bd74080 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-18T17:23:28.535 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-18T17:23:28.549 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T17:23:28.584 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:28.581+0000 7f0bceefa080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-18T17:23:28.585 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:28.581+0000 7f0bceefa080 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-18T17:23:28.585 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:28.581+0000 7f0bceefa080 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-18T17:23:28.586 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:28.581+0000 7f0bceefa080 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-18T17:23:28.586 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:28.581+0000 7f0bceefa080 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-18T17:23:28.586 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:28.581+0000 7f0bceefa080 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-18T17:23:31.575 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-18T17:23:31.635 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T17:23:31.675 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:31.668+0000 7ff20e1b8080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-18T17:23:31.675 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:31.672+0000 7ff20e1b8080 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-18T17:23:31.675 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:31.672+0000 7ff20e1b8080 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-18T17:23:31.675 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:31.672+0000 7ff20e1b8080 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-18T17:23:31.676 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:31.672+0000 7ff20e1b8080 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-18T17:23:31.676 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:31.672+0000 7ff20e1b8080 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-18T17:23:33.660 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:23:33.667 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:23:34.650 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-18T17:23:34.667 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T17:23:34.750 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:34.744+0000 7fe4b953e080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-18T17:23:34.751 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:34.744+0000 7fe4b953e080 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-18T17:23:34.751 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:34.744+0000 7fe4b953e080 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-18T17:23:34.751 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:34.744+0000 7fe4b953e080 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-18T17:23:34.751 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:34.744+0000 7fe4b953e080 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-18T17:23:34.752 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:34.748+0000 7fe4b953e080 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-18T17:23:37.714 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-18T17:23:37.731 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-18T17:23:37.732 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:37.732 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-18T17:23:37.773 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:37.774 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-18T17:23:37.854 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:37.855 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-18T17:23:37.931 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:37.931 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2023-10-18T17:23:38.010 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:38.010 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-18T17:23:38.090 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:38.091 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-18T17:23:38.168 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:38.168 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-18T17:23:38.243 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:38.243 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-18T17:23:38.323 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:38.323 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-18T17:23:38.339 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:38.340 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-18T17:23:38.398 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:38.398 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-18T17:23:38.408 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:38.408 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2023-10-18T17:23:38.424 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:38.425 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-18T17:23:38.433 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:38.434 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-18T17:23:38.445 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:38.446 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-18T17:23:38.506 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:38.507 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-18T17:23:38.517 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:38.517 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-18T17:23:38.537 INFO:tasks.ceph:Adding keys to all mons... 2023-10-18T17:23:38.538 DEBUG:teuthology.orchestra.run.smithi158:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-18T17:23:38.588 DEBUG:teuthology.orchestra.run.smithi183:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-18T17:23:38.603 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr.y] 2023-10-18T17:23:38.603 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB6FDBlLMLvABAAqlWx4nEja9CZp7J5mIEMAg== 2023-10-18T17:23:38.603 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.a] 2023-10-18T17:23:38.604 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB6FDBlpsBCChAAVbIXbFzpLuA51Q459aFctA== 2023-10-18T17:23:38.604 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.c] 2023-10-18T17:23:38.604 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB6FDBl0ig4FBAAzV/t+bAA/05St/bfCic1Ow== 2023-10-18T17:23:38.604 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.e] 2023-10-18T17:23:38.605 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB6FDBlbCjOHhAA0tmRbIiu142VMqbbBpJDHg== 2023-10-18T17:23:38.605 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.0] 2023-10-18T17:23:38.605 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB8FDBl7h20DxAAL2oWgPx/+Udz7Og8pS96LQ== 2023-10-18T17:23:38.605 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.1] 2023-10-18T17:23:38.605 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB/FDBluPnzOBAALLcFCkt7x41bTIeZI3iDCA== 2023-10-18T17:23:38.606 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.2] 2023-10-18T17:23:38.606 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQCDFDBle7f8JhAA0znyvFx4athpm9k/LdrSOA== 2023-10-18T17:23:38.606 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.3] 2023-10-18T17:23:38.606 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQCHFDBlR8SEFBAAPMUaTuXhgM2Je71QDPWdKA== 2023-10-18T17:23:38.607 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr.x] 2023-10-18T17:23:38.607 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB6FDBl8FuVBRAAmWI9wYnPAXQQjLQyHu3GrA== 2023-10-18T17:23:38.607 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.b] 2023-10-18T17:23:38.607 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB6FDBl8EFOJBAAgRPVRrtpTKvJ/XABV2ngcA== 2023-10-18T17:23:38.607 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.d] 2023-10-18T17:23:38.608 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB6FDBlGNlNKhAAWWXIXUYxlvgF463qTr/dMQ== 2023-10-18T17:23:38.608 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.f] 2023-10-18T17:23:38.608 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB6FDBlCE6bLRAApAj9C0GHs856yqQQwj2R7A== 2023-10-18T17:23:38.608 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.4] 2023-10-18T17:23:38.609 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQCNFDBl94YaIRAAknk3vyxbrWZ4NQJwU3xzog== 2023-10-18T17:23:38.609 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.5] 2023-10-18T17:23:38.609 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQCQFDBlI5PgIhAA3WsPloa7MFgD+9CdIPhGpQ== 2023-10-18T17:23:38.609 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.6] 2023-10-18T17:23:38.609 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQCTFDBlSPs3KBAAmrBOZH/e7UCph3WZRlTB6Q== 2023-10-18T17:23:38.610 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.7] 2023-10-18T17:23:38.610 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQCWFDBlxlG2LBAALaSbZPz2cSyZDIqzoaeFFQ== 2023-10-18T17:23:38.610 INFO:teuthology.orchestra.run.smithi183.stdout:[client.0] 2023-10-18T17:23:38.610 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB6FDBlF5R4NBAA3KML0vJwGTbH7Ee3onV/4g== 2023-10-18T17:23:38.613 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr.y] 2023-10-18T17:23:38.613 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQB6FDBlLMLvABAAqlWx4nEja9CZp7J5mIEMAg== 2023-10-18T17:23:38.613 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.a] 2023-10-18T17:23:38.613 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQB6FDBlpsBCChAAVbIXbFzpLuA51Q459aFctA== 2023-10-18T17:23:38.614 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.c] 2023-10-18T17:23:38.614 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQB6FDBl0ig4FBAAzV/t+bAA/05St/bfCic1Ow== 2023-10-18T17:23:38.614 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.e] 2023-10-18T17:23:38.614 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQB6FDBlbCjOHhAA0tmRbIiu142VMqbbBpJDHg== 2023-10-18T17:23:38.615 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.0] 2023-10-18T17:23:38.615 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQB8FDBl7h20DxAAL2oWgPx/+Udz7Og8pS96LQ== 2023-10-18T17:23:38.615 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.1] 2023-10-18T17:23:38.615 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQB/FDBluPnzOBAALLcFCkt7x41bTIeZI3iDCA== 2023-10-18T17:23:38.615 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.2] 2023-10-18T17:23:38.616 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCDFDBle7f8JhAA0znyvFx4athpm9k/LdrSOA== 2023-10-18T17:23:38.616 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.3] 2023-10-18T17:23:38.616 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCHFDBlR8SEFBAAPMUaTuXhgM2Je71QDPWdKA== 2023-10-18T17:23:38.616 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr.x] 2023-10-18T17:23:38.617 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQB6FDBl8FuVBRAAmWI9wYnPAXQQjLQyHu3GrA== 2023-10-18T17:23:38.617 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.b] 2023-10-18T17:23:38.617 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQB6FDBl8EFOJBAAgRPVRrtpTKvJ/XABV2ngcA== 2023-10-18T17:23:38.617 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.d] 2023-10-18T17:23:38.617 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQB6FDBlGNlNKhAAWWXIXUYxlvgF463qTr/dMQ== 2023-10-18T17:23:38.618 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.f] 2023-10-18T17:23:38.618 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQB6FDBlCE6bLRAApAj9C0GHs856yqQQwj2R7A== 2023-10-18T17:23:38.618 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.4] 2023-10-18T17:23:38.618 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCNFDBl94YaIRAAknk3vyxbrWZ4NQJwU3xzog== 2023-10-18T17:23:38.619 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.5] 2023-10-18T17:23:38.619 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCQFDBlI5PgIhAA3WsPloa7MFgD+9CdIPhGpQ== 2023-10-18T17:23:38.619 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.6] 2023-10-18T17:23:38.619 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCTFDBlSPs3KBAAmrBOZH/e7UCph3WZRlTB6Q== 2023-10-18T17:23:38.619 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.7] 2023-10-18T17:23:38.620 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQCWFDBlxlG2LBAALaSbZPz2cSyZDIqzoaeFFQ== 2023-10-18T17:23:38.620 INFO:teuthology.orchestra.run.smithi158.stdout:[client.0] 2023-10-18T17:23:38.620 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQB6FDBlF5R4NBAA3KML0vJwGTbH7Ee3onV/4g== 2023-10-18T17:23:38.621 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-18T17:23:38.672 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-18T17:23:38.735 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T17:23:38.742 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T17:23:38.810 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T17:23:38.816 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T17:23:38.882 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T17:23:38.889 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T17:23:38.954 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T17:23:38.962 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T17:23:39.025 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T17:23:39.032 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T17:23:39.091 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T17:23:39.098 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T17:23:39.166 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T17:23:39.173 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T17:23:39.238 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-18T17:23:39.245 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-18T17:23:39.305 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T17:23:39.314 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T17:23:39.374 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T17:23:39.380 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T17:23:39.445 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T17:23:39.452 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T17:23:39.518 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T17:23:39.526 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T17:23:39.589 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T17:23:39.597 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T17:23:39.658 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T17:23:39.665 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T17:23:39.727 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T17:23:39.734 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T17:23:39.797 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-18T17:23:39.804 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-18T17:23:39.868 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-18T17:23:39.868 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-18T17:23:39.901 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-18T17:23:40.033 DEBUG:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-18T17:23:40.064 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-18T17:23:40.081 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-18T17:23:40.132 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-18T17:23:40.146 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-18T17:23:40.157 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-18T17:23:40.271 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-18T17:23:40.287 DEBUG:teuthology.orchestra.run.smithi158:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-18T17:23:40.294 DEBUG:teuthology.orchestra.run.smithi183:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-18T17:23:40.304 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-18T17:23:40.305 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-18T17:23:40.305 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-18T17:23:40.353 INFO:tasks.ceph.mon.a:Started 2023-10-18T17:23:40.353 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-18T17:23:40.354 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-18T17:23:40.356 INFO:tasks.ceph.mon.b:Started 2023-10-18T17:23:40.356 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-18T17:23:40.356 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-18T17:23:40.359 INFO:tasks.ceph.mon.c:Started 2023-10-18T17:23:40.359 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-18T17:23:40.359 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-18T17:23:40.360 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-18T17:23:40.364 INFO:tasks.ceph.mgr.y:Started 2023-10-18T17:23:40.364 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-18T17:23:40.365 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-18T17:23:40.367 INFO:tasks.ceph.mgr.x:Started 2023-10-18T17:23:40.368 INFO:tasks.ceph:Setting crush tunables to default 2023-10-18T17:23:40.368 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd crush tunables default 2023-10-18T17:23:40.507 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.498+0000 7f753885a700 1 Processor -- start 2023-10-18T17:23:40.508 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.498+0000 7f753885a700 1 -- start start 2023-10-18T17:23:40.510 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.502+0000 7f753885a700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 0x7f75340c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:40.510 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.502+0000 7f753885a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 0x7f7534065ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:40.510 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.502+0000 7f753885a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753414ffb0 con 0x7f75340c23e0 2023-10-18T17:23:40.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.502+0000 7f753885a700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7534150df0 con 0x7f75340c11f0 2023-10-18T17:23:40.513 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.502+0000 7f753885a700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7534150270 con 0x7f7534065670 2023-10-18T17:23:40.513 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.502+0000 7f753259c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 0x7f75340c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:40.513 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.502+0000 7f753259c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 0x7f75340c27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:58600/0 (socket says 172.21.15.158:58600) 2023-10-18T17:23:40.514 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.502+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 learned_addr learned my addr 172.21.15.158:0/1013394911 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:23:40.514 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.502+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 msgr2=0x7f75340c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-18T17:23:40.514 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.502+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 msgr2=0x7f75340c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T17:23:40.515 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.502+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 0x7f75340c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-18T17:23:40.515 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.502+0000 7f753359e700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 0x7f7534065ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:40.515 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.502+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 0x7f75340c27c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:23:40.515 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.502+0000 7f753359e700 1 -- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 msgr2=0x7f7534065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-18T17:23:40.516 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.502+0000 7f753359e700 1 -- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 msgr2=0x7f7534065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T17:23:40.516 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.502+0000 7f753359e700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 0x7f7534065ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-18T17:23:40.516 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.502+0000 7f753359e700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 0x7f7534065ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:23:40.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.702+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 0x7f75340c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:40.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.702+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 msgr2=0x7f75340c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-18T17:23:40.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.702+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 msgr2=0x7f75340c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T17:23:40.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.702+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 0x7f75340c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-18T17:23:40.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.702+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 0x7f75340c27c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:23:40.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.702+0000 7f753359e700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 0x7f7534065ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:40.714 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.702+0000 7f753359e700 1 -- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 msgr2=0x7f7534065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-18T17:23:40.714 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.702+0000 7f753359e700 1 -- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 msgr2=0x7f7534065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T17:23:40.714 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.702+0000 7f753359e700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 0x7f7534065ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-18T17:23:40.714 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:40.702+0000 7f753359e700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 0x7f7534065ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:23:41.114 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.102+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 0x7f75340c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:41.114 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.106+0000 7f753359e700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 0x7f7534065ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:41.114 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.106+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 msgr2=0x7f75340c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-18T17:23:41.115 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.106+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 msgr2=0x7f75340c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T17:23:41.115 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.106+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 0x7f75340c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-18T17:23:41.115 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.106+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 0x7f75340c27c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:23:41.115 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.106+0000 7f753359e700 1 -- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 msgr2=0x7f7534065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-18T17:23:41.115 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.106+0000 7f753359e700 1 -- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 msgr2=0x7f7534065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T17:23:41.116 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.106+0000 7f753359e700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 0x7f7534065ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-18T17:23:41.116 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.106+0000 7f753359e700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 0x7f7534065ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:23:41.916 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.906+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 0x7f75340c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:41.916 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.906+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 msgr2=0x7f75340c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-18T17:23:41.916 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.906+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 msgr2=0x7f75340c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T17:23:41.917 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.906+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 0x7f75340c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-18T17:23:41.917 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.906+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 0x7f75340c27c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:23:41.917 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.906+0000 7f753359e700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 0x7f7534065ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:41.917 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.906+0000 7f753359e700 1 -- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 msgr2=0x7f7534065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-18T17:23:41.917 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.906+0000 7f753359e700 1 -- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 msgr2=0x7f7534065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T17:23:41.917 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.906+0000 7f753359e700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 0x7f7534065ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-18T17:23:41.918 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:41.906+0000 7f753359e700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 0x7f7534065ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:23:43.510 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:43.502+0000 7f7530d99700 1 -- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 msgr2=0x7f7534065ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:23:43.510 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:43.502+0000 7f7530d99700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 0x7f7534065ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:43.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:43.502+0000 7f7530d99700 1 -- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 msgr2=0x7f75340c27c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:23:43.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:43.502+0000 7f7530d99700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.183:3300/0 conn(0x7f75340c11f0 0x7f75340c27c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:43.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:43.502+0000 7f7530d99700 1 -- 172.21.15.158:0/1013394911 >> v1:172.21.15.158:6789/0 conn(0x7f75340c23e0 legacy=0x7f75340664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:43.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:43.502+0000 7f7530d99700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 0x7f75200096e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:43.512 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:43.502+0000 7f7530d99700 1 -- 172.21.15.158:0/1013394911 --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7534150550 con 0x7f7520003590 2023-10-18T17:23:43.512 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:43.502+0000 7f7530d99700 1 -- 172.21.15.158:0/1013394911 --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7534150df0 con 0x7f7520007220 2023-10-18T17:23:43.513 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:43.502+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 0x7f75200096e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:43.513 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:43.502+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 msgr2=0x7f75200096e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-18T17:23:43.513 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:43.502+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 msgr2=0x7f75200096e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T17:23:43.513 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:43.502+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 0x7f75200096e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-18T17:23:43.513 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:43.502+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 0x7f75200096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:23:43.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:43.702+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 0x7f75200096e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:43.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:43.702+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 msgr2=0x7f75200096e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-18T17:23:43.714 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:43.702+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 msgr2=0x7f75200096e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T17:23:43.714 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:43.702+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 0x7f75200096e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-18T17:23:43.714 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:43.702+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 0x7f75200096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:23:44.114 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:44.106+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 0x7f75200096e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:44.115 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:44.106+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 msgr2=0x7f75200096e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-18T17:23:44.115 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:44.106+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 msgr2=0x7f75200096e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T17:23:44.115 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:44.106+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 0x7f75200096e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-18T17:23:44.115 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:44.106+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 0x7f75200096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:23:44.917 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:44.906+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 0x7f75200096e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:44.917 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:44.906+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 msgr2=0x7f75200096e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-18T17:23:44.917 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:44.906+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 msgr2=0x7f75200096e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T17:23:44.917 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:44.906+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 0x7f75200096e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-18T17:23:44.918 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:44.906+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 0x7f75200096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:23:45.577 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.566+0000 7f7531d9b700 1 -- 172.21.15.158:0/1013394911 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880460527 0 0) 0x7f7534150550 con 0x7f7520003590 2023-10-18T17:23:45.577 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.570+0000 7f7531d9b700 1 -- 172.21.15.158:0/1013394911 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f751c0033f0 con 0x7f7520003590 2023-10-18T17:23:45.581 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f7531d9b700 1 -- 172.21.15.158:0/1013394911 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2303525523 0 0) 0x7f751c0033f0 con 0x7f7520003590 2023-10-18T17:23:45.582 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f7531d9b700 1 -- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 msgr2=0x7f75200096e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:23:45.582 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f7531d9b700 1 --2- 172.21.15.158:0/1013394911 >> v2:172.21.15.158:3300/0 conn(0x7f7520007220 0x7f75200096e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:45.582 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f7531d9b700 1 -- 172.21.15.158:0/1013394911 --> v1:172.21.15.183:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752000adf0 con 0x7f7520003590 2023-10-18T17:23:45.582 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f7531d9b700 1 -- 172.21.15.158:0/1013394911 <== mon.1 v1:172.21.15.183:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2074596555 0 0) 0x7f7524002540 con 0x7f7520003590 2023-10-18T17:23:45.582 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f7531d9b700 1 -- 172.21.15.158:0/1013394911 >> v1:172.21.15.183:6789/0 conn(0x7f7520003590 legacy=0x7f75200059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:45.584 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f7531d9b700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 0x7f751c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:45.584 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f7531d9b700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f751c003ea0 0x7f751c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:45.584 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f753359e700 1 -- 172.21.15.158:0/1013394911 reap_dead start 2023-10-18T17:23:45.584 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f7531d9b700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f751c004b80 0x7f751c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:45.585 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f7531d9b700 1 -- 172.21.15.158:0/1013394911 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7534150df0 con 0x7f751c004b80 2023-10-18T17:23:45.585 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f7531d9b700 1 -- 172.21.15.158:0/1013394911 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c00baa0 con 0x7f751c003ea0 2023-10-18T17:23:45.585 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f7531d9b700 1 -- 172.21.15.158:0/1013394911 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c00bc60 con 0x7f7534065670 2023-10-18T17:23:45.585 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f751c003ea0 0x7f751c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:45.585 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f7532d9d700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 0x7f751c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:45.586 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f753359e700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f751c004b80 0x7f751c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:45.586 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 msgr2=0x7f751c0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:45.586 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 0x7f751c0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:45.586 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f751c004b80 msgr2=0x7f751c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:45.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f751c004b80 0x7f751c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:45.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f753259c700 1 -- 172.21.15.158:0/1013394911 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752000adf0 con 0x7f751c003ea0 2023-10-18T17:23:45.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f753359e700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f751c004b80 0x7f751c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:23:45.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f753259c700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f751c003ea0 0x7f751c004690 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f7528006e70 tx=0x7f7528008040).ready entity=mon.1 client_cookie=e81f9f1dc793d743 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:45.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f7531d9b700 1 -- 172.21.15.158:0/1013394911 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7528019ea0 con 0x7f751c003ea0 2023-10-18T17:23:45.588 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f7531d9b700 1 -- 172.21.15.158:0/1013394911 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7528019760 con 0x7f751c003ea0 2023-10-18T17:23:45.588 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.574+0000 7f7531d9b700 1 -- 172.21.15.158:0/1013394911 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752801e070 con 0x7f751c003ea0 2023-10-18T17:23:45.589 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.578+0000 7f753885a700 1 -- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f751c003ea0 msgr2=0x7f751c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:45.589 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.578+0000 7f753885a700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f751c003ea0 0x7f751c004690 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f7528006e70 tx=0x7f7528008040).stop 2023-10-18T17:23:45.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.578+0000 7f753885a700 1 -- 172.21.15.158:0/1013394911 shutdown_connections 2023-10-18T17:23:45.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.578+0000 7f753885a700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f751c004b80 0x7f751c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:45.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.578+0000 7f753885a700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f751c003ea0 0x7f751c004690 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:45.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.578+0000 7f753885a700 1 --2- 172.21.15.158:0/1013394911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7534065670 0x7f751c0038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:45.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.578+0000 7f753885a700 1 -- 172.21.15.158:0/1013394911 >> 172.21.15.158:0/1013394911 conn(0x7f75340620d0 msgr2=0x7f75340624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:45.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.578+0000 7f753885a700 1 -- 172.21.15.158:0/1013394911 shutdown_connections 2023-10-18T17:23:45.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.578+0000 7f753885a700 1 -- 172.21.15.158:0/1013394911 wait complete. 2023-10-18T17:23:45.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.578+0000 7f753885a700 1 Processor -- start 2023-10-18T17:23:45.592 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.578+0000 7f753885a700 1 -- start start 2023-10-18T17:23:45.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.582+0000 7f753885a700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f751c003ea0 0x7f7534147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:45.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.582+0000 7f753885a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f751c004b80 0x7f7534144ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:45.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.582+0000 7f753885a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7534065670 0x7f7534065a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:45.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.582+0000 7f753885a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75340bf980 con 0x7f7534065670 2023-10-18T17:23:45.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.582+0000 7f753885a700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7534160320 con 0x7f751c003ea0 2023-10-18T17:23:45.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.582+0000 7f753885a700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753415f730 con 0x7f751c004b80 2023-10-18T17:23:45.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.582+0000 7f7532d9d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f751c003ea0 0x7f7534147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:45.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.582+0000 7f753359e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7534065670 0x7f7534065a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:45.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.582+0000 7f7532d9d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f751c003ea0 0x7f7534147ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:58710/0 (socket says 172.21.15.158:58710) 2023-10-18T17:23:45.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.582+0000 7f7532d9d700 1 -- 172.21.15.158:0/1558539221 learned_addr learned my addr 172.21.15.158:0/1558539221 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:23:45.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.582+0000 7f753359e700 1 --2- 172.21.15.158:0/1558539221 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7534065670 0x7f7534065a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56788/0 (socket says 172.21.15.158:56788) 2023-10-18T17:23:45.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.582+0000 7f753259c700 1 --2- 172.21.15.158:0/1558539221 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f751c004b80 0x7f7534144ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:45.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.582+0000 7f753359e700 1 -- 172.21.15.158:0/1558539221 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f751c004b80 msgr2=0x7f7534144ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:45.597 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.582+0000 7f753359e700 1 --2- 172.21.15.158:0/1558539221 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f751c004b80 0x7f7534144ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:45.597 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.582+0000 7f753359e700 1 -- 172.21.15.158:0/1558539221 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f751c003ea0 msgr2=0x7f7534147ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:45.597 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.582+0000 7f753359e700 1 --2- 172.21.15.158:0/1558539221 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f751c003ea0 0x7f7534147ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:45.597 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.582+0000 7f753359e700 1 -- 172.21.15.158:0/1558539221 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7534163650 con 0x7f7534065670 2023-10-18T17:23:45.598 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.582+0000 7f7532d9d700 1 --2- 172.21.15.158:0/1558539221 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f751c003ea0 0x7f7534147ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:23:45.598 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.582+0000 7f753359e700 1 --2- 172.21.15.158:0/1558539221 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7534065670 0x7f7534065a50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f7534067b90 tx=0x7f752c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:45.598 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.586+0000 7f751affd700 1 -- 172.21.15.158:0/1558539221 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c013c00 con 0x7f7534065670 2023-10-18T17:23:45.598 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.586+0000 7f751affd700 1 -- 172.21.15.158:0/1558539221 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752c00f040 con 0x7f7534065670 2023-10-18T17:23:45.598 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.586+0000 7f753885a700 1 -- 172.21.15.158:0/1558539221 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7534163930 con 0x7f7534065670 2023-10-18T17:23:45.599 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.586+0000 7f751affd700 1 -- 172.21.15.158:0/1558539221 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c018450 con 0x7f7534065670 2023-10-18T17:23:45.599 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.586+0000 7f753885a700 1 -- 172.21.15.158:0/1558539221 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753415fcd0 con 0x7f7534065670 2023-10-18T17:23:45.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.586+0000 7f753885a700 1 -- 172.21.15.158:0/1558539221 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7534046f00 con 0x7f7534065670 2023-10-18T17:23:45.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.586+0000 7f751affd700 1 -- 172.21.15.158:0/1558539221 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f752c003040 con 0x7f7534065670 2023-10-18T17:23:45.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.586+0000 7f751affd700 1 -- 172.21.15.158:0/1558539221 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f752c021450 con 0x7f7534065670 2023-10-18T17:23:45.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.590+0000 7f751affd700 1 -- 172.21.15.158:0/1558539221 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f752c01c070 con 0x7f7534065670 2023-10-18T17:23:45.673 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.666+0000 7f753885a700 1 -- 172.21.15.158:0/1558539221 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7534160460 con 0x7f7534065670 2023-10-18T17:23:45.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.670+0000 7f751affd700 1 -- 172.21.15.158:0/1558539221 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f752c018bf0 con 0x7f7534065670 2023-10-18T17:23:45.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.674+0000 7f753885a700 1 -- 172.21.15.158:0/1558539221 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7534065670 msgr2=0x7f7534065a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:45.682 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.674+0000 7f753885a700 1 --2- 172.21.15.158:0/1558539221 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7534065670 0x7f7534065a50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f7534067b90 tx=0x7f752c00b040).stop 2023-10-18T17:23:45.682 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.674+0000 7f753885a700 1 -- 172.21.15.158:0/1558539221 shutdown_connections 2023-10-18T17:23:45.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.674+0000 7f753885a700 1 --2- 172.21.15.158:0/1558539221 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7534065670 0x7f7534065a50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:45.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.674+0000 7f753885a700 1 --2- 172.21.15.158:0/1558539221 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f751c004b80 0x7f7534144ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:45.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.674+0000 7f753885a700 1 --2- 172.21.15.158:0/1558539221 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f751c003ea0 0x7f7534147ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:45.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.674+0000 7f753885a700 1 -- 172.21.15.158:0/1558539221 >> 172.21.15.158:0/1558539221 conn(0x7f75340620d0 msgr2=0x7f75340c1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:45.684 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.674+0000 7f753885a700 1 -- 172.21.15.158:0/1558539221 shutdown_connections 2023-10-18T17:23:45.684 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:45.674+0000 7f753885a700 1 -- 172.21.15.158:0/1558539221 wait complete. 2023-10-18T17:23:45.684 INFO:teuthology.orchestra.run.smithi158.stderr:adjusted tunables profile to default 2023-10-18T17:23:45.702 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-18T17:23:45.702 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:45.703 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-18T17:23:45.734 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:45.734 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-18T17:23:45.780 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:45.776+0000 7fa69eb27500 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-18T17:23:45.818 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:45.819 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-18T17:23:45.823 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:45.814+0000 7f45f5d5b500 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-18T17:23:45.840 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:45.836+0000 7fa69eb27500 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-18T17:23:45.855 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T17:23:45.856 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-18T17:23:45.908 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:45.898+0000 7f45f5d5b500 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-18T17:23:45.933 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:45.934 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-18T17:23:45.950 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:45.950 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-18T17:23:46.006 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:46.007 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-18T17:23:46.021 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-18T17:23:46.022 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-18T17:23:46.030 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 1f621b1e-5ea4-4dc3-80e1-c415c7cc97d0 0 2023-10-18T17:23:46.179 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.172+0000 7f112b59e700 1 Processor -- start 2023-10-18T17:23:46.179 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.172+0000 7f112b59e700 1 -- start start 2023-10-18T17:23:46.181 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112b59e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f112c0bfc10 0x7f112c0bfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.181 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112b59e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f112c068e00 0x7f112c0b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.182 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112b59e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f112c0667e0 con 0x7f112c14d350 2023-10-18T17:23:46.182 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112b59e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f112c066b80 con 0x7f112c0bfc10 2023-10-18T17:23:46.182 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112b59e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112c069590 con 0x7f112c068e00 2023-10-18T17:23:46.182 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112ad9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f112c068e00 0x7f112c0b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.183 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112ad9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f112c068e00 0x7f112c0b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:59510/0 (socket says 172.21.15.183:59510) 2023-10-18T17:23:46.183 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112ad9d700 1 -- 172.21.15.183:0/3119411928 learned_addr learned my addr 172.21.15.183:0/3119411928 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-18T17:23:46.183 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112a59c700 1 --2- 172.21.15.183:0/3119411928 >> v2:172.21.15.158:3300/0 conn(0x7f112c0bfc10 0x7f112c0bfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.183 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112ad9d700 1 -- 172.21.15.183:0/3119411928 >> v2:172.21.15.158:3300/0 conn(0x7f112c0bfc10 msgr2=0x7f112c0bfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:46.183 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112ad9d700 1 --2- 172.21.15.183:0/3119411928 >> v2:172.21.15.158:3300/0 conn(0x7f112c0bfc10 0x7f112c0bfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.184 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112ad9d700 1 -- 172.21.15.183:0/3119411928 >> v1:172.21.15.158:6789/0 conn(0x7f112c14d350 legacy=0x7f112c066fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:46.184 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112ad9d700 1 -- 172.21.15.183:0/3119411928 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c069870 con 0x7f112c068e00 2023-10-18T17:23:46.184 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112a59c700 1 --2- 172.21.15.183:0/3119411928 >> v2:172.21.15.158:3300/0 conn(0x7f112c0bfc10 0x7f112c0bfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T17:23:46.184 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112ad9d700 1 --2- 172.21.15.183:0/3119411928 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f112c068e00 0x7f112c0b6390 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f112c0c40b0 tx=0x7f1124009840).ready entity=mon.2 client_cookie=fb709261c9764a61 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:46.184 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112959a700 1 -- 172.21.15.183:0/3119411928 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112400e070 con 0x7f112c068e00 2023-10-18T17:23:46.185 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112959a700 1 -- 172.21.15.183:0/3119411928 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112400baa0 con 0x7f112c068e00 2023-10-18T17:23:46.185 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112959a700 1 -- 172.21.15.183:0/3119411928 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112400be20 con 0x7f112c068e00 2023-10-18T17:23:46.187 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112b59e700 1 -- 172.21.15.183:0/3119411928 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f112c068e00 msgr2=0x7f112c0b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.188 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112b59e700 1 --2- 172.21.15.183:0/3119411928 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f112c068e00 0x7f112c0b6390 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f112c0c40b0 tx=0x7f1124009840).stop 2023-10-18T17:23:46.188 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112b59e700 1 -- 172.21.15.183:0/3119411928 shutdown_connections 2023-10-18T17:23:46.188 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112b59e700 1 --2- 172.21.15.183:0/3119411928 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f112c068e00 0x7f112c0b6390 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.188 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112b59e700 1 --2- 172.21.15.183:0/3119411928 >> v2:172.21.15.158:3300/0 conn(0x7f112c0bfc10 0x7f112c0bfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.189 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112b59e700 1 -- 172.21.15.183:0/3119411928 >> 172.21.15.183:0/3119411928 conn(0x7f112c05dc20 msgr2=0x7f112c05e000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:46.189 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112b59e700 1 -- 172.21.15.183:0/3119411928 shutdown_connections 2023-10-18T17:23:46.189 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.176+0000 7f112b59e700 1 -- 172.21.15.183:0/3119411928 wait complete. 2023-10-18T17:23:46.189 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112b59e700 1 Processor -- start 2023-10-18T17:23:46.189 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112b59e700 1 -- start start 2023-10-18T17:23:46.190 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112b59e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f112c068e00 0x7f112c0bd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.190 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112b59e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f112c0bfc10 0x7f112c1479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.190 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112b59e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f112c14d350 0x7f112c163b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.190 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112b59e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c145e50 con 0x7f112c068e00 2023-10-18T17:23:46.190 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112b59e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c1630e0 con 0x7f112c0bfc10 2023-10-18T17:23:46.191 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112b59e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112c1636a0 con 0x7f112c14d350 2023-10-18T17:23:46.191 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112ad9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f112c14d350 0x7f112c163b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.191 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112ad9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f112c14d350 0x7f112c163b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:59512/0 (socket says 172.21.15.183:59512) 2023-10-18T17:23:46.191 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f1129d9b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f112c0bfc10 0x7f112c1479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.191 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112ad9d700 1 -- 172.21.15.183:0/1673902878 learned_addr learned my addr 172.21.15.183:0/1673902878 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-18T17:23:46.192 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112a59c700 1 --2- 172.21.15.183:0/1673902878 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f112c068e00 0x7f112c0bd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.192 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112ad9d700 1 -- 172.21.15.183:0/1673902878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f112c0bfc10 msgr2=0x7f112c1479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.192 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112ad9d700 1 --2- 172.21.15.183:0/1673902878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f112c0bfc10 0x7f112c1479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.192 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112ad9d700 1 -- 172.21.15.183:0/1673902878 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f112c068e00 msgr2=0x7f112c0bd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.192 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112ad9d700 1 --2- 172.21.15.183:0/1673902878 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f112c068e00 0x7f112c0bd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.193 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112ad9d700 1 -- 172.21.15.183:0/1673902878 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1124009ae0 con 0x7f112c14d350 2023-10-18T17:23:46.193 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f1129d9b700 1 --2- 172.21.15.183:0/1673902878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f112c0bfc10 0x7f112c1479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:23:46.193 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112ad9d700 1 --2- 172.21.15.183:0/1673902878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f112c14d350 0x7f112c163b30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f1124009880 tx=0x7f112c14c900).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:46.193 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f111a7fc700 1 -- 172.21.15.183:0/1673902878 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11240092e0 con 0x7f112c14d350 2023-10-18T17:23:46.193 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f111a7fc700 1 -- 172.21.15.183:0/1673902878 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112401e470 con 0x7f112c14d350 2023-10-18T17:23:46.194 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112b59e700 1 -- 172.21.15.183:0/1673902878 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112c146060 con 0x7f112c14d350 2023-10-18T17:23:46.194 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f111a7fc700 1 -- 172.21.15.183:0/1673902878 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112401e830 con 0x7f112c14d350 2023-10-18T17:23:46.194 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f112b59e700 1 -- 172.21.15.183:0/1673902878 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112c163330 con 0x7f112c14d350 2023-10-18T17:23:46.194 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f111a7fc700 1 -- 172.21.15.183:0/1673902878 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f1124003040 con 0x7f112c14d350 2023-10-18T17:23:46.194 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.180+0000 7f111a7fc700 1 -- 172.21.15.183:0/1673902878 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f1124028800 con 0x7f112c14d350 2023-10-18T17:23:46.195 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.184+0000 7f112b59e700 1 -- 172.21.15.183:0/1673902878 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f112c046f00 con 0x7f112c14d350 2023-10-18T17:23:46.195 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.184+0000 7f111a7fc700 1 -- 172.21.15.183:0/1673902878 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f112402d060 con 0x7f112c14d350 2023-10-18T17:23:46.263 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.256+0000 7f112b59e700 1 -- 172.21.15.183:0/1673902878 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1f621b1e-5ea4-4dc3-80e1-c415c7cc97d0", "id": 0} v 0) v1 -- 0x7f112c1637e0 con 0x7f112c14d350 2023-10-18T17:23:46.270 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.264+0000 7f111a7fc700 1 -- 172.21.15.183:0/1673902878 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1f621b1e-5ea4-4dc3-80e1-c415c7cc97d0", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f11240360b0 con 0x7f112c14d350 2023-10-18T17:23:46.270 INFO:teuthology.orchestra.run.smithi183.stdout:0 2023-10-18T17:23:46.271 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.268+0000 7f112b59e700 1 -- 172.21.15.183:0/1673902878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f112c14d350 msgr2=0x7f112c163b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.272 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.268+0000 7f112b59e700 1 --2- 172.21.15.183:0/1673902878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f112c14d350 0x7f112c163b30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f1124009880 tx=0x7f112c14c900).stop 2023-10-18T17:23:46.272 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.268+0000 7f112b59e700 1 -- 172.21.15.183:0/1673902878 shutdown_connections 2023-10-18T17:23:46.272 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.268+0000 7f112b59e700 1 --2- 172.21.15.183:0/1673902878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f112c14d350 0x7f112c163b30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.272 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.268+0000 7f112b59e700 1 --2- 172.21.15.183:0/1673902878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f112c0bfc10 0x7f112c1479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.273 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.268+0000 7f112b59e700 1 --2- 172.21.15.183:0/1673902878 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f112c068e00 0x7f112c0bd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.273 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.268+0000 7f112b59e700 1 -- 172.21.15.183:0/1673902878 >> 172.21.15.183:0/1673902878 conn(0x7f112c05dc20 msgr2=0x7f112c066fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:46.273 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.268+0000 7f112b59e700 1 -- 172.21.15.183:0/1673902878 shutdown_connections 2023-10-18T17:23:46.273 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.268+0000 7f112b59e700 1 -- 172.21.15.183:0/1673902878 wait complete. 2023-10-18T17:23:46.283 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 769d7514-319f-4ac3-8cf3-6f88f4e7da2d 1 2023-10-18T17:23:46.386 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.379+0000 7fee8d8a4700 1 Processor -- start 2023-10-18T17:23:46.387 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.379+0000 7fee8d8a4700 1 -- start start 2023-10-18T17:23:46.388 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee8d8a4700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fee880b6aa0 0x7fee8814d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.388 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee8d8a4700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee8814d840 con 0x7fee880bfff0 2023-10-18T17:23:46.388 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee8d8a4700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee880667e0 con 0x7fee880bfc10 2023-10-18T17:23:46.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee8d8a4700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee88066b80 con 0x7fee880b6aa0 2023-10-18T17:23:46.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee8c8a2700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fee880bfc10 0x7fee88066fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:52306/0 (socket says 172.21.15.183:52306) 2023-10-18T17:23:46.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee8c8a2700 1 -- 172.21.15.183:0/4048050791 learned_addr learned my addr 172.21.15.183:0/4048050791 (peer_addr_for_me v1:172.21.15.183:0/0) 2023-10-18T17:23:46.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee877fe700 1 -- 172.21.15.183:0/4048050791 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841246251 0 0) 0x7fee880667e0 con 0x7fee880bfc10 2023-10-18T17:23:46.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee8d0a3700 1 --2- 172.21.15.183:0/4048050791 >> v2:172.21.15.158:3300/0 conn(0x7fee880b6aa0 0x7fee8814d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.390 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee877fe700 1 -- 172.21.15.183:0/4048050791 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee700033f0 con 0x7fee880bfc10 2023-10-18T17:23:46.392 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee877fe700 1 -- 172.21.15.183:0/4048050791 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2305107696 0 0) 0x7fee700033f0 con 0x7fee880bfc10 2023-10-18T17:23:46.393 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee877fe700 1 -- 172.21.15.183:0/4048050791 >> v2:172.21.15.158:3300/0 conn(0x7fee880b6aa0 msgr2=0x7fee8814d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:46.393 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee877fe700 1 --2- 172.21.15.183:0/4048050791 >> v2:172.21.15.158:3300/0 conn(0x7fee880b6aa0 0x7fee8814d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.393 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee877fe700 1 -- 172.21.15.183:0/4048050791 >> v1:172.21.15.158:6789/0 conn(0x7fee880bfff0 legacy=0x7fee880b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.393 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee877fe700 1 -- 172.21.15.183:0/4048050791 --> v1:172.21.15.183:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee88069590 con 0x7fee880bfc10 2023-10-18T17:23:46.393 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee877fe700 1 -- 172.21.15.183:0/4048050791 <== mon.1 v1:172.21.15.183:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2074596555 0 0) 0x7fee80001970 con 0x7fee880bfc10 2023-10-18T17:23:46.394 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee877fe700 1 -- 172.21.15.183:0/4048050791 >> v1:172.21.15.183:6789/0 conn(0x7fee880bfc10 legacy=0x7fee88066fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.394 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee877fe700 1 --2- 172.21.15.183:0/4048050791 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee700038e0 0x7fee70003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.394 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee877fe700 1 --2- 172.21.15.183:0/4048050791 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee70004690 0x7fee70004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.394 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee877fe700 1 --2- 172.21.15.183:0/4048050791 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee70005000 0x7fee7000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.395 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee877fe700 1 -- 172.21.15.183:0/4048050791 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee88066b80 con 0x7fee70005000 2023-10-18T17:23:46.395 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee877fe700 1 -- 172.21.15.183:0/4048050791 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7000beb0 con 0x7fee700038e0 2023-10-18T17:23:46.395 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee8c8a2700 1 --2- 172.21.15.183:0/4048050791 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee700038e0 0x7fee70003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.395 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee877fe700 1 -- 172.21.15.183:0/4048050791 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7000c070 con 0x7fee70004690 2023-10-18T17:23:46.395 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee87fff700 1 --2- 172.21.15.183:0/4048050791 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee70004690 0x7fee70004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.396 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee8d0a3700 1 --2- 172.21.15.183:0/4048050791 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee70005000 0x7fee7000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.396 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee8c8a2700 1 -- 172.21.15.183:0/4048050791 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee70004690 msgr2=0x7fee70004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:46.396 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee8c8a2700 1 --2- 172.21.15.183:0/4048050791 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee70004690 0x7fee70004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.396 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee8c8a2700 1 -- 172.21.15.183:0/4048050791 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee70005000 msgr2=0x7fee7000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:46.396 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee8c8a2700 1 --2- 172.21.15.183:0/4048050791 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee70005000 0x7fee7000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.397 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee8c8a2700 1 -- 172.21.15.183:0/4048050791 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee700033f0 con 0x7fee700038e0 2023-10-18T17:23:46.397 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee8d0a3700 1 --2- 172.21.15.183:0/4048050791 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee70005000 0x7fee7000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T17:23:46.397 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee87fff700 1 --2- 172.21.15.183:0/4048050791 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee70004690 0x7fee70004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:23:46.397 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee8d0a3700 1 -- 172.21.15.183:0/4048050791 reap_dead start 2023-10-18T17:23:46.397 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee8c8a2700 1 --2- 172.21.15.183:0/4048050791 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee700038e0 0x7fee70003d00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fee8000c5f0 tx=0x7fee880bde20).ready entity=mon.1 client_cookie=302027825d83e7e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:46.397 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee877fe700 1 -- 172.21.15.183:0/4048050791 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8000cdf0 con 0x7fee700038e0 2023-10-18T17:23:46.398 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee877fe700 1 -- 172.21.15.183:0/4048050791 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee800059f0 con 0x7fee700038e0 2023-10-18T17:23:46.398 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee877fe700 1 -- 172.21.15.183:0/4048050791 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee80005d70 con 0x7fee700038e0 2023-10-18T17:23:46.398 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee8d8a4700 1 -- 172.21.15.183:0/4048050791 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee700038e0 msgr2=0x7fee70003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.398 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.383+0000 7fee8d8a4700 1 --2- 172.21.15.183:0/4048050791 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee700038e0 0x7fee70003d00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fee8000c5f0 tx=0x7fee880bde20).stop 2023-10-18T17:23:46.398 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.387+0000 7fee8d8a4700 1 -- 172.21.15.183:0/4048050791 shutdown_connections 2023-10-18T17:23:46.399 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.387+0000 7fee8d8a4700 1 --2- 172.21.15.183:0/4048050791 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee700038e0 0x7fee70003d00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.399 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.387+0000 7fee8d8a4700 1 -- 172.21.15.183:0/4048050791 >> 172.21.15.183:0/4048050791 conn(0x7fee8805dc20 msgr2=0x7fee8805e000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:46.399 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.387+0000 7fee8d8a4700 1 -- 172.21.15.183:0/4048050791 shutdown_connections 2023-10-18T17:23:46.399 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.387+0000 7fee8d8a4700 1 -- 172.21.15.183:0/4048050791 wait complete. 2023-10-18T17:23:46.401 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.387+0000 7fee8d8a4700 1 Processor -- start 2023-10-18T17:23:46.401 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.387+0000 7fee8d8a4700 1 -- start start 2023-10-18T17:23:46.402 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.387+0000 7fee8d8a4700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee700038e0 0x7fee8813f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.402 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.387+0000 7fee8d8a4700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee880be0f0 0x7fee88149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.402 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.387+0000 7fee8d8a4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee88149f50 0x7fee880b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.402 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.387+0000 7fee8d8a4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8813e8e0 con 0x7fee88149f50 2023-10-18T17:23:46.402 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.387+0000 7fee8d8a4700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee881642e0 con 0x7fee880be0f0 2023-10-18T17:23:46.403 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.387+0000 7fee8d8a4700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee881636f0 con 0x7fee700038e0 2023-10-18T17:23:46.403 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.387+0000 7fee8c8a2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee700038e0 0x7fee8813f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.403 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.387+0000 7fee87fff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee880be0f0 0x7fee88149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.403 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.387+0000 7fee8c8a2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee700038e0 0x7fee8813f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:59530/0 (socket says 172.21.15.183:59530) 2023-10-18T17:23:46.403 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.387+0000 7fee8c8a2700 1 -- 172.21.15.183:0/1945999982 learned_addr learned my addr 172.21.15.183:0/1945999982 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-18T17:23:46.403 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.391+0000 7fee8d0a3700 1 --2- 172.21.15.183:0/1945999982 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee88149f50 0x7fee880b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.404 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.391+0000 7fee8c8a2700 1 -- 172.21.15.183:0/1945999982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee880be0f0 msgr2=0x7fee88149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.404 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.391+0000 7fee8c8a2700 1 --2- 172.21.15.183:0/1945999982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee880be0f0 0x7fee88149a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.404 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.391+0000 7fee8c8a2700 1 -- 172.21.15.183:0/1945999982 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee88149f50 msgr2=0x7fee880b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.404 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.391+0000 7fee8c8a2700 1 --2- 172.21.15.183:0/1945999982 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee88149f50 0x7fee880b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.404 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.391+0000 7fee8c8a2700 1 -- 172.21.15.183:0/1945999982 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee881639b0 con 0x7fee700038e0 2023-10-18T17:23:46.405 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.391+0000 7fee8c8a2700 1 --2- 172.21.15.183:0/1945999982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee700038e0 0x7fee8813f990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fee7000c040 tx=0x7fee80015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:46.405 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.391+0000 7fee84ff9700 1 -- 172.21.15.183:0/1945999982 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee80001ca0 con 0x7fee700038e0 2023-10-18T17:23:46.405 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.391+0000 7fee84ff9700 1 -- 172.21.15.183:0/1945999982 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee800072e0 con 0x7fee700038e0 2023-10-18T17:23:46.405 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.391+0000 7fee84ff9700 1 -- 172.21.15.183:0/1945999982 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee80007660 con 0x7fee700038e0 2023-10-18T17:23:46.405 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.391+0000 7fee8d8a4700 1 -- 172.21.15.183:0/1945999982 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee88163c90 con 0x7fee700038e0 2023-10-18T17:23:46.405 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.391+0000 7fee8d8a4700 1 -- 172.21.15.183:0/1945999982 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee88067440 con 0x7fee700038e0 2023-10-18T17:23:46.406 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.391+0000 7fee84ff9700 1 -- 172.21.15.183:0/1945999982 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fee8001c020 con 0x7fee700038e0 2023-10-18T17:23:46.406 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.391+0000 7fee84ff9700 1 -- 172.21.15.183:0/1945999982 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7fee80007e40 con 0x7fee700038e0 2023-10-18T17:23:46.406 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.391+0000 7fee8d8a4700 1 -- 172.21.15.183:0/1945999982 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee88046f00 con 0x7fee700038e0 2023-10-18T17:23:46.406 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.395+0000 7fee84ff9700 1 -- 172.21.15.183:0/1945999982 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fee8003ee50 con 0x7fee700038e0 2023-10-18T17:23:46.469 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:46.463+0000 7fa69eb27500 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-18T17:23:46.473 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.467+0000 7fee8d8a4700 1 -- 172.21.15.183:0/1945999982 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "769d7514-319f-4ac3-8cf3-6f88f4e7da2d", "id": 1} v 0) v1 -- 0x7fee88069870 con 0x7fee700038e0 2023-10-18T17:23:46.478 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.471+0000 7fee84ff9700 1 -- 172.21.15.183:0/1945999982 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "769d7514-319f-4ac3-8cf3-6f88f4e7da2d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fee8002d070 con 0x7fee700038e0 2023-10-18T17:23:46.479 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-10-18T17:23:46.480 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.475+0000 7fee8d8a4700 1 -- 172.21.15.183:0/1945999982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee700038e0 msgr2=0x7fee8813f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.481 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.475+0000 7fee8d8a4700 1 --2- 172.21.15.183:0/1945999982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee700038e0 0x7fee8813f990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fee7000c040 tx=0x7fee80015000).stop 2023-10-18T17:23:46.481 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.475+0000 7fee8d8a4700 1 -- 172.21.15.183:0/1945999982 shutdown_connections 2023-10-18T17:23:46.481 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.475+0000 7fee8d8a4700 1 --2- 172.21.15.183:0/1945999982 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee88149f50 0x7fee880b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.481 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.475+0000 7fee8d8a4700 1 --2- 172.21.15.183:0/1945999982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee880be0f0 0x7fee88149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.481 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.475+0000 7fee8d8a4700 1 --2- 172.21.15.183:0/1945999982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee700038e0 0x7fee8813f990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.482 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.475+0000 7fee8d8a4700 1 -- 172.21.15.183:0/1945999982 >> 172.21.15.183:0/1945999982 conn(0x7fee8805dc20 msgr2=0x7fee88141f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:46.482 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.475+0000 7fee8d8a4700 1 -- 172.21.15.183:0/1945999982 shutdown_connections 2023-10-18T17:23:46.482 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.475+0000 7fee8d8a4700 1 -- 172.21.15.183:0/1945999982 wait complete. 2023-10-18T17:23:46.494 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new b4459762-309d-454c-bd31-33b90192375f 2 2023-10-18T17:23:46.597 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.591+0000 7ff9eea73700 1 Processor -- start 2023-10-18T17:23:46.597 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.591+0000 7ff9eea73700 1 -- start start 2023-10-18T17:23:46.599 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.591+0000 7ff9eea73700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff9e8069b00 0x7ff9e80b6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.599 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.591+0000 7ff9eea73700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e80bd9e0 con 0x7ff9e8153b80 2023-10-18T17:23:46.599 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.591+0000 7ff9eea73700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e8153ff0 con 0x7ff9e80b6560 2023-10-18T17:23:46.599 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.591+0000 7ff9eea73700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e8069190 con 0x7ff9e8069b00 2023-10-18T17:23:46.600 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.591+0000 7ff9ed270700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff9e8069b00 0x7ff9e80b6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.600 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.591+0000 7ff9eda71700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7ff9e80b6560 0x7ff9e80bfa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:52324/0 (socket says 172.21.15.183:52324) 2023-10-18T17:23:46.600 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.591+0000 7ff9eda71700 1 -- 172.21.15.183:0/2099801438 learned_addr learned my addr 172.21.15.183:0/2099801438 (peer_addr_for_me v1:172.21.15.183:0/0) 2023-10-18T17:23:46.600 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.591+0000 7ff9ed270700 1 -- 172.21.15.183:0/2099801438 >> v1:172.21.15.183:6789/0 conn(0x7ff9e80b6560 legacy=0x7ff9e80bfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.600 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.591+0000 7ff9ed270700 1 -- 172.21.15.183:0/2099801438 >> v1:172.21.15.158:6789/0 conn(0x7ff9e8153b80 legacy=0x7ff9e8150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:46.601 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.591+0000 7ff9eca6f700 1 -- 172.21.15.183:0/2099801438 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101829740 0 0) 0x7ff9e8153ff0 con 0x7ff9e80b6560 2023-10-18T17:23:46.601 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.591+0000 7ff9ed270700 1 -- 172.21.15.183:0/2099801438 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e8069470 con 0x7ff9e8069b00 2023-10-18T17:23:46.601 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.591+0000 7ff9ed270700 1 --2- 172.21.15.183:0/2099801438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e8069b00 0x7ff9e80b6940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7ff9d8009760 tx=0x7ff9d8009060).ready entity=mon.1 client_cookie=82821f28cf910c9e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:46.601 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.591+0000 7ff9eca6f700 1 -- 172.21.15.183:0/2099801438 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d800b5b0 con 0x7ff9e8069b00 2023-10-18T17:23:46.601 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.591+0000 7ff9eca6f700 1 -- 172.21.15.183:0/2099801438 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d800b710 con 0x7ff9e8069b00 2023-10-18T17:23:46.602 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.591+0000 7ff9eca6f700 1 -- 172.21.15.183:0/2099801438 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d800ba90 con 0x7ff9e8069b00 2023-10-18T17:23:46.604 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eea73700 1 -- 172.21.15.183:0/2099801438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e8069b00 msgr2=0x7ff9e80b6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.604 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eea73700 1 --2- 172.21.15.183:0/2099801438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e8069b00 0x7ff9e80b6940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7ff9d8009760 tx=0x7ff9d8009060).stop 2023-10-18T17:23:46.605 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eea73700 1 -- 172.21.15.183:0/2099801438 shutdown_connections 2023-10-18T17:23:46.605 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eea73700 1 --2- 172.21.15.183:0/2099801438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e8069b00 0x7ff9e80b6940 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.605 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eea73700 1 -- 172.21.15.183:0/2099801438 >> 172.21.15.183:0/2099801438 conn(0x7ff9e805dc20 msgr2=0x7ff9e805e000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:46.605 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eea73700 1 -- 172.21.15.183:0/2099801438 shutdown_connections 2023-10-18T17:23:46.605 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eea73700 1 -- 172.21.15.183:0/2099801438 wait complete. 2023-10-18T17:23:46.606 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eea73700 1 Processor -- start 2023-10-18T17:23:46.606 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eea73700 1 -- start start 2023-10-18T17:23:46.606 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eea73700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9e8069b00 0x7ff9e80c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.606 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eea73700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e80b6560 0x7ff9e80b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.606 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eea73700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff9e8153b80 0x7ff9e80c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.607 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eea73700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e8163320 con 0x7ff9e8153b80 2023-10-18T17:23:46.607 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eea73700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e8163ea0 con 0x7ff9e80b6560 2023-10-18T17:23:46.607 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eea73700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e80c1c90 con 0x7ff9e8069b00 2023-10-18T17:23:46.607 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eda71700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9e8069b00 0x7ff9e80c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.607 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9ed270700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e80b6560 0x7ff9e80b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.608 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eda71700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9e8069b00 0x7ff9e80c1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:59542/0 (socket says 172.21.15.183:59542) 2023-10-18T17:23:46.608 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eda71700 1 -- 172.21.15.183:0/1276407263 learned_addr learned my addr 172.21.15.183:0/1276407263 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-18T17:23:46.608 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9ee272700 1 --2- 172.21.15.183:0/1276407263 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff9e8153b80 0x7ff9e80c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.608 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eda71700 1 -- 172.21.15.183:0/1276407263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e80b6560 msgr2=0x7ff9e80b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.608 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.595+0000 7ff9eda71700 1 --2- 172.21.15.183:0/1276407263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e80b6560 0x7ff9e80b34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.609 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.599+0000 7ff9eda71700 1 -- 172.21.15.183:0/1276407263 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff9e8153b80 msgr2=0x7ff9e80c2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.609 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.599+0000 7ff9eda71700 1 --2- 172.21.15.183:0/1276407263 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff9e8153b80 0x7ff9e80c2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.609 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.599+0000 7ff9eda71700 1 -- 172.21.15.183:0/1276407263 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d80092a0 con 0x7ff9e8069b00 2023-10-18T17:23:46.609 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.599+0000 7ff9ee272700 1 --2- 172.21.15.183:0/1276407263 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff9e8153b80 0x7ff9e80c2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T17:23:46.609 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.599+0000 7ff9ed270700 1 --2- 172.21.15.183:0/1276407263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e80b6560 0x7ff9e80b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:23:46.610 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.599+0000 7ff9eda71700 1 --2- 172.21.15.183:0/1276407263 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9e8069b00 0x7ff9e80c1600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff9e400c4e0 tx=0x7ff9e4007b00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:46.610 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.599+0000 7ff9ddffb700 1 -- 172.21.15.183:0/1276407263 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e400cea0 con 0x7ff9e8069b00 2023-10-18T17:23:46.610 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.599+0000 7ff9ddffb700 1 -- 172.21.15.183:0/1276407263 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e40072e0 con 0x7ff9e8069b00 2023-10-18T17:23:46.610 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.599+0000 7ff9eea73700 1 -- 172.21.15.183:0/1276407263 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e8163570 con 0x7ff9e8069b00 2023-10-18T17:23:46.610 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.599+0000 7ff9ddffb700 1 -- 172.21.15.183:0/1276407263 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4005670 con 0x7ff9e8069b00 2023-10-18T17:23:46.611 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.599+0000 7ff9eea73700 1 -- 172.21.15.183:0/1276407263 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e8163b30 con 0x7ff9e8069b00 2023-10-18T17:23:46.611 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.599+0000 7ff9ddffb700 1 -- 172.21.15.183:0/1276407263 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ff9e4005d00 con 0x7ff9e8069b00 2023-10-18T17:23:46.611 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.599+0000 7ff9ddffb700 1 -- 172.21.15.183:0/1276407263 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7ff9e4013df0 con 0x7ff9e8069b00 2023-10-18T17:23:46.611 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.599+0000 7ff9eea73700 1 -- 172.21.15.183:0/1276407263 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e8046f00 con 0x7ff9e8069b00 2023-10-18T17:23:46.612 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.603+0000 7ff9ddffb700 1 -- 172.21.15.183:0/1276407263 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7ff9e4018070 con 0x7ff9e8069b00 2023-10-18T17:23:46.670 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:46.662+0000 7f45f5d5b500 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-18T17:23:46.683 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.675+0000 7ff9eea73700 1 -- 172.21.15.183:0/1276407263 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b4459762-309d-454c-bd31-33b90192375f", "id": 2} v 0) v1 -- 0x7ff9e80bdc30 con 0x7ff9e8069b00 2023-10-18T17:23:46.693 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.687+0000 7ff9ddffb700 1 -- 172.21.15.183:0/1276407263 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b4459762-309d-454c-bd31-33b90192375f", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff9e4013450 con 0x7ff9e8069b00 2023-10-18T17:23:46.693 INFO:teuthology.orchestra.run.smithi183.stdout:2 2023-10-18T17:23:46.695 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.687+0000 7ff9eea73700 1 -- 172.21.15.183:0/1276407263 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9e8069b00 msgr2=0x7ff9e80c1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.696 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.687+0000 7ff9eea73700 1 --2- 172.21.15.183:0/1276407263 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9e8069b00 0x7ff9e80c1600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff9e400c4e0 tx=0x7ff9e4007b00).stop 2023-10-18T17:23:46.696 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.691+0000 7ff9eea73700 1 -- 172.21.15.183:0/1276407263 shutdown_connections 2023-10-18T17:23:46.696 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.691+0000 7ff9eea73700 1 --2- 172.21.15.183:0/1276407263 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff9e8153b80 0x7ff9e80c2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.696 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.691+0000 7ff9eea73700 1 --2- 172.21.15.183:0/1276407263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e80b6560 0x7ff9e80b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.697 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.691+0000 7ff9eea73700 1 --2- 172.21.15.183:0/1276407263 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9e8069b00 0x7ff9e80c1600 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.697 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.691+0000 7ff9eea73700 1 -- 172.21.15.183:0/1276407263 >> 172.21.15.183:0/1276407263 conn(0x7ff9e805dc20 msgr2=0x7ff9e814f430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:46.697 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.691+0000 7ff9eea73700 1 -- 172.21.15.183:0/1276407263 shutdown_connections 2023-10-18T17:23:46.697 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.691+0000 7ff9eea73700 1 -- 172.21.15.183:0/1276407263 wait complete. 2023-10-18T17:23:46.711 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 7b78a411-1ae9-4051-ae9d-a03abc5a73ae 3 2023-10-18T17:23:46.817 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.811+0000 7ff79f292700 1 Processor -- start 2023-10-18T17:23:46.818 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.811+0000 7ff79f292700 1 -- start start 2023-10-18T17:23:46.822 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.811+0000 7ff79f292700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff798146640 0x7ff7980be4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.822 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.811+0000 7ff79f292700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff798146a20 0x7ff79814ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.822 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.811+0000 7ff79f292700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7980689c0 con 0x7ff79806a1e0 2023-10-18T17:23:46.823 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.811+0000 7ff79f292700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff79805e330 con 0x7ff798146a20 2023-10-18T17:23:46.823 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.811+0000 7ff79f292700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7980bd700 con 0x7ff798146640 2023-10-18T17:23:46.823 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.811+0000 7ff79d02e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff798146640 0x7ff7980be4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.823 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.811+0000 7ff79d82f700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7ff79806a1e0 0x7ff79805dc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:52340/0 (socket says 172.21.15.183:52340) 2023-10-18T17:23:46.823 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.811+0000 7ff79d82f700 1 -- 172.21.15.183:0/1154562605 learned_addr learned my addr 172.21.15.183:0/1154562605 (peer_addr_for_me v1:172.21.15.183:0/0) 2023-10-18T17:23:46.824 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff78ffff700 1 -- 172.21.15.183:0/1154562605 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799841071 0 0) 0x7ff7980689c0 con 0x7ff79806a1e0 2023-10-18T17:23:46.824 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff78ffff700 1 -- 172.21.15.183:0/1154562605 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7840033f0 con 0x7ff79806a1e0 2023-10-18T17:23:46.824 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff79c82d700 1 --2- 172.21.15.183:0/1154562605 >> v2:172.21.15.158:3300/0 conn(0x7ff798146a20 0x7ff79814ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.824 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff79d02e700 1 -- 172.21.15.183:0/1154562605 >> v2:172.21.15.158:3300/0 conn(0x7ff798146a20 msgr2=0x7ff79814ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:46.824 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff79d02e700 1 --2- 172.21.15.183:0/1154562605 >> v2:172.21.15.158:3300/0 conn(0x7ff798146a20 0x7ff79814ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.825 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff79d02e700 1 -- 172.21.15.183:0/1154562605 >> v1:172.21.15.183:6789/0 conn(0x7ff79806a1e0 legacy=0x7ff79805dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.825 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff79d02e700 1 -- 172.21.15.183:0/1154562605 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7980bd9e0 con 0x7ff798146640 2023-10-18T17:23:46.825 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff79d02e700 1 --2- 172.21.15.183:0/1154562605 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff798146640 0x7ff7980be4c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7ff798063c00 tx=0x7ff794009060).ready entity=mon.1 client_cookie=9d59cc886fa165e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:46.825 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff78ffff700 1 -- 172.21.15.183:0/1154562605 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79400f510 con 0x7ff798146640 2023-10-18T17:23:46.825 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff78ffff700 1 -- 172.21.15.183:0/1154562605 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79400f670 con 0x7ff798146640 2023-10-18T17:23:46.826 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff78ffff700 1 -- 172.21.15.183:0/1154562605 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79400f9f0 con 0x7ff798146640 2023-10-18T17:23:46.826 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff79f292700 1 -- 172.21.15.183:0/1154562605 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff798146640 msgr2=0x7ff7980be4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.826 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff79f292700 1 --2- 172.21.15.183:0/1154562605 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff798146640 0x7ff7980be4c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7ff798063c00 tx=0x7ff794009060).stop 2023-10-18T17:23:46.826 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff79f292700 1 -- 172.21.15.183:0/1154562605 shutdown_connections 2023-10-18T17:23:46.826 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff79f292700 1 --2- 172.21.15.183:0/1154562605 >> v2:172.21.15.158:3300/0 conn(0x7ff798146a20 0x7ff79814ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.827 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff79f292700 1 --2- 172.21.15.183:0/1154562605 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff798146640 0x7ff7980be4c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.827 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff79f292700 1 -- 172.21.15.183:0/1154562605 >> 172.21.15.183:0/1154562605 conn(0x7ff7980c3450 msgr2=0x7ff7980bf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:46.827 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff79f292700 1 -- 172.21.15.183:0/1154562605 shutdown_connections 2023-10-18T17:23:46.827 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff79f292700 1 -- 172.21.15.183:0/1154562605 wait complete. 2023-10-18T17:23:46.829 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff79f292700 1 Processor -- start 2023-10-18T17:23:46.830 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.815+0000 7ff79f292700 1 -- start start 2023-10-18T17:23:46.830 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79f292700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff79806a1e0 0x7ff7980bd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.830 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79f292700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff798146640 0x7ff79814f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.830 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79f292700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff798146a20 0x7ff79814f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:46.830 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79f292700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79814fe90 con 0x7ff798146a20 2023-10-18T17:23:46.831 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79f292700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79814ea40 con 0x7ff79806a1e0 2023-10-18T17:23:46.831 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79f292700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79815cc50 con 0x7ff798146640 2023-10-18T17:23:46.831 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79d02e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff79806a1e0 0x7ff7980bd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.831 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79c82d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff798146640 0x7ff79814f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.831 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79c82d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff798146640 0x7ff79814f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:59556/0 (socket says 172.21.15.183:59556) 2023-10-18T17:23:46.832 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79d02e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff79806a1e0 0x7ff7980bd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:33274/0 (socket says 172.21.15.183:33274) 2023-10-18T17:23:46.832 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79c82d700 1 -- 172.21.15.183:0/4192919565 learned_addr learned my addr 172.21.15.183:0/4192919565 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-18T17:23:46.832 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79d82f700 1 --2- 172.21.15.183:0/4192919565 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff798146a20 0x7ff79814f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:46.832 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79c82d700 1 -- 172.21.15.183:0/4192919565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff79806a1e0 msgr2=0x7ff7980bd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.832 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79c82d700 1 --2- 172.21.15.183:0/4192919565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff79806a1e0 0x7ff7980bd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.833 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79c82d700 1 -- 172.21.15.183:0/4192919565 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff798146a20 msgr2=0x7ff79814f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.833 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79c82d700 1 --2- 172.21.15.183:0/4192919565 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff798146a20 0x7ff79814f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.833 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79c82d700 1 -- 172.21.15.183:0/4192919565 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7940092a0 con 0x7ff798146640 2023-10-18T17:23:46.833 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79c82d700 1 --2- 172.21.15.183:0/4192919565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff798146640 0x7ff79814f4b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff78800c880 tx=0x7ff788008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:46.834 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff78d7fa700 1 -- 172.21.15.183:0/4192919565 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788010580 con 0x7ff798146640 2023-10-18T17:23:46.834 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff78d7fa700 1 -- 172.21.15.183:0/4192919565 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7880106e0 con 0x7ff798146640 2023-10-18T17:23:46.834 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff78d7fa700 1 -- 172.21.15.183:0/4192919565 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788010a60 con 0x7ff798146640 2023-10-18T17:23:46.834 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79f292700 1 -- 172.21.15.183:0/4192919565 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7980bc8e0 con 0x7ff798146640 2023-10-18T17:23:46.834 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79f292700 1 -- 172.21.15.183:0/4192919565 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff79814ecb0 con 0x7ff798146640 2023-10-18T17:23:46.835 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff78d7fa700 1 -- 172.21.15.183:0/4192919565 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ff78801b460 con 0x7ff798146640 2023-10-18T17:23:46.835 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff78d7fa700 1 -- 172.21.15.183:0/4192919565 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7ff788011410 con 0x7ff798146640 2023-10-18T17:23:46.835 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.819+0000 7ff79f292700 1 -- 172.21.15.183:0/4192919565 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff79806c190 con 0x7ff798146640 2023-10-18T17:23:46.835 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.823+0000 7ff78d7fa700 1 -- 172.21.15.183:0/4192919565 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7ff78801b710 con 0x7ff798146640 2023-10-18T17:23:46.902 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.895+0000 7ff79f292700 1 -- 172.21.15.183:0/4192919565 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7b78a411-1ae9-4051-ae9d-a03abc5a73ae", "id": 3} v 0) v1 -- 0x7ff798068f70 con 0x7ff798146640 2023-10-18T17:23:46.913 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.907+0000 7ff78d7fa700 1 -- 172.21.15.183:0/4192919565 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7b78a411-1ae9-4051-ae9d-a03abc5a73ae", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff78802a0b0 con 0x7ff798146640 2023-10-18T17:23:46.913 INFO:teuthology.orchestra.run.smithi183.stdout:3 2023-10-18T17:23:46.915 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.907+0000 7ff79f292700 1 -- 172.21.15.183:0/4192919565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff798146640 msgr2=0x7ff79814f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:46.915 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.907+0000 7ff79f292700 1 --2- 172.21.15.183:0/4192919565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff798146640 0x7ff79814f4b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff78800c880 tx=0x7ff788008040).stop 2023-10-18T17:23:46.916 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.907+0000 7ff79f292700 1 -- 172.21.15.183:0/4192919565 shutdown_connections 2023-10-18T17:23:46.916 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.911+0000 7ff79f292700 1 --2- 172.21.15.183:0/4192919565 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff798146a20 0x7ff79814f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.916 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.911+0000 7ff79f292700 1 --2- 172.21.15.183:0/4192919565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff798146640 0x7ff79814f4b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.916 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.911+0000 7ff79f292700 1 --2- 172.21.15.183:0/4192919565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff79806a1e0 0x7ff7980bd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:46.917 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.911+0000 7ff79f292700 1 -- 172.21.15.183:0/4192919565 >> 172.21.15.183:0/4192919565 conn(0x7ff7980c3450 msgr2=0x7ff7981453e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:46.917 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.911+0000 7ff79f292700 1 -- 172.21.15.183:0/4192919565 shutdown_connections 2023-10-18T17:23:46.917 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:46.911+0000 7ff79f292700 1 -- 172.21.15.183:0/4192919565 wait complete. 2023-10-18T17:23:46.927 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 58005b5f-2742-4ecb-8c3a-a2ae65c7fb99 4 2023-10-18T17:23:47.029 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.023+0000 7f0ed89d6700 1 Processor -- start 2023-10-18T17:23:47.029 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.023+0000 7f0ed89d6700 1 -- start start 2023-10-18T17:23:47.030 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.023+0000 7f0ed89d6700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0ed414b3b0 0x7f0ed4062160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.031 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.023+0000 7f0ed89d6700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed4069160 con 0x7f0ed40688e0 2023-10-18T17:23:47.031 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.023+0000 7f0ed89d6700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed414b790 con 0x7f0ed4068d20 2023-10-18T17:23:47.031 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.023+0000 7f0ed89d6700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed4069390 con 0x7f0ed414b3b0 2023-10-18T17:23:47.031 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.023+0000 7f0ed37fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0ed414b3b0 0x7f0ed4062160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.031 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.023+0000 7f0ed3fff700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f0ed4068d20 0x7f0ed4151700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:52350/0 (socket says 172.21.15.183:52350) 2023-10-18T17:23:47.032 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.023+0000 7f0ed3fff700 1 -- 172.21.15.183:0/4201710692 learned_addr learned my addr 172.21.15.183:0/4201710692 (peer_addr_for_me v1:172.21.15.183:0/0) 2023-10-18T17:23:47.033 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.023+0000 7f0ed37fe700 1 -- 172.21.15.183:0/4201710692 >> v1:172.21.15.183:6789/0 conn(0x7f0ed4068d20 legacy=0x7f0ed4151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.033 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.023+0000 7f0ed27fc700 1 -- 172.21.15.183:0/4201710692 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501249929 0 0) 0x7f0ed414b790 con 0x7f0ed4068d20 2023-10-18T17:23:47.034 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.023+0000 7f0ed37fe700 1 -- 172.21.15.183:0/4201710692 >> v1:172.21.15.158:6789/0 conn(0x7f0ed40688e0 legacy=0x7f0ed40bc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:47.034 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.023+0000 7f0ed37fe700 1 -- 172.21.15.183:0/4201710692 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed40be810 con 0x7f0ed414b3b0 2023-10-18T17:23:47.034 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.027+0000 7f0ed37fe700 1 --2- 172.21.15.183:0/4201710692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ed414b3b0 0x7f0ed4062160 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f0ec4009e60 tx=0x7f0ec4009780).ready entity=mon.1 client_cookie=9718be01d664591c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:47.034 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.027+0000 7f0ed27fc700 1 -- 172.21.15.183:0/4201710692 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec400e070 con 0x7f0ed414b3b0 2023-10-18T17:23:47.034 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.027+0000 7f0ed27fc700 1 -- 172.21.15.183:0/4201710692 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec400bc80 con 0x7f0ed414b3b0 2023-10-18T17:23:47.035 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.027+0000 7f0ed27fc700 1 -- 172.21.15.183:0/4201710692 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4012410 con 0x7f0ed414b3b0 2023-10-18T17:23:47.035 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.027+0000 7f0ed89d6700 1 -- 172.21.15.183:0/4201710692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ed414b3b0 msgr2=0x7f0ed4062160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.035 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.027+0000 7f0ed89d6700 1 --2- 172.21.15.183:0/4201710692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ed414b3b0 0x7f0ed4062160 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f0ec4009e60 tx=0x7f0ec4009780).stop 2023-10-18T17:23:47.035 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.027+0000 7f0ed89d6700 1 -- 172.21.15.183:0/4201710692 shutdown_connections 2023-10-18T17:23:47.035 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.027+0000 7f0ed89d6700 1 --2- 172.21.15.183:0/4201710692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ed414b3b0 0x7f0ed4062160 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.036 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.027+0000 7f0ed89d6700 1 -- 172.21.15.183:0/4201710692 >> 172.21.15.183:0/4201710692 conn(0x7f0ed40c2a50 msgr2=0x7f0ed40c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:47.036 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.027+0000 7f0ed89d6700 1 -- 172.21.15.183:0/4201710692 shutdown_connections 2023-10-18T17:23:47.036 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.027+0000 7f0ed89d6700 1 -- 172.21.15.183:0/4201710692 wait complete. 2023-10-18T17:23:47.038 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.027+0000 7f0ed89d6700 1 Processor -- start 2023-10-18T17:23:47.038 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.027+0000 7f0ed89d6700 1 -- start start 2023-10-18T17:23:47.039 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed89d6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ed40688e0 0x7f0ed4145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.039 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed89d6700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ed4068d20 0x7f0ed4146230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.039 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed89d6700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ed414b3b0 0x7f0ed414e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.039 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed89d6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed4151130 con 0x7f0ed40688e0 2023-10-18T17:23:47.039 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed89d6700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed4148a70 con 0x7f0ed4068d20 2023-10-18T17:23:47.039 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed89d6700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed4150920 con 0x7f0ed414b3b0 2023-10-18T17:23:47.040 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed3fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ed414b3b0 0x7f0ed414e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.040 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed2ffd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ed4068d20 0x7f0ed4146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.040 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed3fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ed414b3b0 0x7f0ed414e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:59570/0 (socket says 172.21.15.183:59570) 2023-10-18T17:23:47.040 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed3fff700 1 -- 172.21.15.183:0/282849710 learned_addr learned my addr 172.21.15.183:0/282849710 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-18T17:23:47.040 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed3fff700 1 -- 172.21.15.183:0/282849710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ed4068d20 msgr2=0x7f0ed4146230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.040 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed3fff700 1 --2- 172.21.15.183:0/282849710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ed4068d20 0x7f0ed4146230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.041 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed37fe700 1 --2- 172.21.15.183:0/282849710 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ed40688e0 0x7f0ed4145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.041 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed3fff700 1 -- 172.21.15.183:0/282849710 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ed40688e0 msgr2=0x7f0ed4145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.041 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed3fff700 1 --2- 172.21.15.183:0/282849710 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ed40688e0 0x7f0ed4145d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.041 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed3fff700 1 -- 172.21.15.183:0/282849710 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec4009a20 con 0x7f0ed414b3b0 2023-10-18T17:23:47.041 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed3fff700 1 --2- 172.21.15.183:0/282849710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ed414b3b0 0x7f0ed414e050 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f0ecc00c490 tx=0x7f0ecc007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:47.042 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ecb7fe700 1 -- 172.21.15.183:0/282849710 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc0072e0 con 0x7f0ed414b3b0 2023-10-18T17:23:47.042 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ecb7fe700 1 -- 172.21.15.183:0/282849710 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc007440 con 0x7f0ed414b3b0 2023-10-18T17:23:47.042 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ecb7fe700 1 -- 172.21.15.183:0/282849710 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc0057a0 con 0x7f0ed414b3b0 2023-10-18T17:23:47.042 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed89d6700 1 -- 172.21.15.183:0/282849710 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed41458b0 con 0x7f0ed414b3b0 2023-10-18T17:23:47.043 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed89d6700 1 -- 172.21.15.183:0/282849710 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed4150b70 con 0x7f0ed414b3b0 2023-10-18T17:23:47.043 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ecb7fe700 1 -- 172.21.15.183:0/282849710 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f0ecc013450 con 0x7f0ed414b3b0 2023-10-18T17:23:47.043 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ecb7fe700 1 -- 172.21.15.183:0/282849710 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f0ecc005d70 con 0x7f0ed414b3b0 2023-10-18T17:23:47.043 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.031+0000 7f0ed89d6700 1 -- 172.21.15.183:0/282849710 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed4145a40 con 0x7f0ed414b3b0 2023-10-18T17:23:47.044 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.035+0000 7f0ecb7fe700 1 -- 172.21.15.183:0/282849710 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f0ecc013930 con 0x7f0ed414b3b0 2023-10-18T17:23:47.055 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:47.047+0000 7fa69eb27500 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-18T17:23:47.115 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.111+0000 7f0ed89d6700 1 -- 172.21.15.183:0/282849710 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "58005b5f-2742-4ecb-8c3a-a2ae65c7fb99", "id": 4} v 0) v1 -- 0x7f0ed4046f00 con 0x7f0ed414b3b0 2023-10-18T17:23:47.126 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.119+0000 7f0ecb7fe700 1 -- 172.21.15.183:0/282849710 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "58005b5f-2742-4ecb-8c3a-a2ae65c7fb99", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0ecc013ad0 con 0x7f0ed414b3b0 2023-10-18T17:23:47.126 INFO:teuthology.orchestra.run.smithi183.stdout:4 2023-10-18T17:23:47.128 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.123+0000 7f0ed89d6700 1 -- 172.21.15.183:0/282849710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ed414b3b0 msgr2=0x7f0ed414e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.128 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.123+0000 7f0ed89d6700 1 --2- 172.21.15.183:0/282849710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ed414b3b0 0x7f0ed414e050 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f0ecc00c490 tx=0x7f0ecc007c10).stop 2023-10-18T17:23:47.128 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.123+0000 7f0ed89d6700 1 -- 172.21.15.183:0/282849710 shutdown_connections 2023-10-18T17:23:47.128 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.123+0000 7f0ed89d6700 1 --2- 172.21.15.183:0/282849710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ed414b3b0 0x7f0ed414e050 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.128 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.123+0000 7f0ed89d6700 1 --2- 172.21.15.183:0/282849710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ed4068d20 0x7f0ed4146230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.129 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.123+0000 7f0ed89d6700 1 --2- 172.21.15.183:0/282849710 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ed40688e0 0x7f0ed4145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.129 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.123+0000 7f0ed89d6700 1 -- 172.21.15.183:0/282849710 >> 172.21.15.183:0/282849710 conn(0x7f0ed40c2a50 msgr2=0x7f0ed4069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:47.129 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.123+0000 7f0ed89d6700 1 -- 172.21.15.183:0/282849710 shutdown_connections 2023-10-18T17:23:47.129 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.123+0000 7f0ed89d6700 1 -- 172.21.15.183:0/282849710 wait complete. 2023-10-18T17:23:47.140 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new c0b217ed-1c09-4cde-b192-65624ab3a70a 5 2023-10-18T17:23:47.205 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:47.199+0000 7fa69eb27500 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-18T17:23:47.237 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.231+0000 7f3255300700 1 Processor -- start 2023-10-18T17:23:47.238 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.231+0000 7f3255300700 1 -- start start 2023-10-18T17:23:47.241 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.231+0000 7f3255300700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f325005dd40 0x7f32500bc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.241 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.231+0000 7f3255300700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325014eab0 con 0x7f325014ae60 2023-10-18T17:23:47.242 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.231+0000 7f3255300700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32500bc8a0 con 0x7f32500bbfd0 2023-10-18T17:23:47.242 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.231+0000 7f3255300700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f325014dcb0 con 0x7f325005dd40 2023-10-18T17:23:47.242 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.231+0000 7f324e7fc700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f325005dd40 0x7f32500bc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.243 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.231+0000 7f324e7fc700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f325005dd40 0x7f32500bc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:33294/0 (socket says 172.21.15.183:33294) 2023-10-18T17:23:47.243 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.231+0000 7f324e7fc700 1 -- 172.21.15.183:0/895675682 learned_addr learned my addr 172.21.15.183:0/895675682 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-18T17:23:47.244 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f324e7fc700 1 -- 172.21.15.183:0/895675682 >> v1:172.21.15.183:6789/0 conn(0x7f32500bbfd0 legacy=0x7f32500bfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.244 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f324e7fc700 1 -- 172.21.15.183:0/895675682 >> v1:172.21.15.158:6789/0 conn(0x7f325014ae60 legacy=0x7f3250062280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:47.244 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f324dffb700 1 -- 172.21.15.183:0/895675682 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063769861 0 0) 0x7f32500bc8a0 con 0x7f32500bbfd0 2023-10-18T17:23:47.245 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f324e7fc700 1 -- 172.21.15.183:0/895675682 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325014dea0 con 0x7f325005dd40 2023-10-18T17:23:47.245 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f324e7fc700 1 --2- 172.21.15.183:0/895675682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f325005dd40 0x7f32500bc3b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3244006fd0 tx=0x7f32440090f0).ready entity=mon.1 client_cookie=af824424e48962ea server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:47.245 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f324dffb700 1 -- 172.21.15.183:0/895675682 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324400b690 con 0x7f325005dd40 2023-10-18T17:23:47.245 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f324dffb700 1 -- 172.21.15.183:0/895675682 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324400b7f0 con 0x7f325005dd40 2023-10-18T17:23:47.245 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f324dffb700 1 -- 172.21.15.183:0/895675682 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324400bb70 con 0x7f325005dd40 2023-10-18T17:23:47.245 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f3255300700 1 -- 172.21.15.183:0/895675682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f325005dd40 msgr2=0x7f32500bc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.246 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f3255300700 1 --2- 172.21.15.183:0/895675682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f325005dd40 0x7f32500bc3b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3244006fd0 tx=0x7f32440090f0).stop 2023-10-18T17:23:47.246 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f3255300700 1 -- 172.21.15.183:0/895675682 shutdown_connections 2023-10-18T17:23:47.246 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f3255300700 1 --2- 172.21.15.183:0/895675682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f325005dd40 0x7f32500bc3b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.246 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f3255300700 1 -- 172.21.15.183:0/895675682 >> 172.21.15.183:0/895675682 conn(0x7f32500c3450 msgr2=0x7f32500bf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:47.246 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f3255300700 1 -- 172.21.15.183:0/895675682 shutdown_connections 2023-10-18T17:23:47.247 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f3255300700 1 -- 172.21.15.183:0/895675682 wait complete. 2023-10-18T17:23:47.249 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f3255300700 1 Processor -- start 2023-10-18T17:23:47.249 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f3255300700 1 -- start start 2023-10-18T17:23:47.249 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f3255300700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f325005dd40 0x7f325015e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.250 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f3255300700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32500bbfd0 0x7f32500b7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.250 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f3255300700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f325014ae60 0x7f32500663d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.250 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f3255300700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32500b7b60 con 0x7f325014ae60 2023-10-18T17:23:47.250 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f3255300700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32500b90c0 con 0x7f325005dd40 2023-10-18T17:23:47.250 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f3255300700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32500b7d40 con 0x7f32500bbfd0 2023-10-18T17:23:47.251 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f324effd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f325005dd40 0x7f325015e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.251 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f324e7fc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32500bbfd0 0x7f32500b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.251 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f324effd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f325005dd40 0x7f325015e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:33298/0 (socket says 172.21.15.183:33298) 2023-10-18T17:23:47.251 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f324effd700 1 -- 172.21.15.183:0/14321316 learned_addr learned my addr 172.21.15.183:0/14321316 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-18T17:23:47.251 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f324f7fe700 1 --2- 172.21.15.183:0/14321316 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f325014ae60 0x7f32500663d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.251 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f324e7fc700 1 -- 172.21.15.183:0/14321316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f325005dd40 msgr2=0x7f325015e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.252 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.235+0000 7f324e7fc700 1 --2- 172.21.15.183:0/14321316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f325005dd40 0x7f325015e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.252 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.239+0000 7f324e7fc700 1 -- 172.21.15.183:0/14321316 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f325014ae60 msgr2=0x7f32500663d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.252 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.239+0000 7f324e7fc700 1 --2- 172.21.15.183:0/14321316 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f325014ae60 0x7f32500663d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.252 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.239+0000 7f324e7fc700 1 -- 172.21.15.183:0/14321316 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3244009370 con 0x7f32500bbfd0 2023-10-18T17:23:47.252 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.239+0000 7f324effd700 1 --2- 172.21.15.183:0/14321316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f325005dd40 0x7f325015e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:23:47.253 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.239+0000 7f324f7fe700 1 --2- 172.21.15.183:0/14321316 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f325014ae60 0x7f32500663d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T17:23:47.253 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.239+0000 7f324e7fc700 1 --2- 172.21.15.183:0/14321316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32500bbfd0 0x7f32500b7670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f3250065eb0 tx=0x7f3244017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:47.253 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.239+0000 7f3236ffd700 1 -- 172.21.15.183:0/14321316 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324400bb70 con 0x7f32500bbfd0 2023-10-18T17:23:47.253 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.239+0000 7f3236ffd700 1 -- 172.21.15.183:0/14321316 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3244000c90 con 0x7f32500bbfd0 2023-10-18T17:23:47.253 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.239+0000 7f3255300700 1 -- 172.21.15.183:0/14321316 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32500b8020 con 0x7f32500bbfd0 2023-10-18T17:23:47.254 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.239+0000 7f3236ffd700 1 -- 172.21.15.183:0/14321316 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32440246c0 con 0x7f32500bbfd0 2023-10-18T17:23:47.254 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.239+0000 7f3255300700 1 -- 172.21.15.183:0/14321316 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32500b85e0 con 0x7f32500bbfd0 2023-10-18T17:23:47.254 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.239+0000 7f3236ffd700 1 -- 172.21.15.183:0/14321316 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f3244021070 con 0x7f32500bbfd0 2023-10-18T17:23:47.254 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.239+0000 7f3236ffd700 1 -- 172.21.15.183:0/14321316 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f324401ba60 con 0x7f32500bbfd0 2023-10-18T17:23:47.254 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.239+0000 7f3255300700 1 -- 172.21.15.183:0/14321316 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325006c190 con 0x7f32500bbfd0 2023-10-18T17:23:47.255 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.243+0000 7f3236ffd700 1 -- 172.21.15.183:0/14321316 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f324401bd40 con 0x7f32500bbfd0 2023-10-18T17:23:47.321 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.315+0000 7f3255300700 1 -- 172.21.15.183:0/14321316 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c0b217ed-1c09-4cde-b192-65624ab3a70a", "id": 5} v 0) v1 -- 0x7f325014e180 con 0x7f32500bbfd0 2023-10-18T17:23:47.331 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.323+0000 7f3236ffd700 1 -- 172.21.15.183:0/14321316 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c0b217ed-1c09-4cde-b192-65624ab3a70a", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f324401b4b0 con 0x7f32500bbfd0 2023-10-18T17:23:47.331 INFO:teuthology.orchestra.run.smithi183.stdout:5 2023-10-18T17:23:47.333 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.327+0000 7f3255300700 1 -- 172.21.15.183:0/14321316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32500bbfd0 msgr2=0x7f32500b7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.333 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.327+0000 7f3255300700 1 --2- 172.21.15.183:0/14321316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32500bbfd0 0x7f32500b7670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f3250065eb0 tx=0x7f3244017000).stop 2023-10-18T17:23:47.333 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.327+0000 7f3255300700 1 -- 172.21.15.183:0/14321316 shutdown_connections 2023-10-18T17:23:47.333 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.327+0000 7f3255300700 1 --2- 172.21.15.183:0/14321316 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f325014ae60 0x7f32500663d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.333 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.327+0000 7f3255300700 1 --2- 172.21.15.183:0/14321316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32500bbfd0 0x7f32500b7670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.334 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.327+0000 7f3255300700 1 --2- 172.21.15.183:0/14321316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f325005dd40 0x7f325015e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.334 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.327+0000 7f3255300700 1 -- 172.21.15.183:0/14321316 >> 172.21.15.183:0/14321316 conn(0x7f32500c3450 msgr2=0x7f32500bec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:47.334 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.327+0000 7f3255300700 1 -- 172.21.15.183:0/14321316 shutdown_connections 2023-10-18T17:23:47.334 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.327+0000 7f3255300700 1 -- 172.21.15.183:0/14321316 wait complete. 2023-10-18T17:23:47.344 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 5f910aac-4091-408b-8b2b-19865b21395c 6 2023-10-18T17:23:47.379 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:47.370+0000 7f45f5d5b500 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-18T17:23:47.427 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:47.419+0000 7fa69eb27500 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-18T17:23:47.443 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22d15bc700 1 Processor -- start 2023-10-18T17:23:47.444 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22d15bc700 1 -- start start 2023-10-18T17:23:47.445 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22d15bc700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f22cc1498b0 0x7f22cc14ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.446 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22d15bc700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc14d380 con 0x7f22cc149c90 2023-10-18T17:23:47.446 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22d15bc700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc062480 con 0x7f22cc0688e0 2023-10-18T17:23:47.446 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22d15bc700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc0b66e0 con 0x7f22cc1498b0 2023-10-18T17:23:47.447 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22d0dbb700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f22cc0688e0 0x7f22cc069840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:52376/0 (socket says 172.21.15.183:52376) 2023-10-18T17:23:47.447 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22d0dbb700 1 -- 172.21.15.183:0/3431377909 learned_addr learned my addr 172.21.15.183:0/3431377909 (peer_addr_for_me v1:172.21.15.183:0/0) 2023-10-18T17:23:47.447 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22caffd700 1 -- 172.21.15.183:0/3431377909 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129528695 0 0) 0x7f22cc062480 con 0x7f22cc0688e0 2023-10-18T17:23:47.447 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22caffd700 1 -- 172.21.15.183:0/3431377909 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22b40033f0 con 0x7f22cc0688e0 2023-10-18T17:23:47.450 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22cbfff700 1 --2- 172.21.15.183:0/3431377909 >> v2:172.21.15.158:3300/0 conn(0x7f22cc1498b0 0x7f22cc14ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.450 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22caffd700 1 -- 172.21.15.183:0/3431377909 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2547822406 0 0) 0x7f22b40033f0 con 0x7f22cc0688e0 2023-10-18T17:23:47.450 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22caffd700 1 -- 172.21.15.183:0/3431377909 >> v2:172.21.15.158:3300/0 conn(0x7f22cc1498b0 msgr2=0x7f22cc14ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:47.451 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22caffd700 1 --2- 172.21.15.183:0/3431377909 >> v2:172.21.15.158:3300/0 conn(0x7f22cc1498b0 0x7f22cc14ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.451 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22caffd700 1 -- 172.21.15.183:0/3431377909 >> v1:172.21.15.158:6789/0 conn(0x7f22cc149c90 legacy=0x7f22cc0645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:47.451 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22caffd700 1 -- 172.21.15.183:0/3431377909 --> v1:172.21.15.183:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc062760 con 0x7f22cc0688e0 2023-10-18T17:23:47.451 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22caffd700 1 -- 172.21.15.183:0/3431377909 <== mon.1 v1:172.21.15.183:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2074596555 0 0) 0x7f22c40017f0 con 0x7f22cc0688e0 2023-10-18T17:23:47.452 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22caffd700 1 -- 172.21.15.183:0/3431377909 >> v1:172.21.15.183:6789/0 conn(0x7f22cc0688e0 legacy=0x7f22cc069840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.452 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22caffd700 1 --2- 172.21.15.183:0/3431377909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22b40038e0 0x7f22b4003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.452 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22caffd700 1 --2- 172.21.15.183:0/3431377909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22b4004690 0x7f22b4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.452 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22caffd700 1 --2- 172.21.15.183:0/3431377909 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f22b4005050 0x7f22b400c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.452 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22caffd700 1 -- 172.21.15.183:0/3431377909 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b400cff0 con 0x7f22b4005050 2023-10-18T17:23:47.453 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22caffd700 1 -- 172.21.15.183:0/3431377909 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b400d160 con 0x7f22b40038e0 2023-10-18T17:23:47.453 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22caffd700 1 -- 172.21.15.183:0/3431377909 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b400d320 con 0x7f22b4004690 2023-10-18T17:23:47.453 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22cbfff700 1 --2- 172.21.15.183:0/3431377909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22b40038e0 0x7f22b4003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.453 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22cb7fe700 1 --2- 172.21.15.183:0/3431377909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22b4004690 0x7f22b4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.453 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22cbfff700 1 -- 172.21.15.183:0/3431377909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22b4004690 msgr2=0x7f22b4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:47.454 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22cbfff700 1 --2- 172.21.15.183:0/3431377909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22b4004690 0x7f22b4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.454 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22cbfff700 1 -- 172.21.15.183:0/3431377909 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f22b4005050 msgr2=0x7f22b400c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:47.454 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22cbfff700 1 --2- 172.21.15.183:0/3431377909 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f22b4005050 0x7f22b400c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:23:47.454 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22cbfff700 1 -- 172.21.15.183:0/3431377909 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b40033f0 con 0x7f22b40038e0 2023-10-18T17:23:47.455 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22cb7fe700 1 --2- 172.21.15.183:0/3431377909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22b4004690 0x7f22b4004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T17:23:47.455 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22d0dbb700 1 -- 172.21.15.183:0/3431377909 reap_dead start 2023-10-18T17:23:47.455 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.439+0000 7f22cbfff700 1 --2- 172.21.15.183:0/3431377909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22b40038e0 0x7f22b4003ce0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f22bc00ba00 tx=0x7f22bc008040).ready entity=mon.1 client_cookie=a6dbf66fcab30313 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:47.455 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.443+0000 7f22caffd700 1 -- 172.21.15.183:0/3431377909 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc00b340 con 0x7f22b40038e0 2023-10-18T17:23:47.455 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.443+0000 7f22caffd700 1 -- 172.21.15.183:0/3431377909 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc013480 con 0x7f22b40038e0 2023-10-18T17:23:47.455 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.443+0000 7f22caffd700 1 -- 172.21.15.183:0/3431377909 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc013800 con 0x7f22b40038e0 2023-10-18T17:23:47.456 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.443+0000 7f22d15bc700 1 -- 172.21.15.183:0/3431377909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22b40038e0 msgr2=0x7f22b4003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.456 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.443+0000 7f22d15bc700 1 --2- 172.21.15.183:0/3431377909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22b40038e0 0x7f22b4003ce0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f22bc00ba00 tx=0x7f22bc008040).stop 2023-10-18T17:23:47.456 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.443+0000 7f22d15bc700 1 -- 172.21.15.183:0/3431377909 shutdown_connections 2023-10-18T17:23:47.456 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.443+0000 7f22d15bc700 1 --2- 172.21.15.183:0/3431377909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22b40038e0 0x7f22b4003ce0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.456 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.443+0000 7f22d15bc700 1 -- 172.21.15.183:0/3431377909 >> 172.21.15.183:0/3431377909 conn(0x7f22cc0c2a50 msgr2=0x7f22cc0c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:47.457 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.443+0000 7f22d15bc700 1 -- 172.21.15.183:0/3431377909 shutdown_connections 2023-10-18T17:23:47.457 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.443+0000 7f22d15bc700 1 -- 172.21.15.183:0/3431377909 wait complete. 2023-10-18T17:23:47.457 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.443+0000 7f22d15bc700 1 Processor -- start 2023-10-18T17:23:47.457 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.443+0000 7f22d15bc700 1 -- start start 2023-10-18T17:23:47.459 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22d15bc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f22b40038e0 0x7f22cc15f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.460 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22d15bc700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22cc152e70 0x7f22cc15d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.460 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22d15bc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22cc15f940 0x7f22cc15d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.460 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22d15bc700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc15db90 con 0x7f22b40038e0 2023-10-18T17:23:47.460 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22d15bc700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0b96e0 con 0x7f22cc152e70 2023-10-18T17:23:47.460 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22d15bc700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc15fdf0 con 0x7f22cc15f940 2023-10-18T17:23:47.461 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22cb7fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22cc152e70 0x7f22cc15d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.461 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22cb7fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22cc152e70 0x7f22cc15d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:33318/0 (socket says 172.21.15.183:33318) 2023-10-18T17:23:47.461 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22cb7fe700 1 -- 172.21.15.183:0/2654393824 learned_addr learned my addr 172.21.15.183:0/2654393824 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-18T17:23:47.461 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22d0dbb700 1 --2- 172.21.15.183:0/2654393824 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22cc15f940 0x7f22cc15d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.461 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22cb7fe700 1 -- 172.21.15.183:0/2654393824 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22cc15f940 msgr2=0x7f22cc15d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.462 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22cb7fe700 1 --2- 172.21.15.183:0/2654393824 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22cc15f940 0x7f22cc15d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.462 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22cb7fe700 1 -- 172.21.15.183:0/2654393824 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f22b40038e0 msgr2=0x7f22cc15f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.462 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22cb7fe700 1 --2- 172.21.15.183:0/2654393824 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f22b40038e0 0x7f22cc15f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T17:23:47.462 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22cb7fe700 1 -- 172.21.15.183:0/2654393824 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc0b9980 con 0x7f22cc152e70 2023-10-18T17:23:47.462 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22cb7fe700 1 --2- 172.21.15.183:0/2654393824 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22cc152e70 0x7f22cc15d1b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f22c000d480 tx=0x7f22c0009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:47.463 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22b3fff700 1 -- 172.21.15.183:0/2654393824 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c00104e0 con 0x7f22cc152e70 2023-10-18T17:23:47.463 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22b3fff700 1 -- 172.21.15.183:0/2654393824 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c0010640 con 0x7f22cc152e70 2023-10-18T17:23:47.463 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22d15bc700 1 -- 172.21.15.183:0/2654393824 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22cc152660 con 0x7f22cc152e70 2023-10-18T17:23:47.463 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22b3fff700 1 -- 172.21.15.183:0/2654393824 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c00109e0 con 0x7f22cc152e70 2023-10-18T17:23:47.463 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22d15bc700 1 -- 172.21.15.183:0/2654393824 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc14a890 con 0x7f22cc152e70 2023-10-18T17:23:47.464 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22b3fff700 1 -- 172.21.15.183:0/2654393824 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f22c0013470 con 0x7f22cc152e70 2023-10-18T17:23:47.464 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22b3fff700 1 -- 172.21.15.183:0/2654393824 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f22c0010d90 con 0x7f22cc152e70 2023-10-18T17:23:47.464 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.447+0000 7f22d15bc700 1 -- 172.21.15.183:0/2654393824 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc046f00 con 0x7f22cc152e70 2023-10-18T17:23:47.464 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.451+0000 7f22b3fff700 1 -- 172.21.15.183:0/2654393824 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f22c0022060 con 0x7f22cc152e70 2023-10-18T17:23:47.525 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.519+0000 7f22d15bc700 1 -- 172.21.15.183:0/2654393824 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5f910aac-4091-408b-8b2b-19865b21395c", "id": 6} v 0) v1 -- 0x7f22cc062a40 con 0x7f22cc152e70 2023-10-18T17:23:47.534 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.527+0000 7f22b3fff700 1 -- 172.21.15.183:0/2654393824 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5f910aac-4091-408b-8b2b-19865b21395c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f22c0018070 con 0x7f22cc152e70 2023-10-18T17:23:47.535 INFO:teuthology.orchestra.run.smithi183.stdout:6 2023-10-18T17:23:47.536 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.531+0000 7f22d15bc700 1 -- 172.21.15.183:0/2654393824 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22cc152e70 msgr2=0x7f22cc15d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.536 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.531+0000 7f22d15bc700 1 --2- 172.21.15.183:0/2654393824 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22cc152e70 0x7f22cc15d1b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f22c000d480 tx=0x7f22c0009040).stop 2023-10-18T17:23:47.537 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.531+0000 7f22d15bc700 1 -- 172.21.15.183:0/2654393824 shutdown_connections 2023-10-18T17:23:47.537 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.531+0000 7f22d15bc700 1 --2- 172.21.15.183:0/2654393824 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22cc15f940 0x7f22cc15d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.537 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.531+0000 7f22d15bc700 1 --2- 172.21.15.183:0/2654393824 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22cc152e70 0x7f22cc15d1b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.537 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.531+0000 7f22d15bc700 1 --2- 172.21.15.183:0/2654393824 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f22b40038e0 0x7f22cc15f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T17:23:47.537 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.531+0000 7f22d15bc700 1 -- 172.21.15.183:0/2654393824 >> 172.21.15.183:0/2654393824 conn(0x7f22cc0c2a50 msgr2=0x7f22cc0be070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:47.538 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.531+0000 7f22d15bc700 1 -- 172.21.15.183:0/2654393824 shutdown_connections 2023-10-18T17:23:47.538 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.531+0000 7f22d15bc700 1 -- 172.21.15.183:0/2654393824 wait complete. 2023-10-18T17:23:47.549 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 96d7b9aa-687e-42e3-a5cf-1533931ecce5 7 2023-10-18T17:23:47.585 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:47.578+0000 7f45f5d5b500 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-18T17:23:47.586 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:47.579+0000 7fa69eb27500 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-18T17:23:47.635 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:47.627+0000 7fa69eb27500 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-18T17:23:47.642 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.635+0000 7ffa28e7f700 1 Processor -- start 2023-10-18T17:23:47.642 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.635+0000 7ffa28e7f700 1 -- start start 2023-10-18T17:23:47.644 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.635+0000 7ffa28e7f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa2405dfb0 0x7ffa240bed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.644 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.635+0000 7ffa28e7f700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa240be8b0 con 0x7ffa240bfb30 2023-10-18T17:23:47.644 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.635+0000 7ffa28e7f700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa240bd9c0 con 0x7ffa2414d620 2023-10-18T17:23:47.645 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.635+0000 7ffa28e7f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa240bdca0 con 0x7ffa2405dfb0 2023-10-18T17:23:47.645 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa21d9b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa2405dfb0 0x7ffa240bed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.645 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa2259c700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7ffa2414d620 0x7ffa24068820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:52390/0 (socket says 172.21.15.183:52390) 2023-10-18T17:23:47.645 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa2259c700 1 -- 172.21.15.183:0/2660472649 learned_addr learned my addr 172.21.15.183:0/2660472649 (peer_addr_for_me v1:172.21.15.183:0/0) 2023-10-18T17:23:47.645 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa21d9b700 1 -- 172.21.15.183:0/2660472649 >> v1:172.21.15.183:6789/0 conn(0x7ffa2414d620 legacy=0x7ffa24068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.646 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa2159a700 1 -- 172.21.15.183:0/2660472649 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788702103 0 0) 0x7ffa240bd9c0 con 0x7ffa2414d620 2023-10-18T17:23:47.646 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa21d9b700 1 -- 172.21.15.183:0/2660472649 >> v1:172.21.15.158:6789/0 conn(0x7ffa240bfb30 legacy=0x7ffa2415a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.646 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa21d9b700 1 -- 172.21.15.183:0/2660472649 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa240bdf80 con 0x7ffa2405dfb0 2023-10-18T17:23:47.646 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa21d9b700 1 --2- 172.21.15.183:0/2660472649 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa2405dfb0 0x7ffa240bed40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7ffa18009780 tx=0x7ffa18009060).ready entity=mon.2 client_cookie=51292af006e09339 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:47.646 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa2159a700 1 -- 172.21.15.183:0/2660472649 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa180090d0 con 0x7ffa2405dfb0 2023-10-18T17:23:47.647 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa2159a700 1 -- 172.21.15.183:0/2660472649 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1800b580 con 0x7ffa2405dfb0 2023-10-18T17:23:47.647 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa2159a700 1 -- 172.21.15.183:0/2660472649 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1800b900 con 0x7ffa2405dfb0 2023-10-18T17:23:47.650 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa28e7f700 1 -- 172.21.15.183:0/2660472649 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa2405dfb0 msgr2=0x7ffa240bed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.650 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa28e7f700 1 --2- 172.21.15.183:0/2660472649 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa2405dfb0 0x7ffa240bed40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7ffa18009780 tx=0x7ffa18009060).stop 2023-10-18T17:23:47.650 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa28e7f700 1 -- 172.21.15.183:0/2660472649 shutdown_connections 2023-10-18T17:23:47.651 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa28e7f700 1 --2- 172.21.15.183:0/2660472649 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa2405dfb0 0x7ffa240bed40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.651 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa28e7f700 1 -- 172.21.15.183:0/2660472649 >> 172.21.15.183:0/2660472649 conn(0x7ffa240c3400 msgr2=0x7ffa240bf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:47.651 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa28e7f700 1 -- 172.21.15.183:0/2660472649 shutdown_connections 2023-10-18T17:23:47.651 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa28e7f700 1 -- 172.21.15.183:0/2660472649 wait complete. 2023-10-18T17:23:47.651 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa28e7f700 1 Processor -- start 2023-10-18T17:23:47.651 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.639+0000 7ffa28e7f700 1 -- start start 2023-10-18T17:23:47.652 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa28e7f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa2405dfb0 0x7ffa240bbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.652 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa28e7f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa240bfb30 0x7ffa241637c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.652 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa28e7f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa2414d620 0x7ffa240c1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.652 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa28e7f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa24164000 con 0x7ffa2414d620 2023-10-18T17:23:47.652 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa28e7f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa241642e0 con 0x7ffa2405dfb0 2023-10-18T17:23:47.653 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa28e7f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa241645c0 con 0x7ffa240bfb30 2023-10-18T17:23:47.653 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa21d9b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa240bfb30 0x7ffa241637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.653 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa2259c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa2405dfb0 0x7ffa240bbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.653 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa21d9b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa240bfb30 0x7ffa241637c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:59610/0 (socket says 172.21.15.183:59610) 2023-10-18T17:23:47.653 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa21d9b700 1 -- 172.21.15.183:0/1251264262 learned_addr learned my addr 172.21.15.183:0/1251264262 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-18T17:23:47.654 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa22d9d700 1 --2- 172.21.15.183:0/1251264262 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa2414d620 0x7ffa240c1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.654 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa21d9b700 1 -- 172.21.15.183:0/1251264262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa2405dfb0 msgr2=0x7ffa240bbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.654 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa21d9b700 1 --2- 172.21.15.183:0/1251264262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa2405dfb0 0x7ffa240bbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.654 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa21d9b700 1 -- 172.21.15.183:0/1251264262 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa2414d620 msgr2=0x7ffa240c1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.654 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa21d9b700 1 --2- 172.21.15.183:0/1251264262 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa2414d620 0x7ffa240c1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.655 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa21d9b700 1 -- 172.21.15.183:0/1251264262 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa18009240 con 0x7ffa240bfb30 2023-10-18T17:23:47.655 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa2259c700 1 --2- 172.21.15.183:0/1251264262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa2405dfb0 0x7ffa240bbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:23:47.655 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa21d9b700 1 --2- 172.21.15.183:0/1251264262 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa240bfb30 0x7ffa241637c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7ffa24068230 tx=0x7ffa18017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:47.655 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa127fc700 1 -- 172.21.15.183:0/1251264262 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1800b900 con 0x7ffa240bfb30 2023-10-18T17:23:47.655 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa127fc700 1 -- 172.21.15.183:0/1251264262 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1800bcc0 con 0x7ffa240bfb30 2023-10-18T17:23:47.656 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa28e7f700 1 -- 172.21.15.183:0/1251264262 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2414e5a0 con 0x7ffa240bfb30 2023-10-18T17:23:47.656 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa127fc700 1 -- 172.21.15.183:0/1251264262 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1801b410 con 0x7ffa240bfb30 2023-10-18T17:23:47.656 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa28e7f700 1 -- 172.21.15.183:0/1251264262 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2414eb60 con 0x7ffa240bfb30 2023-10-18T17:23:47.656 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa127fc700 1 -- 172.21.15.183:0/1251264262 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ffa1801ba60 con 0x7ffa240bfb30 2023-10-18T17:23:47.656 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa127fc700 1 -- 172.21.15.183:0/1251264262 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7ffa18024d60 con 0x7ffa240bfb30 2023-10-18T17:23:47.657 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.643+0000 7ffa28e7f700 1 -- 172.21.15.183:0/1251264262 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa240628a0 con 0x7ffa240bfb30 2023-10-18T17:23:47.657 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.647+0000 7ffa127fc700 1 -- 172.21.15.183:0/1251264262 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7ffa18043e50 con 0x7ffa240bfb30 2023-10-18T17:23:47.698 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:47.691+0000 7fa69eb27500 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-18T17:23:47.729 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.723+0000 7ffa28e7f700 1 -- 172.21.15.183:0/1251264262 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "96d7b9aa-687e-42e3-a5cf-1533931ecce5", "id": 7} v 0) v1 -- 0x7ffa2406c190 con 0x7ffa240bfb30 2023-10-18T17:23:47.737 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.731+0000 7ffa127fc700 1 -- 172.21.15.183:0/1251264262 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96d7b9aa-687e-42e3-a5cf-1533931ecce5", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffa18032030 con 0x7ffa240bfb30 2023-10-18T17:23:47.738 INFO:teuthology.orchestra.run.smithi183.stdout:7 2023-10-18T17:23:47.739 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.731+0000 7ffa28e7f700 1 -- 172.21.15.183:0/1251264262 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa240bfb30 msgr2=0x7ffa241637c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.739 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.731+0000 7ffa28e7f700 1 --2- 172.21.15.183:0/1251264262 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa240bfb30 0x7ffa241637c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7ffa24068230 tx=0x7ffa18017000).stop 2023-10-18T17:23:47.739 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.731+0000 7ffa28e7f700 1 -- 172.21.15.183:0/1251264262 shutdown_connections 2023-10-18T17:23:47.739 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.731+0000 7ffa28e7f700 1 --2- 172.21.15.183:0/1251264262 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa2414d620 0x7ffa240c1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.740 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.731+0000 7ffa28e7f700 1 --2- 172.21.15.183:0/1251264262 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa240bfb30 0x7ffa241637c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.740 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.731+0000 7ffa28e7f700 1 --2- 172.21.15.183:0/1251264262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa2405dfb0 0x7ffa240bbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.740 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.731+0000 7ffa28e7f700 1 -- 172.21.15.183:0/1251264262 >> 172.21.15.183:0/1251264262 conn(0x7ffa240c3400 msgr2=0x7ffa24156390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:47.740 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.731+0000 7ffa28e7f700 1 -- 172.21.15.183:0/1251264262 shutdown_connections 2023-10-18T17:23:47.740 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-18T17:23:47.731+0000 7ffa28e7f700 1 -- 172.21.15.183:0/1251264262 wait complete. 2023-10-18T17:23:47.751 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-18T17:23:47.751 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-18T17:23:47.755 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:47.751+0000 7fa69eb27500 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-18T17:23:47.758 INFO:tasks.ceph.osd.0:Started 2023-10-18T17:23:47.758 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-18T17:23:47.759 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-18T17:23:47.763 INFO:tasks.ceph.osd.1:Started 2023-10-18T17:23:47.764 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-18T17:23:47.764 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-18T17:23:47.768 INFO:tasks.ceph.osd.2:Started 2023-10-18T17:23:47.768 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-18T17:23:47.769 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-18T17:23:47.775 INFO:tasks.ceph.osd.3:Started 2023-10-18T17:23:47.776 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-18T17:23:47.776 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-18T17:23:47.778 INFO:tasks.ceph.osd.4:Started 2023-10-18T17:23:47.779 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-18T17:23:47.779 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-18T17:23:47.781 INFO:tasks.ceph.osd.5:Started 2023-10-18T17:23:47.782 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-18T17:23:47.782 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-18T17:23:47.784 INFO:tasks.ceph.osd.6:Started 2023-10-18T17:23:47.785 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-18T17:23:47.785 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-18T17:23:47.787 INFO:tasks.ceph.osd.7:Started 2023-10-18T17:23:47.788 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T17:23:47.914 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:47.906+0000 7f45f5d5b500 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-18T17:23:47.947 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.938+0000 7f59596db700 1 Processor -- start 2023-10-18T17:23:47.947 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.938+0000 7f59596db700 1 -- start start 2023-10-18T17:23:47.951 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.942+0000 7f59596db700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f59541499b0 0x7f59540bf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.951 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.942+0000 7f59596db700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59540b5390 0x7f59540689b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.951 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.942+0000 7f59596db700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5954068520 con 0x7f59540bd270 2023-10-18T17:23:47.951 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.942+0000 7f59596db700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5954150710 con 0x7f59541499b0 2023-10-18T17:23:47.951 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.942+0000 7f59596db700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5954149d90 con 0x7f59540b5390 2023-10-18T17:23:47.953 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.942+0000 7f59537fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f59540bd270 0x7f59540bdd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49710/0 (socket says 172.21.15.158:49710) 2023-10-18T17:23:47.953 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.942+0000 7f59537fe700 1 -- 172.21.15.158:0/1727901684 learned_addr learned my addr 172.21.15.158:0/1727901684 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:23:47.953 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.942+0000 7f594a7fc700 1 --2- 172.21.15.158:0/1727901684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59540b5390 0x7f59540689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.953 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.942+0000 7f5952ffd700 1 --2- 172.21.15.158:0/1727901684 >> v2:172.21.15.183:3300/0 conn(0x7f59541499b0 0x7f59540bf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.942+0000 7f594a7fc700 1 -- 172.21.15.158:0/1727901684 >> v2:172.21.15.183:3300/0 conn(0x7f59541499b0 msgr2=0x7f59540bf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:47.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.942+0000 7f594a7fc700 1 --2- 172.21.15.158:0/1727901684 >> v2:172.21.15.183:3300/0 conn(0x7f59541499b0 0x7f59540bf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.942+0000 7f594a7fc700 1 -- 172.21.15.158:0/1727901684 >> v1:172.21.15.158:6789/0 conn(0x7f59540bd270 legacy=0x7f59540bdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.942+0000 7f594a7fc700 1 -- 172.21.15.158:0/1727901684 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5954150430 con 0x7f59540b5390 2023-10-18T17:23:47.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.942+0000 7f594a7fc700 1 --2- 172.21.15.158:0/1727901684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59540b5390 0x7f59540689b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f593c009760 tx=0x7f593c009060).ready entity=mon.2 client_cookie=9b6b40164ece74f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:47.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.942+0000 7f59527fc700 1 -- 172.21.15.158:0/1727901684 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c00b590 con 0x7f59540b5390 2023-10-18T17:23:47.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.942+0000 7f59527fc700 1 -- 172.21.15.158:0/1727901684 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c00b6f0 con 0x7f59540b5390 2023-10-18T17:23:47.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.942+0000 7f59527fc700 1 -- 172.21.15.158:0/1727901684 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c00ba70 con 0x7f59540b5390 2023-10-18T17:23:47.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.946+0000 7f59596db700 1 -- 172.21.15.158:0/1727901684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59540b5390 msgr2=0x7f59540689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.946+0000 7f59596db700 1 --2- 172.21.15.158:0/1727901684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59540b5390 0x7f59540689b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f593c009760 tx=0x7f593c009060).stop 2023-10-18T17:23:47.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.946+0000 7f59596db700 1 -- 172.21.15.158:0/1727901684 shutdown_connections 2023-10-18T17:23:47.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.946+0000 7f59596db700 1 --2- 172.21.15.158:0/1727901684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59540b5390 0x7f59540689b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.946+0000 7f59596db700 1 --2- 172.21.15.158:0/1727901684 >> v2:172.21.15.183:3300/0 conn(0x7f59541499b0 0x7f59540bf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.946+0000 7f59596db700 1 -- 172.21.15.158:0/1727901684 >> 172.21.15.158:0/1727901684 conn(0x7f59540620d0 msgr2=0x7f59540624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:47.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.946+0000 7f59596db700 1 -- 172.21.15.158:0/1727901684 shutdown_connections 2023-10-18T17:23:47.958 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.946+0000 7f59596db700 1 -- 172.21.15.158:0/1727901684 wait complete. 2023-10-18T17:23:47.958 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.946+0000 7f59596db700 1 Processor -- start 2023-10-18T17:23:47.958 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.946+0000 7f59596db700 1 -- start start 2023-10-18T17:23:47.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f59596db700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59540b5390 0x7f5954168cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f59596db700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59540bd270 0x7f5954142ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f59596db700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59541499b0 0x7f59540bafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:47.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f59596db700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59540c29a0 con 0x7f59541499b0 2023-10-18T17:23:47.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f59596db700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5954148c40 con 0x7f59540b5390 2023-10-18T17:23:47.961 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f59596db700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5954165ac0 con 0x7f59540bd270 2023-10-18T17:23:47.961 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f59537fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59541499b0 0x7f59540bafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.961 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f594a7fc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59540bd270 0x7f5954142ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.961 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f5952ffd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59540b5390 0x7f5954168cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:47.961 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f594a7fc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59540bd270 0x7f5954142ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:54610/0 (socket says 172.21.15.158:54610) 2023-10-18T17:23:47.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f594a7fc700 1 -- 172.21.15.158:0/2322902957 learned_addr learned my addr 172.21.15.158:0/2322902957 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:23:47.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f594a7fc700 1 -- 172.21.15.158:0/2322902957 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59540b5390 msgr2=0x7f5954168cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f594a7fc700 1 --2- 172.21.15.158:0/2322902957 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59540b5390 0x7f5954168cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f594a7fc700 1 -- 172.21.15.158:0/2322902957 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59541499b0 msgr2=0x7f59540bafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:47.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f594a7fc700 1 --2- 172.21.15.158:0/2322902957 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59541499b0 0x7f59540bafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:47.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f594a7fc700 1 -- 172.21.15.158:0/2322902957 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c0092a0 con 0x7f59540bd270 2023-10-18T17:23:47.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f59537fe700 1 --2- 172.21.15.158:0/2322902957 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59541499b0 0x7f59540bafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:23:47.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f594a7fc700 1 --2- 172.21.15.158:0/2322902957 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59540bd270 0x7f5954142ea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f593c011e50 tx=0x7f593c017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:47.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f594b7fe700 1 -- 172.21.15.158:0/2322902957 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c00b590 con 0x7f59540bd270 2023-10-18T17:23:47.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f594b7fe700 1 -- 172.21.15.158:0/2322902957 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c00b860 con 0x7f59540bd270 2023-10-18T17:23:47.964 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f594b7fe700 1 -- 172.21.15.158:0/2322902957 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c01b660 con 0x7f59540bd270 2023-10-18T17:23:47.964 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f59596db700 1 -- 172.21.15.158:0/2322902957 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59541691b0 con 0x7f59540bd270 2023-10-18T17:23:47.964 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f59596db700 1 -- 172.21.15.158:0/2322902957 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5954164eb0 con 0x7f59540bd270 2023-10-18T17:23:47.964 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f594b7fe700 1 -- 172.21.15.158:0/2322902957 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f593c01bcb0 con 0x7f59540bd270 2023-10-18T17:23:47.964 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.950+0000 7f594b7fe700 1 -- 172.21.15.158:0/2322902957 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f593c026c50 con 0x7f59540bd270 2023-10-18T17:23:47.965 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.954+0000 7f59596db700 1 -- 172.21.15.158:0/2322902957 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595414dd40 con 0x7f59540bd270 2023-10-18T17:23:47.967 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:47.958+0000 7f594b7fe700 1 -- 172.21.15.158:0/2322902957 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f595414dd40 con 0x7f59540bd270 2023-10-18T17:23:48.064 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:48.059+0000 7fa69eb27500 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-18T17:23:48.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:48.082+0000 7f59596db700 1 -- 172.21.15.158:0/2322902957 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f595406c190 con 0x7f59540bd270 2023-10-18T17:23:48.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:48.086+0000 7f594b7fe700 1 -- 172.21.15.158:0/2322902957 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7f593c035090 con 0x7f59540bd270 2023-10-18T17:23:48.093 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:48.094 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":10,"fsid":"ca4bb219-38c8-4c5b-a49c-213b123db018","created":"2023-10-18T17:23:45.550173+0000","modified":"2023-10-18T17:23:47.727646+0000","last_up_change":"0.000000","last_in_change":"2023-10-18T17:23:47.727646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"1f621b1e-5ea4-4dc3-80e1-c415c7cc97d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"769d7514-319f-4ac3-8cf3-6f88f4e7da2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b4459762-309d-454c-bd31-33b90192375f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7b78a411-1ae9-4051-ae9d-a03abc5a73ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"58005b5f-2742-4ecb-8c3a-a2ae65c7fb99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c0b217ed-1c09-4cde-b192-65624ab3a70a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5f910aac-4091-408b-8b2b-19865b21395c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"96d7b9aa-687e-42e3-a5cf-1533931ecce5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T17:23:48.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:48.086+0000 7f59596db700 1 -- 172.21.15.158:0/2322902957 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59540bd270 msgr2=0x7f5954142ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:48.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:48.086+0000 7f59596db700 1 --2- 172.21.15.158:0/2322902957 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59540bd270 0x7f5954142ea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f593c011e50 tx=0x7f593c017000).stop 2023-10-18T17:23:48.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:48.086+0000 7f59596db700 1 -- 172.21.15.158:0/2322902957 shutdown_connections 2023-10-18T17:23:48.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:48.086+0000 7f59596db700 1 --2- 172.21.15.158:0/2322902957 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59541499b0 0x7f59540bafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:48.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:48.086+0000 7f59596db700 1 --2- 172.21.15.158:0/2322902957 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59540bd270 0x7f5954142ea0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:48.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:48.086+0000 7f59596db700 1 --2- 172.21.15.158:0/2322902957 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59540b5390 0x7f5954168cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:48.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:48.086+0000 7f59596db700 1 -- 172.21.15.158:0/2322902957 >> 172.21.15.158:0/2322902957 conn(0x7f59540620d0 msgr2=0x7f595414cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:48.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:48.086+0000 7f59596db700 1 -- 172.21.15.158:0/2322902957 shutdown_connections 2023-10-18T17:23:48.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:48.086+0000 7f59596db700 1 -- 172.21.15.158:0/2322902957 wait complete. 2023-10-18T17:23:48.119 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-18T17:23:48.120 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-18T17:23:48.145 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-10-18T17:23:48.139+0000 7fc5cdbae080 -1 Falling back to public interface 2023-10-18T17:23:48.146 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-18T17:23:48.139+0000 7fe791226080 -1 Falling back to public interface 2023-10-18T17:23:48.162 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:48.154+0000 7f45f5d5b500 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-18T17:23:48.169 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-18T17:23:48.163+0000 7f0cb5822080 -1 Falling back to public interface 2023-10-18T17:23:48.211 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:48.207+0000 7fa69eb27500 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-18T17:23:48.240 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:48.230+0000 7f45f5d5b500 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-18T17:23:48.335 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:48.326+0000 7f45f5d5b500 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-18T17:23:48.401 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-18T17:23:48.395+0000 7f81abbfc080 -1 Falling back to public interface 2023-10-18T17:23:48.419 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:48.410+0000 7f45f5d5b500 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-18T17:23:48.427 INFO:tasks.ceph.osd.3.smithi158.stderr:2023-10-18T17:23:48.418+0000 7fdf55ee0080 -1 Falling back to public interface 2023-10-18T17:23:48.438 INFO:tasks.ceph.osd.2.smithi158.stderr:2023-10-18T17:23:48.430+0000 7f27f8ee1080 -1 Falling back to public interface 2023-10-18T17:23:48.446 INFO:tasks.ceph.osd.0.smithi158.stderr:2023-10-18T17:23:48.438+0000 7f7a3e2db080 -1 Falling back to public interface 2023-10-18T17:23:48.455 INFO:tasks.ceph.osd.1.smithi158.stderr:2023-10-18T17:23:48.446+0000 7fb802ede080 -1 Falling back to public interface 2023-10-18T17:23:48.470 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:48.463+0000 7fa69eb27500 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-18T17:23:48.539 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:48.531+0000 7fa69eb27500 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-18T17:23:48.787 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:48.779+0000 7fa69eb27500 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-18T17:23:48.797 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:48.790+0000 7f45f5d5b500 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-18T17:23:48.847 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:48.839+0000 7fa69eb27500 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-18T17:23:48.924 DEBUG:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-18T17:23:48.956 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:48.946+0000 7f45f5d5b500 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-18T17:23:49.002 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:48.995+0000 7fa69eb27500 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-18T17:23:49.066 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.058+0000 7f47a0ff9700 1 Processor -- start 2023-10-18T17:23:49.067 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.058+0000 7f47a0ff9700 1 -- start start 2023-10-18T17:23:49.068 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.058+0000 7f47a0ff9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f479c0bf5b0 0x7f479c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:49.068 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.058+0000 7f47a0ff9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c0c2900 con 0x7f479c06b4b0 2023-10-18T17:23:49.068 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.058+0000 7f47a0ff9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c0bf9e0 con 0x7f479c06b890 2023-10-18T17:23:49.069 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.058+0000 7f47a0ff9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c064cd0 con 0x7f479c0bf5b0 2023-10-18T17:23:49.069 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.058+0000 7f479b7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f479c06b4b0 0x7f479c14c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49724/0 (socket says 172.21.15.158:49724) 2023-10-18T17:23:49.069 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.058+0000 7f479b7fe700 1 -- 172.21.15.158:0/2175802134 learned_addr learned my addr 172.21.15.158:0/2175802134 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:23:49.069 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.058+0000 7f479bfff700 1 --2- 172.21.15.158:0/2175802134 >> v2:172.21.15.158:3300/0 conn(0x7f479c0bf5b0 0x7f479c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:49.071 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.062+0000 7f479affd700 1 -- 172.21.15.158:0/2175802134 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835136105 0 0) 0x7f479c0c2900 con 0x7f479c06b4b0 2023-10-18T17:23:49.071 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.062+0000 7f479affd700 1 -- 172.21.15.158:0/2175802134 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47880033f0 con 0x7f479c06b4b0 2023-10-18T17:23:49.071 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.062+0000 7f479bfff700 1 -- 172.21.15.158:0/2175802134 >> v1:172.21.15.183:6789/0 conn(0x7f479c06b890 legacy=0x7f479c0645c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:49.071 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.062+0000 7f479bfff700 1 -- 172.21.15.158:0/2175802134 >> v1:172.21.15.158:6789/0 conn(0x7f479c06b4b0 legacy=0x7f479c14c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:49.072 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.062+0000 7f479bfff700 1 -- 172.21.15.158:0/2175802134 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c14d1f0 con 0x7f479c0bf5b0 2023-10-18T17:23:49.072 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.062+0000 7f479bfff700 1 --2- 172.21.15.158:0/2175802134 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f479c0bf5b0 0x7f479c0b5220 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f4794009e60 tx=0x7f4794009780).ready entity=mon.0 client_cookie=849548deb7733f5b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:49.072 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.062+0000 7f479affd700 1 -- 172.21.15.158:0/2175802134 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479400e070 con 0x7f479c0bf5b0 2023-10-18T17:23:49.072 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.062+0000 7f479affd700 1 -- 172.21.15.158:0/2175802134 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479400bb60 con 0x7f479c0bf5b0 2023-10-18T17:23:49.072 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.062+0000 7f479affd700 1 -- 172.21.15.158:0/2175802134 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794012410 con 0x7f479c0bf5b0 2023-10-18T17:23:49.072 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.062+0000 7f47a0ff9700 1 -- 172.21.15.158:0/2175802134 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f479c0bf5b0 msgr2=0x7f479c0b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:49.073 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.062+0000 7f47a0ff9700 1 --2- 172.21.15.158:0/2175802134 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f479c0bf5b0 0x7f479c0b5220 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f4794009e60 tx=0x7f4794009780).stop 2023-10-18T17:23:49.073 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.062+0000 7f47a0ff9700 1 -- 172.21.15.158:0/2175802134 shutdown_connections 2023-10-18T17:23:49.073 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.062+0000 7f47a0ff9700 1 --2- 172.21.15.158:0/2175802134 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f479c0bf5b0 0x7f479c0b5220 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:49.073 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.062+0000 7f47a0ff9700 1 -- 172.21.15.158:0/2175802134 >> 172.21.15.158:0/2175802134 conn(0x7f479c069d60 msgr2=0x7f479c06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:49.073 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.062+0000 7f47a0ff9700 1 -- 172.21.15.158:0/2175802134 shutdown_connections 2023-10-18T17:23:49.074 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.062+0000 7f47a0ff9700 1 -- 172.21.15.158:0/2175802134 wait complete. 2023-10-18T17:23:49.074 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f47a0ff9700 1 Processor -- start 2023-10-18T17:23:49.074 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f47a0ff9700 1 -- start start 2023-10-18T17:23:49.077 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f47a0ff9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f479c06b4b0 0x7f479c141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:49.077 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f47a0ff9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f479c06b890 0x7f479c149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:49.077 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f47a0ff9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f479c0bf5b0 0x7f479c0b8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:49.078 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f47a0ff9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0b74b0 con 0x7f479c06b4b0 2023-10-18T17:23:49.078 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f47a0ff9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0b7e90 con 0x7f479c0bf5b0 2023-10-18T17:23:49.079 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f47a0ff9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c160840 con 0x7f479c06b890 2023-10-18T17:23:49.079 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f479b7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f479c06b4b0 0x7f479c141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:49.079 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f479b7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f479c06b4b0 0x7f479c141f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56840/0 (socket says 172.21.15.158:56840) 2023-10-18T17:23:49.079 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f479b7fe700 1 -- 172.21.15.158:0/4161088095 learned_addr learned my addr 172.21.15.158:0/4161088095 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:23:49.080 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f479bfff700 1 --2- 172.21.15.158:0/4161088095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f479c0bf5b0 0x7f479c0b8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:49.080 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f4793fff700 1 --2- 172.21.15.158:0/4161088095 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f479c06b890 0x7f479c149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:49.080 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f479b7fe700 1 -- 172.21.15.158:0/4161088095 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f479c06b890 msgr2=0x7f479c149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:49.080 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f479b7fe700 1 --2- 172.21.15.158:0/4161088095 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f479c06b890 0x7f479c149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:49.081 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f479b7fe700 1 -- 172.21.15.158:0/4161088095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f479c0bf5b0 msgr2=0x7f479c0b8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:49.081 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f479b7fe700 1 --2- 172.21.15.158:0/4161088095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f479c0bf5b0 0x7f479c0b8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:49.081 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f479b7fe700 1 -- 172.21.15.158:0/4161088095 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4794009a20 con 0x7f479c06b4b0 2023-10-18T17:23:49.081 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f4793fff700 1 --2- 172.21.15.158:0/4161088095 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f479c06b890 0x7f479c149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:23:49.081 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f479b7fe700 1 --2- 172.21.15.158:0/4161088095 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f479c06b4b0 0x7f479c141f60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f478c00c590 tx=0x7f478c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:49.082 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f47937fe700 1 -- 172.21.15.158:0/4161088095 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c0072e0 con 0x7f479c06b4b0 2023-10-18T17:23:49.082 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f47937fe700 1 -- 172.21.15.158:0/4161088095 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c007440 con 0x7f479c06b4b0 2023-10-18T17:23:49.082 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f47a0ff9700 1 -- 172.21.15.158:0/4161088095 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c0b4ff0 con 0x7f479c06b4b0 2023-10-18T17:23:49.082 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f47937fe700 1 -- 172.21.15.158:0/4161088095 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c0057a0 con 0x7f479c06b4b0 2023-10-18T17:23:49.082 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f47a0ff9700 1 -- 172.21.15.158:0/4161088095 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c141c80 con 0x7f479c06b4b0 2023-10-18T17:23:49.083 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.066+0000 7f47937fe700 1 -- 172.21.15.158:0/4161088095 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f478c013450 con 0x7f479c06b4b0 2023-10-18T17:23:49.083 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.070+0000 7f47937fe700 1 -- 172.21.15.158:0/4161088095 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f478c005e30 con 0x7f479c06b4b0 2023-10-18T17:23:49.083 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.070+0000 7f47a0ff9700 1 -- 172.21.15.158:0/4161088095 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c046f00 con 0x7f479c06b4b0 2023-10-18T17:23:49.084 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.070+0000 7f47937fe700 1 -- 172.21.15.158:0/4161088095 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f478c013700 con 0x7f479c06b4b0 2023-10-18T17:23:49.101 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:49.095+0000 7fa69eb27500 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-18T17:23:49.147 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.138+0000 7f47a0ff9700 1 -- 172.21.15.158:0/4161088095 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f479c14d4b0 con 0x7f479c06b4b0 2023-10-18T17:23:49.148 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.138+0000 7f47937fe700 1 -- 172.21.15.158:0/4161088095 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7f478c0138a0 con 0x7f479c06b4b0 2023-10-18T17:23:49.148 INFO:teuthology.misc.health.smithi158.stdout: 2023-10-18T17:23:49.149 INFO:teuthology.misc.health.smithi158.stdout:{"epoch":10,"fsid":"ca4bb219-38c8-4c5b-a49c-213b123db018","created":"2023-10-18T17:23:45.550173+0000","modified":"2023-10-18T17:23:47.727646+0000","last_up_change":"0.000000","last_in_change":"2023-10-18T17:23:47.727646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"1f621b1e-5ea4-4dc3-80e1-c415c7cc97d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"769d7514-319f-4ac3-8cf3-6f88f4e7da2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b4459762-309d-454c-bd31-33b90192375f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7b78a411-1ae9-4051-ae9d-a03abc5a73ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"58005b5f-2742-4ecb-8c3a-a2ae65c7fb99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c0b217ed-1c09-4cde-b192-65624ab3a70a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5f910aac-4091-408b-8b2b-19865b21395c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"96d7b9aa-687e-42e3-a5cf-1533931ecce5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T17:23:49.150 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.142+0000 7f47a0ff9700 1 -- 172.21.15.158:0/4161088095 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f479c06b4b0 msgr2=0x7f479c141f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:49.150 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.142+0000 7f47a0ff9700 1 --2- 172.21.15.158:0/4161088095 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f479c06b4b0 0x7f479c141f60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f478c00c590 tx=0x7f478c007c80).stop 2023-10-18T17:23:49.151 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.142+0000 7f47a0ff9700 1 -- 172.21.15.158:0/4161088095 shutdown_connections 2023-10-18T17:23:49.151 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.142+0000 7f47a0ff9700 1 --2- 172.21.15.158:0/4161088095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f479c0bf5b0 0x7f479c0b8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:49.151 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.142+0000 7f47a0ff9700 1 --2- 172.21.15.158:0/4161088095 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f479c06b890 0x7f479c149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:49.151 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.142+0000 7f47a0ff9700 1 --2- 172.21.15.158:0/4161088095 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f479c06b4b0 0x7f479c141f60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:49.151 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.142+0000 7f47a0ff9700 1 -- 172.21.15.158:0/4161088095 >> 172.21.15.158:0/4161088095 conn(0x7f479c069d60 msgr2=0x7f479c0bfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:49.152 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.142+0000 7f47a0ff9700 1 -- 172.21.15.158:0/4161088095 shutdown_connections 2023-10-18T17:23:49.152 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:49.142+0000 7f47a0ff9700 1 -- 172.21.15.158:0/4161088095 wait complete. 2023-10-18T17:23:49.167 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-18T17:23:49.247 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:49.239+0000 7fa69eb27500 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-18T17:23:49.282 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:49.274+0000 7f45f5d5b500 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-18T17:23:49.367 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:49.358+0000 7f45f5d5b500 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-18T17:23:49.448 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:49.443+0000 7fa69eb27500 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-18T17:23:49.665 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:49.654+0000 7f45f5d5b500 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-18T17:23:49.746 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:49.738+0000 7f45f5d5b500 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-18T17:23:49.921 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:49.910+0000 7f45f5d5b500 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-18T17:23:50.044 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:50.034+0000 7f45f5d5b500 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-18T17:23:50.221 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:50.210+0000 7f45f5d5b500 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-18T17:23:50.455 INFO:tasks.ceph.mgr.y.smithi158.stderr:2023-10-18T17:23:50.446+0000 7f45f5d5b500 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-18T17:23:50.501 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:50.495+0000 7fa688808700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-18T17:23:50.502 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:23:50.495+0000 7fa688808700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-18T17:23:51.943 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-18T17:23:51.935+0000 7f0cb5822080 -1 osd.7 0 log_to_monitors {default=true} 2023-10-18T17:23:51.958 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-18T17:23:51.951+0000 7fe791226080 -1 osd.5 0 log_to_monitors {default=true} 2023-10-18T17:23:52.041 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-10-18T17:23:52.035+0000 7fc5cdbae080 -1 osd.4 0 log_to_monitors {default=true} 2023-10-18T17:23:52.139 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-18T17:23:52.131+0000 7f81abbfc080 -1 osd.6 0 log_to_monitors {default=true} 2023-10-18T17:23:52.579 INFO:tasks.ceph.osd.3.smithi158.stderr:2023-10-18T17:23:52.571+0000 7fdf55ee0080 -1 osd.3 0 log_to_monitors {default=true} 2023-10-18T17:23:52.600 INFO:tasks.ceph.osd.2.smithi158.stderr:2023-10-18T17:23:52.591+0000 7f27f8ee1080 -1 osd.2 0 log_to_monitors {default=true} 2023-10-18T17:23:52.661 INFO:tasks.ceph.osd.0.smithi158.stderr:2023-10-18T17:23:52.655+0000 7f7a3e2db080 -1 osd.0 0 log_to_monitors {default=true} 2023-10-18T17:23:52.674 INFO:tasks.ceph.osd.1.smithi158.stderr:2023-10-18T17:23:52.667+0000 7fb802ede080 -1 osd.1 0 log_to_monitors {default=true} 2023-10-18T17:23:53.616 INFO:tasks.ceph.osd.3.smithi158.stderr:2023-10-18T17:23:53.611+0000 7fdf50e85700 -1 osd.3 0 waiting for initial osdmap 2023-10-18T17:23:53.618 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-10-18T17:23:53.611+0000 7fc5c934e700 -1 osd.4 0 waiting for initial osdmap 2023-10-18T17:23:53.619 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-18T17:23:53.611+0000 7f81a739c700 -1 osd.6 0 waiting for initial osdmap 2023-10-18T17:23:53.621 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-18T17:23:53.615+0000 7f0cb0fc2700 -1 osd.7 0 waiting for initial osdmap 2023-10-18T17:23:53.622 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-18T17:23:53.615+0000 7fe78e1eb700 -1 osd.5 0 waiting for initial osdmap 2023-10-18T17:23:53.625 INFO:tasks.ceph.osd.3.smithi158.stderr:2023-10-18T17:23:53.619+0000 7fdf4dbf9700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T17:23:53.626 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-10-18T17:23:53.619+0000 7fc5c60c2700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T17:23:53.628 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-18T17:23:53.623+0000 7f81a4110700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T17:23:53.628 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-18T17:23:53.623+0000 7f0cadd36700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T17:23:53.630 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-18T17:23:53.623+0000 7fe78973a700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T17:23:54.624 INFO:tasks.ceph.osd.0.smithi158.stderr:2023-10-18T17:23:54.615+0000 7f7a39a7b700 -1 osd.0 0 waiting for initial osdmap 2023-10-18T17:23:54.625 INFO:tasks.ceph.osd.2.smithi158.stderr:2023-10-18T17:23:54.619+0000 7f27f3cfb700 -1 osd.2 0 waiting for initial osdmap 2023-10-18T17:23:54.625 INFO:tasks.ceph.osd.1.smithi158.stderr:2023-10-18T17:23:54.619+0000 7fb7fdd89700 -1 osd.1 0 waiting for initial osdmap 2023-10-18T17:23:54.632 INFO:tasks.ceph.osd.0.smithi158.stderr:2023-10-18T17:23:54.623+0000 7f7a367ef700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T17:23:54.704 INFO:tasks.ceph.osd.2.smithi158.stderr:2023-10-18T17:23:54.695+0000 7f27f0a6f700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T17:23:54.704 INFO:tasks.ceph.osd.1.smithi158.stderr:2023-10-18T17:23:54.699+0000 7fb7faafd700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T17:23:55.973 DEBUG:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-18T17:23:56.108 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.099+0000 7ffa84879700 1 Processor -- start 2023-10-18T17:23:56.108 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.099+0000 7ffa84879700 1 -- start start 2023-10-18T17:23:56.109 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa84879700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa80068e60 0x7ffa80153b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:56.109 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa84879700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa80154040 con 0x7ffa80068a80 2023-10-18T17:23:56.110 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa84879700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa800be400 con 0x7ffa80151090 2023-10-18T17:23:56.110 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa84879700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800c0a40 con 0x7ffa80068e60 2023-10-18T17:23:56.112 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7f7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7ffa80068a80 0x7ffa800bff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:59118/0 (socket says 172.21.15.158:59118) 2023-10-18T17:23:56.112 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7f7fe700 1 -- 172.21.15.158:0/4087879604 learned_addr learned my addr 172.21.15.158:0/4087879604 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:23:56.112 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7effd700 1 --2- 172.21.15.158:0/4087879604 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa80068e60 0x7ffa80153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:56.113 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7e7fc700 1 -- 172.21.15.158:0/4087879604 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195112261 0 0) 0x7ffa80154040 con 0x7ffa80068a80 2023-10-18T17:23:56.113 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7e7fc700 1 -- 172.21.15.158:0/4087879604 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa680033f0 con 0x7ffa80068a80 2023-10-18T17:23:56.113 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7e7fc700 1 -- 172.21.15.158:0/4087879604 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654367237 0 0) 0x7ffa800be400 con 0x7ffa80151090 2023-10-18T17:23:56.113 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7e7fc700 1 -- 172.21.15.158:0/4087879604 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa80154040 con 0x7ffa80151090 2023-10-18T17:23:56.113 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7e7fc700 1 -- 172.21.15.158:0/4087879604 <== mon.0 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3279976298 0 0) 0x7ffa680033f0 con 0x7ffa80068a80 2023-10-18T17:23:56.114 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7e7fc700 1 -- 172.21.15.158:0/4087879604 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa80068e60 msgr2=0x7ffa80153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:56.114 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7e7fc700 1 --2- 172.21.15.158:0/4087879604 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa80068e60 0x7ffa80153b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:56.114 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7e7fc700 1 -- 172.21.15.158:0/4087879604 >> v1:172.21.15.183:6789/0 conn(0x7ffa80151090 legacy=0x7ffa8014cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:56.114 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7e7fc700 1 -- 172.21.15.158:0/4087879604 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa80068690 con 0x7ffa80068a80 2023-10-18T17:23:56.114 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7e7fc700 1 -- 172.21.15.158:0/4087879604 <== mon.0 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2074596555 0 0) 0x7ffa70001470 con 0x7ffa80068a80 2023-10-18T17:23:56.115 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7effd700 1 --2- 172.21.15.158:0/4087879604 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa80068e60 0x7ffa80153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:23:56.115 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7e7fc700 1 -- 172.21.15.158:0/4087879604 >> v1:172.21.15.158:6789/0 conn(0x7ffa80068a80 legacy=0x7ffa800bff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:56.115 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7e7fc700 1 --2- 172.21.15.158:0/4087879604 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa68003aa0 0x7ffa68003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:56.115 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7e7fc700 1 --2- 172.21.15.158:0/4087879604 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa68004690 0x7ffa68004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:56.116 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7e7fc700 1 --2- 172.21.15.158:0/4087879604 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa68005000 0x7ffa6800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:56.116 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7e7fc700 1 -- 172.21.15.158:0/4087879604 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6800bdd0 con 0x7ffa68004690 2023-10-18T17:23:56.116 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7e7fc700 1 -- 172.21.15.158:0/4087879604 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6800bf10 con 0x7ffa68005000 2023-10-18T17:23:56.116 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7e7fc700 1 -- 172.21.15.158:0/4087879604 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6800c0d0 con 0x7ffa68003aa0 2023-10-18T17:23:56.116 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7effd700 1 --2- 172.21.15.158:0/4087879604 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa68004690 0x7ffa68004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:56.119 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7ffff700 1 --2- 172.21.15.158:0/4087879604 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa68005000 0x7ffa6800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:56.120 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7effd700 1 -- 172.21.15.158:0/4087879604 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa68003aa0 msgr2=0x7ffa68003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:56.120 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.103+0000 7ffa7f7fe700 1 --2- 172.21.15.158:0/4087879604 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa68003aa0 0x7ffa68003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:56.120 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.107+0000 7ffa7effd700 1 --2- 172.21.15.158:0/4087879604 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa68003aa0 0x7ffa68003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:56.120 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.107+0000 7ffa7effd700 1 -- 172.21.15.158:0/4087879604 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa68005000 msgr2=0x7ffa6800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:56.120 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.107+0000 7ffa7effd700 1 --2- 172.21.15.158:0/4087879604 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa68005000 0x7ffa6800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:56.120 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.107+0000 7ffa7effd700 1 -- 172.21.15.158:0/4087879604 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa680033f0 con 0x7ffa68004690 2023-10-18T17:23:56.121 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.107+0000 7ffa7f7fe700 1 --2- 172.21.15.158:0/4087879604 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa68003aa0 0x7ffa68003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T17:23:56.121 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.107+0000 7ffa7ffff700 1 --2- 172.21.15.158:0/4087879604 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa68005000 0x7ffa6800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T17:23:56.121 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.107+0000 7ffa7effd700 1 --2- 172.21.15.158:0/4087879604 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa68004690 0x7ffa68004b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ffa800684e0 tx=0x7ffa74009060).ready entity=mon.0 client_cookie=504cd45506de3889 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:56.121 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.107+0000 7ffa7e7fc700 1 -- 172.21.15.158:0/4087879604 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa740094d0 con 0x7ffa68004690 2023-10-18T17:23:56.121 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.107+0000 7ffa7e7fc700 1 -- 172.21.15.158:0/4087879604 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7400e640 con 0x7ffa68004690 2023-10-18T17:23:56.122 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.107+0000 7ffa7e7fc700 1 -- 172.21.15.158:0/4087879604 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400ea00 con 0x7ffa68004690 2023-10-18T17:23:56.122 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.107+0000 7ffa84879700 1 -- 172.21.15.158:0/4087879604 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa68004690 msgr2=0x7ffa68004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:56.122 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.107+0000 7ffa84879700 1 --2- 172.21.15.158:0/4087879604 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa68004690 0x7ffa68004b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ffa800684e0 tx=0x7ffa74009060).stop 2023-10-18T17:23:56.123 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.107+0000 7ffa7ffff700 1 -- 172.21.15.158:0/4087879604 reap_dead start 2023-10-18T17:23:56.123 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.107+0000 7ffa84879700 1 -- 172.21.15.158:0/4087879604 shutdown_connections 2023-10-18T17:23:56.123 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.107+0000 7ffa84879700 1 -- 172.21.15.158:0/4087879604 >> 172.21.15.158:0/4087879604 conn(0x7ffa8006afa0 msgr2=0x7ffa8006b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:56.123 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.107+0000 7ffa84879700 1 -- 172.21.15.158:0/4087879604 shutdown_connections 2023-10-18T17:23:56.123 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.107+0000 7ffa84879700 1 -- 172.21.15.158:0/4087879604 wait complete. 2023-10-18T17:23:56.124 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.111+0000 7ffa84879700 1 Processor -- start 2023-10-18T17:23:56.124 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.111+0000 7ffa84879700 1 -- start start 2023-10-18T17:23:56.124 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.111+0000 7ffa84879700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa68004690 0x7ffa8014b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:56.124 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.111+0000 7ffa84879700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa80160ea0 0x7ffa800c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:56.124 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.111+0000 7ffa84879700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa800c2e80 0x7ffa8014e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:56.124 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.111+0000 7ffa84879700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8014dae0 con 0x7ffa80160ea0 2023-10-18T17:23:56.125 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.111+0000 7ffa84879700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8014dd80 con 0x7ffa68004690 2023-10-18T17:23:56.125 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.111+0000 7ffa84879700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800bbe00 con 0x7ffa800c2e80 2023-10-18T17:23:56.125 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.111+0000 7ffa7effd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa80160ea0 0x7ffa800c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:56.125 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.111+0000 7ffa7effd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa80160ea0 0x7ffa800c2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55464/0 (socket says 172.21.15.158:55464) 2023-10-18T17:23:56.125 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.111+0000 7ffa7effd700 1 -- 172.21.15.158:0/2068598631 learned_addr learned my addr 172.21.15.158:0/2068598631 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:23:56.126 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.111+0000 7ffa7f7fe700 1 --2- 172.21.15.158:0/2068598631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa68004690 0x7ffa8014b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:56.126 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.111+0000 7ffa7ffff700 1 --2- 172.21.15.158:0/2068598631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa800c2e80 0x7ffa8014e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:56.126 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.111+0000 7ffa7effd700 1 -- 172.21.15.158:0/2068598631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa800c2e80 msgr2=0x7ffa8014e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:56.126 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.111+0000 7ffa7effd700 1 --2- 172.21.15.158:0/2068598631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa800c2e80 0x7ffa8014e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:56.127 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.111+0000 7ffa7effd700 1 -- 172.21.15.158:0/2068598631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa68004690 msgr2=0x7ffa8014b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:56.127 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.111+0000 7ffa7effd700 1 --2- 172.21.15.158:0/2068598631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa68004690 0x7ffa8014b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:56.127 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.111+0000 7ffa7effd700 1 -- 172.21.15.158:0/2068598631 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa800ba350 con 0x7ffa80160ea0 2023-10-18T17:23:56.128 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.111+0000 7ffa7effd700 1 --2- 172.21.15.158:0/2068598631 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa80160ea0 0x7ffa800c2990 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ffa7401bb60 tx=0x7ffa7401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:56.129 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.115+0000 7ffa677fe700 1 -- 172.21.15.158:0/2068598631 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74020070 con 0x7ffa80160ea0 2023-10-18T17:23:56.129 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.115+0000 7ffa677fe700 1 -- 172.21.15.158:0/2068598631 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7400e9c0 con 0x7ffa80160ea0 2023-10-18T17:23:56.129 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.115+0000 7ffa84879700 1 -- 172.21.15.158:0/2068598631 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa80161300 con 0x7ffa80160ea0 2023-10-18T17:23:56.129 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.115+0000 7ffa677fe700 1 -- 172.21.15.158:0/2068598631 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa740094d0 con 0x7ffa80160ea0 2023-10-18T17:23:56.129 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.115+0000 7ffa84879700 1 -- 172.21.15.158:0/2068598631 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa800ba880 con 0x7ffa80160ea0 2023-10-18T17:23:56.130 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.115+0000 7ffa84879700 1 -- 172.21.15.158:0/2068598631 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8014df30 con 0x7ffa80160ea0 2023-10-18T17:23:56.130 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.115+0000 7ffa677fe700 1 -- 172.21.15.158:0/2068598631 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ffa740123f0 con 0x7ffa80160ea0 2023-10-18T17:23:56.130 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.119+0000 7ffa677fe700 1 --2- 172.21.15.158:0/2068598631 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ffa6c05a540 0x7ffa6c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:56.130 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.119+0000 7ffa677fe700 1 -- 172.21.15.158:0/2068598631 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4892+0+0 (secure 0 0 0) 0x7ffa740753d0 con 0x7ffa80160ea0 2023-10-18T17:23:56.130 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.119+0000 7ffa7f7fe700 1 --2- 172.21.15.158:0/2068598631 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ffa6c05a540 0x7ffa6c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:56.131 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.119+0000 7ffa7f7fe700 1 --2- 172.21.15.158:0/2068598631 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ffa6c05a540 0x7ffa6c05ca00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ffa70000e10 tx=0x7ffa70009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:56.132 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.127+0000 7ffa677fe700 1 -- 172.21.15.158:0/2068598631 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7ffa8014df30 con 0x7ffa80160ea0 2023-10-18T17:23:56.298 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.291+0000 7ffa84879700 1 -- 172.21.15.158:0/2068598631 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa8014df30 con 0x7ffa80160ea0 2023-10-18T17:23:56.299 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.291+0000 7ffa677fe700 1 -- 172.21.15.158:0/2068598631 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+12159 (secure 0 0 0) 0x7ffa8014df30 con 0x7ffa80160ea0 2023-10-18T17:23:56.300 INFO:teuthology.misc.health.smithi158.stdout: 2023-10-18T17:23:56.300 INFO:teuthology.misc.health.smithi158.stdout:{"epoch":14,"fsid":"ca4bb219-38c8-4c5b-a49c-213b123db018","created":"2023-10-18T17:23:45.550173+0000","modified":"2023-10-18T17:23:55.617219+0000","last_up_change":"2023-10-18T17:23:55.617219+0000","last_in_change":"2023-10-18T17:23:47.727646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-18T17:23:54.686216+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"1f621b1e-5ea4-4dc3-80e1-c415c7cc97d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6815","nonce":33195},{"type":"v1","addr":"172.21.15.158:6817","nonce":33195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":33195},{"type":"v1","addr":"172.21.15.158:6819","nonce":33195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":33195},{"type":"v1","addr":"172.21.15.158:6824","nonce":33195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":33195},{"type":"v1","addr":"172.21.15.158:6821","nonce":33195}]},"public_addr":"172.21.15.158:6817/33195","cluster_addr":"172.21.15.158:6819/33195","heartbeat_back_addr":"172.21.15.158:6824/33195","heartbeat_front_addr":"172.21.15.158:6821/33195","state":["exists","up"]},{"osd":1,"uuid":"769d7514-319f-4ac3-8cf3-6f88f4e7da2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6823","nonce":33196},{"type":"v1","addr":"172.21.15.158:6825","nonce":33196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":33196},{"type":"v1","addr":"172.21.15.158:6827","nonce":33196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":33196},{"type":"v1","addr":"172.21.15.158:6831","nonce":33196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":33196},{"type":"v1","addr":"172.21.15.158:6829","nonce":33196}]},"public_addr":"172.21.15.158:6825/33196","cluster_addr":"172.21.15.158:6827/33196","heartbeat_back_addr":"172.21.15.158:6831/33196","heartbeat_front_addr":"172.21.15.158:6829/33196","state":["exists","up"]},{"osd":2,"uuid":"b4459762-309d-454c-bd31-33b90192375f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":33193},{"type":"v1","addr":"172.21.15.158:6809","nonce":33193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":33193},{"type":"v1","addr":"172.21.15.158:6811","nonce":33193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":33193},{"type":"v1","addr":"172.21.15.158:6816","nonce":33193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":33193},{"type":"v1","addr":"172.21.15.158:6813","nonce":33193}]},"public_addr":"172.21.15.158:6809/33193","cluster_addr":"172.21.15.158:6811/33193","heartbeat_back_addr":"172.21.15.158:6816/33193","heartbeat_front_addr":"172.21.15.158:6813/33193","state":["exists","up"]},{"osd":3,"uuid":"7b78a411-1ae9-4051-ae9d-a03abc5a73ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":33194},{"type":"v1","addr":"172.21.15.158:6801","nonce":33194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":33194},{"type":"v1","addr":"172.21.15.158:6803","nonce":33194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":33194},{"type":"v1","addr":"172.21.15.158:6807","nonce":33194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":33194},{"type":"v1","addr":"172.21.15.158:6805","nonce":33194}]},"public_addr":"172.21.15.158:6801/33194","cluster_addr":"172.21.15.158:6803/33194","heartbeat_back_addr":"172.21.15.158:6807/33194","heartbeat_front_addr":"172.21.15.158:6805/33194","state":["exists","up"]},{"osd":4,"uuid":"58005b5f-2742-4ecb-8c3a-a2ae65c7fb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":33897},{"type":"v1","addr":"172.21.15.183:6801","nonce":33897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6803","nonce":33897},{"type":"v1","addr":"172.21.15.183:6805","nonce":33897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":33897},{"type":"v1","addr":"172.21.15.183:6812","nonce":33897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":33897},{"type":"v1","addr":"172.21.15.183:6808","nonce":33897}]},"public_addr":"172.21.15.183:6801/33897","cluster_addr":"172.21.15.183:6805/33897","heartbeat_back_addr":"172.21.15.183:6812/33897","heartbeat_front_addr":"172.21.15.183:6808/33897","state":["exists","up"]},{"osd":5,"uuid":"c0b217ed-1c09-4cde-b192-65624ab3a70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":33898},{"type":"v1","addr":"172.21.15.183:6804","nonce":33898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6807","nonce":33898},{"type":"v1","addr":"172.21.15.183:6809","nonce":33898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":33898},{"type":"v1","addr":"172.21.15.183:6815","nonce":33898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6811","nonce":33898},{"type":"v1","addr":"172.21.15.183:6813","nonce":33898}]},"public_addr":"172.21.15.183:6804/33898","cluster_addr":"172.21.15.183:6809/33898","heartbeat_back_addr":"172.21.15.183:6815/33898","heartbeat_front_addr":"172.21.15.183:6813/33898","state":["exists","up"]},{"osd":6,"uuid":"5f910aac-4091-408b-8b2b-19865b21395c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":33910},{"type":"v1","addr":"172.21.15.183:6825","nonce":33910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":33910},{"type":"v1","addr":"172.21.15.183:6827","nonce":33910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":33910},{"type":"v1","addr":"172.21.15.183:6831","nonce":33910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":33910},{"type":"v1","addr":"172.21.15.183:6829","nonce":33910}]},"public_addr":"172.21.15.183:6825/33910","cluster_addr":"172.21.15.183:6827/33910","heartbeat_back_addr":"172.21.15.183:6831/33910","heartbeat_front_addr":"172.21.15.183:6829/33910","state":["exists","up"]},{"osd":7,"uuid":"96d7b9aa-687e-42e3-a5cf-1533931ecce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":33903},{"type":"v1","addr":"172.21.15.183:6817","nonce":33903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":33903},{"type":"v1","addr":"172.21.15.183:6819","nonce":33903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":33903},{"type":"v1","addr":"172.21.15.183:6823","nonce":33903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":33903},{"type":"v1","addr":"172.21.15.183:6821","nonce":33903}]},"public_addr":"172.21.15.183:6817/33903","cluster_addr":"172.21.15.183:6819/33903","heartbeat_back_addr":"172.21.15.183:6823/33903","heartbeat_front_addr":"172.21.15.183:6821/33903","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.546583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.007074+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:52.994413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.176820+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:52.906075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T17:23:56.302 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.295+0000 7ffa84879700 1 -- 172.21.15.158:0/2068598631 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ffa6c05a540 msgr2=0x7ffa6c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:56.303 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.295+0000 7ffa84879700 1 --2- 172.21.15.158:0/2068598631 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ffa6c05a540 0x7ffa6c05ca00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ffa70000e10 tx=0x7ffa70009040).stop 2023-10-18T17:23:56.303 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.295+0000 7ffa84879700 1 -- 172.21.15.158:0/2068598631 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa80160ea0 msgr2=0x7ffa800c2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:56.303 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.295+0000 7ffa84879700 1 --2- 172.21.15.158:0/2068598631 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa80160ea0 0x7ffa800c2990 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ffa7401bb60 tx=0x7ffa7401a000).stop 2023-10-18T17:23:56.303 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.295+0000 7ffa84879700 1 -- 172.21.15.158:0/2068598631 shutdown_connections 2023-10-18T17:23:56.303 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.295+0000 7ffa84879700 1 --2- 172.21.15.158:0/2068598631 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ffa6c05a540 0x7ffa6c05ca00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:56.304 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.295+0000 7ffa84879700 1 --2- 172.21.15.158:0/2068598631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa800c2e80 0x7ffa8014e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:56.304 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.295+0000 7ffa84879700 1 --2- 172.21.15.158:0/2068598631 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffa80160ea0 0x7ffa800c2990 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:56.304 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.295+0000 7ffa84879700 1 --2- 172.21.15.158:0/2068598631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa68004690 0x7ffa8014b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:56.304 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.295+0000 7ffa84879700 1 -- 172.21.15.158:0/2068598631 >> 172.21.15.158:0/2068598631 conn(0x7ffa8006afa0 msgr2=0x7ffa801498d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:56.304 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.295+0000 7ffa84879700 1 -- 172.21.15.158:0/2068598631 shutdown_connections 2023-10-18T17:23:56.305 INFO:teuthology.misc.health.smithi158.stderr:2023-10-18T17:23:56.295+0000 7ffa84879700 1 -- 172.21.15.158:0/2068598631 wait complete. 2023-10-18T17:23:56.321 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-18T17:23:56.322 INFO:tasks.ceph:Creating RBD pool 2023-10-18T17:23:56.322 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-18T17:23:56.484 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.475+0000 7fe7f441b700 1 Processor -- start 2023-10-18T17:23:56.484 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.479+0000 7fe7f441b700 1 -- start start 2023-10-18T17:23:56.488 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.479+0000 7fe7f441b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe7ec149d80 0x7fe7ec14a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:56.488 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.479+0000 7fe7f441b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe7ec0689e0 0x7fe7ec0661c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:56.488 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.479+0000 7fe7f441b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7ec0c69f0 0x7fe7ec0c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:56.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.479+0000 7fe7f441b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7ec0c7350 con 0x7fe7ec149d80 2023-10-18T17:23:56.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.479+0000 7fe7f441b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7ec1500e0 con 0x7fe7ec0689e0 2023-10-18T17:23:56.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.479+0000 7fe7f441b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec1503c0 con 0x7fe7ec0c69f0 2023-10-18T17:23:56.490 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f21b7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe7ec149d80 0x7fe7ec14a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:56.491 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f21b7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe7ec149d80 0x7fe7ec14a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55474/0 (socket says 172.21.15.158:55474) 2023-10-18T17:23:56.491 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f21b7700 1 -- 172.21.15.158:0/1126410849 learned_addr learned my addr 172.21.15.158:0/1126410849 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:23:56.491 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f19b6700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe7ec0689e0 0x7fe7ec0661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:56.491 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f29b8700 1 --2- 172.21.15.158:0/1126410849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7ec0c69f0 0x7fe7ec0c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:56.492 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f21b7700 1 -- 172.21.15.158:0/1126410849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7ec0c69f0 msgr2=0x7fe7ec0c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:56.492 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f21b7700 1 --2- 172.21.15.158:0/1126410849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7ec0c69f0 0x7fe7ec0c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:56.492 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f21b7700 1 -- 172.21.15.158:0/1126410849 >> v2:172.21.15.183:3300/0 conn(0x7fe7ec0689e0 msgr2=0x7fe7ec0661c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:56.492 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f21b7700 1 --2- 172.21.15.158:0/1126410849 >> v2:172.21.15.183:3300/0 conn(0x7fe7ec0689e0 0x7fe7ec0661c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:56.492 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f21b7700 1 -- 172.21.15.158:0/1126410849 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ec1506a0 con 0x7fe7ec149d80 2023-10-18T17:23:56.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f21b7700 1 --2- 172.21.15.158:0/1126410849 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7ec149d80 0x7fe7ec14a160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe7ec0c0ad0 tx=0x7fe7e80090f0).ready entity=mon.0 client_cookie=363b0c376452a978 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:56.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f11b5700 1 -- 172.21.15.158:0/1126410849 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e800f510 con 0x7fe7ec149d80 2023-10-18T17:23:56.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f11b5700 1 -- 172.21.15.158:0/1126410849 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e800f670 con 0x7fe7ec149d80 2023-10-18T17:23:56.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f11b5700 1 -- 172.21.15.158:0/1126410849 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e800f9f0 con 0x7fe7ec149d80 2023-10-18T17:23:56.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f441b700 1 -- 172.21.15.158:0/1126410849 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7ec149d80 msgr2=0x7fe7ec14a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:56.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f441b700 1 --2- 172.21.15.158:0/1126410849 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7ec149d80 0x7fe7ec14a160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe7ec0c0ad0 tx=0x7fe7e80090f0).stop 2023-10-18T17:23:56.496 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f441b700 1 -- 172.21.15.158:0/1126410849 shutdown_connections 2023-10-18T17:23:56.496 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f441b700 1 --2- 172.21.15.158:0/1126410849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7ec0c69f0 0x7fe7ec0c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:56.496 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f441b700 1 --2- 172.21.15.158:0/1126410849 >> v2:172.21.15.183:3300/0 conn(0x7fe7ec0689e0 0x7fe7ec0661c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:56.496 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f441b700 1 --2- 172.21.15.158:0/1126410849 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7ec149d80 0x7fe7ec14a160 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:56.496 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f441b700 1 -- 172.21.15.158:0/1126410849 >> 172.21.15.158:0/1126410849 conn(0x7fe7ec05dc20 msgr2=0x7fe7ec05e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:56.497 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f441b700 1 -- 172.21.15.158:0/1126410849 shutdown_connections 2023-10-18T17:23:56.497 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.483+0000 7fe7f441b700 1 -- 172.21.15.158:0/1126410849 wait complete. 2023-10-18T17:23:56.497 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.487+0000 7fe7f441b700 1 Processor -- start 2023-10-18T17:23:56.497 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.487+0000 7fe7f441b700 1 -- start start 2023-10-18T17:23:56.497 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.487+0000 7fe7f441b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7ec0689e0 0x7fe7ec1639e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:56.498 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.487+0000 7fe7f441b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7ec0c69f0 0x7fe7ec14f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:56.498 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.487+0000 7fe7f441b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7ec149d80 0x7fe7ec0b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:56.498 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.487+0000 7fe7f441b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec0b4180 con 0x7fe7ec149d80 2023-10-18T17:23:56.498 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.487+0000 7fe7f441b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec160410 con 0x7fe7ec0689e0 2023-10-18T17:23:56.499 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.487+0000 7fe7f441b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec160c50 con 0x7fe7ec0c69f0 2023-10-18T17:23:56.499 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.487+0000 7fe7f21b7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7ec0689e0 0x7fe7ec1639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:56.499 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.487+0000 7fe7f19b6700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7ec0c69f0 0x7fe7ec14f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:56.499 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.487+0000 7fe7f21b7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7ec0689e0 0x7fe7ec1639e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:41600/0 (socket says 172.21.15.158:41600) 2023-10-18T17:23:56.499 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.487+0000 7fe7f21b7700 1 -- 172.21.15.158:0/3766868369 learned_addr learned my addr 172.21.15.158:0/3766868369 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:23:56.499 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.487+0000 7fe7f29b8700 1 --2- 172.21.15.158:0/3766868369 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7ec149d80 0x7fe7ec0b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:56.500 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.487+0000 7fe7f19b6700 1 -- 172.21.15.158:0/3766868369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7ec0689e0 msgr2=0x7fe7ec1639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:56.501 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.487+0000 7fe7f19b6700 1 --2- 172.21.15.158:0/3766868369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7ec0689e0 0x7fe7ec1639e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:56.501 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.487+0000 7fe7f19b6700 1 -- 172.21.15.158:0/3766868369 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7ec149d80 msgr2=0x7fe7ec0b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:56.501 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.487+0000 7fe7f19b6700 1 --2- 172.21.15.158:0/3766868369 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7ec149d80 0x7fe7ec0b5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:56.501 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.487+0000 7fe7f19b6700 1 -- 172.21.15.158:0/3766868369 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e8009370 con 0x7fe7ec0c69f0 2023-10-18T17:23:56.501 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.491+0000 7fe7f19b6700 1 --2- 172.21.15.158:0/3766868369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7ec0c69f0 0x7fe7ec14f270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe7dc00e6f0 tx=0x7fe7dc009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:56.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.491+0000 7fe7e27fc700 1 -- 172.21.15.158:0/3766868369 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc012600 con 0x7fe7ec0c69f0 2023-10-18T17:23:56.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.491+0000 7fe7e27fc700 1 -- 172.21.15.158:0/3766868369 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7dc012760 con 0x7fe7ec0c69f0 2023-10-18T17:23:56.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.491+0000 7fe7e27fc700 1 -- 172.21.15.158:0/3766868369 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc012ae0 con 0x7fe7ec0c69f0 2023-10-18T17:23:56.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.491+0000 7fe7f441b700 1 -- 172.21.15.158:0/3766868369 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7ec0bd870 con 0x7fe7ec0c69f0 2023-10-18T17:23:56.503 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.491+0000 7fe7f441b700 1 -- 172.21.15.158:0/3766868369 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7ec0bde10 con 0x7fe7ec0c69f0 2023-10-18T17:23:56.503 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.491+0000 7fe7f441b700 1 -- 172.21.15.158:0/3766868369 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7ec06c190 con 0x7fe7ec0c69f0 2023-10-18T17:23:56.503 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.495+0000 7fe7e27fc700 1 -- 172.21.15.158:0/3766868369 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe7dc01b400 con 0x7fe7ec0c69f0 2023-10-18T17:23:56.504 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.495+0000 7fe7e27fc700 1 --2- 172.21.15.158:0/3766868369 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fe7d005a510 0x7fe7d005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:56.504 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.495+0000 7fe7e27fc700 1 -- 172.21.15.158:0/3766868369 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4892+0+0 (secure 0 0 0) 0x7fe7dc0746b0 con 0x7fe7ec0c69f0 2023-10-18T17:23:56.504 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.495+0000 7fe7f21b7700 1 --2- 172.21.15.158:0/3766868369 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fe7d005a510 0x7fe7d005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:56.504 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.495+0000 7fe7f21b7700 1 --2- 172.21.15.158:0/3766868369 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fe7d005a510 0x7fe7d005c9d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe7e8009130 tx=0x7fe7e8017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:56.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.503+0000 7fe7e27fc700 1 -- 172.21.15.158:0/3766868369 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fe7dc048240 con 0x7fe7ec0c69f0 2023-10-18T17:23:56.678 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:56.671+0000 7fe7f441b700 1 -- 172.21.15.158:0/3766868369 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fe7ec160d90 con 0x7fe7ec0c69f0 2023-10-18T17:23:57.661 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.655+0000 7fe7e27fc700 1 -- 172.21.15.158:0/3766868369 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7fe7dc04b860 con 0x7fe7ec0c69f0 2023-10-18T17:23:57.666 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.659+0000 7fe7f441b700 1 -- 172.21.15.158:0/3766868369 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fe7d005a510 msgr2=0x7fe7d005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:57.666 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.659+0000 7fe7f441b700 1 --2- 172.21.15.158:0/3766868369 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fe7d005a510 0x7fe7d005c9d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe7e8009130 tx=0x7fe7e8017000).stop 2023-10-18T17:23:57.666 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.659+0000 7fe7f441b700 1 -- 172.21.15.158:0/3766868369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7ec0c69f0 msgr2=0x7fe7ec14f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:57.667 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.659+0000 7fe7f441b700 1 --2- 172.21.15.158:0/3766868369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7ec0c69f0 0x7fe7ec14f270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe7dc00e6f0 tx=0x7fe7dc009060).stop 2023-10-18T17:23:57.667 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.659+0000 7fe7f441b700 1 -- 172.21.15.158:0/3766868369 shutdown_connections 2023-10-18T17:23:57.667 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.659+0000 7fe7f441b700 1 --2- 172.21.15.158:0/3766868369 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fe7d005a510 0x7fe7d005c9d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:57.667 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.659+0000 7fe7f441b700 1 --2- 172.21.15.158:0/3766868369 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe7ec149d80 0x7fe7ec0b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:57.667 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.659+0000 7fe7f441b700 1 --2- 172.21.15.158:0/3766868369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7ec0c69f0 0x7fe7ec14f270 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:57.668 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.659+0000 7fe7f441b700 1 --2- 172.21.15.158:0/3766868369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7ec0689e0 0x7fe7ec1639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:57.668 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.659+0000 7fe7f441b700 1 -- 172.21.15.158:0/3766868369 >> 172.21.15.158:0/3766868369 conn(0x7fe7ec05dc20 msgr2=0x7fe7ec0c2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:57.668 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.659+0000 7fe7f441b700 1 -- 172.21.15.158:0/3766868369 shutdown_connections 2023-10-18T17:23:57.668 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.659+0000 7fe7f441b700 1 -- 172.21.15.158:0/3766868369 wait complete. 2023-10-18T17:23:57.669 INFO:teuthology.orchestra.run.smithi158.stderr:pool 'rbd' created 2023-10-18T17:23:57.687 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-18T17:23:57.837 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.831+0000 7f1516bb9700 1 Processor -- start 2023-10-18T17:23:57.838 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.831+0000 7f1516bb9700 1 -- start start 2023-10-18T17:23:57.840 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.831+0000 7f1516bb9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15100bf060 0x7f15100bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:57.840 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.831+0000 7f1516bb9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f15101541d0 0x7f1510154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:57.840 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.831+0000 7f1516bb9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15100bd5e0 con 0x7f15100bec80 2023-10-18T17:23:57.841 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.831+0000 7f1516bb9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15100666a0 con 0x7f15101541d0 2023-10-18T17:23:57.841 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.831+0000 7f1516bb9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1510066170 con 0x7f15100bf060 2023-10-18T17:23:57.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f15153b6700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15100bf060 0x7f15100bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:57.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f15153b6700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15100bf060 0x7f15100bc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:38740/0 (socket says 172.21.15.158:38740) 2023-10-18T17:23:57.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f15163b8700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f15101541d0 0x7f1510154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:57.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f15153b6700 1 -- 172.21.15.158:0/2087807557 learned_addr learned my addr 172.21.15.158:0/2087807557 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:23:57.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f1515bb7700 1 --1- 172.21.15.158:0/2087807557 >> v1:172.21.15.158:6789/0 conn(0x7f15100bec80 0x7f1510068710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:59128/0 (socket says 172.21.15.158:59128) 2023-10-18T17:23:57.844 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f15153b6700 1 -- 172.21.15.158:0/2087807557 >> v2:172.21.15.183:3300/0 conn(0x7f15101541d0 msgr2=0x7f1510154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:57.844 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f15153b6700 1 --2- 172.21.15.158:0/2087807557 >> v2:172.21.15.183:3300/0 conn(0x7f15101541d0 0x7f1510154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:57.844 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f15153b6700 1 -- 172.21.15.158:0/2087807557 >> v1:172.21.15.158:6789/0 conn(0x7f15100bec80 legacy=0x7f1510068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:57.844 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f15153b6700 1 -- 172.21.15.158:0/2087807557 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1510068280 con 0x7f15100bf060 2023-10-18T17:23:57.844 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f15153b6700 1 --2- 172.21.15.158:0/2087807557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15100bf060 0x7f15100bc8b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f1500006fd0 tx=0x7f15000090f0).ready entity=mon.2 client_cookie=1b71bfb7a3fcf0fe server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:57.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f1514bb5700 1 -- 172.21.15.158:0/2087807557 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150000b580 con 0x7f15100bf060 2023-10-18T17:23:57.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f1514bb5700 1 -- 172.21.15.158:0/2087807557 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150000b6e0 con 0x7f15100bf060 2023-10-18T17:23:57.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f1514bb5700 1 -- 172.21.15.158:0/2087807557 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150000ba60 con 0x7f15100bf060 2023-10-18T17:23:57.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f1516bb9700 1 -- 172.21.15.158:0/2087807557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15100bf060 msgr2=0x7f15100bc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:57.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f1516bb9700 1 --2- 172.21.15.158:0/2087807557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15100bf060 0x7f15100bc8b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f1500006fd0 tx=0x7f15000090f0).stop 2023-10-18T17:23:57.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f1516bb9700 1 -- 172.21.15.158:0/2087807557 shutdown_connections 2023-10-18T17:23:57.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f1516bb9700 1 --2- 172.21.15.158:0/2087807557 >> v2:172.21.15.183:3300/0 conn(0x7f15101541d0 0x7f1510154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:57.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f1516bb9700 1 --2- 172.21.15.158:0/2087807557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15100bf060 0x7f15100bc8b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:57.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f1516bb9700 1 -- 172.21.15.158:0/2087807557 >> 172.21.15.158:0/2087807557 conn(0x7f15100645a0 msgr2=0x7f15100649b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:57.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.835+0000 7f1516bb9700 1 -- 172.21.15.158:0/2087807557 shutdown_connections 2023-10-18T17:23:57.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.839+0000 7f1516bb9700 1 -- 172.21.15.158:0/2087807557 wait complete. 2023-10-18T17:23:57.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.839+0000 7f1516bb9700 1 Processor -- start 2023-10-18T17:23:57.849 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.839+0000 7f1516bb9700 1 -- start start 2023-10-18T17:23:57.849 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f1516bb9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15100bec80 0x7f1510167c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:57.849 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f1516bb9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15101541d0 0x7f151014fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:57.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f1516bb9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1510168170 0x7f15101670a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:57.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f1516bb9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1510166c10 con 0x7f1510168170 2023-10-18T17:23:57.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f1516bb9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1510162480 con 0x7f15100bec80 2023-10-18T17:23:57.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f1516bb9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1510165d20 con 0x7f15101541d0 2023-10-18T17:23:57.852 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f15163b8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1510168170 0x7f15101670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:57.852 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f1515bb7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15100bec80 0x7f1510167c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:57.852 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f15163b8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1510168170 0x7f15101670a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55492/0 (socket says 172.21.15.158:55492) 2023-10-18T17:23:57.852 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f15163b8700 1 -- 172.21.15.158:0/3568622535 learned_addr learned my addr 172.21.15.158:0/3568622535 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:23:57.853 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f15153b6700 1 --2- 172.21.15.158:0/3568622535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15101541d0 0x7f151014fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:57.853 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f15163b8700 1 -- 172.21.15.158:0/3568622535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15101541d0 msgr2=0x7f151014fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:57.853 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f15163b8700 1 --2- 172.21.15.158:0/3568622535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15101541d0 0x7f151014fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:57.853 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f15163b8700 1 -- 172.21.15.158:0/3568622535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15100bec80 msgr2=0x7f1510167c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:57.853 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f15163b8700 1 --2- 172.21.15.158:0/3568622535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15100bec80 0x7f1510167c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:57.854 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f15163b8700 1 -- 172.21.15.158:0/3568622535 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1500009370 con 0x7f1510168170 2023-10-18T17:23:57.854 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f15163b8700 1 --2- 172.21.15.158:0/3568622535 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1510168170 0x7f15101670a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f1508009e90 tx=0x7f150800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:57.854 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f1505ffb700 1 -- 172.21.15.158:0/3568622535 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150800caa0 con 0x7f1510168170 2023-10-18T17:23:57.854 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f1505ffb700 1 -- 172.21.15.158:0/3568622535 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150800f040 con 0x7f1510168170 2023-10-18T17:23:57.854 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f1505ffb700 1 -- 172.21.15.158:0/3568622535 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150800ce10 con 0x7f1510168170 2023-10-18T17:23:57.855 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f1516bb9700 1 -- 172.21.15.158:0/3568622535 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1510166000 con 0x7f1510168170 2023-10-18T17:23:57.855 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.843+0000 7f1516bb9700 1 -- 172.21.15.158:0/3568622535 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15101665c0 con 0x7f1510168170 2023-10-18T17:23:57.855 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.847+0000 7f1516bb9700 1 -- 172.21.15.158:0/3568622535 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1510166d80 con 0x7f1510168170 2023-10-18T17:23:57.856 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.847+0000 7f1505ffb700 1 -- 172.21.15.158:0/3568622535 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1508013610 con 0x7f1510168170 2023-10-18T17:23:57.856 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.851+0000 7f1505ffb700 1 --2- 172.21.15.158:0/3568622535 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f14f405a510 0x7f14f405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:57.857 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.851+0000 7f1505ffb700 1 -- 172.21.15.158:0/3568622535 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5258+0+0 (secure 0 0 0) 0x7f1508074cd0 con 0x7f1510168170 2023-10-18T17:23:57.857 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.851+0000 7f1515bb7700 1 --2- 172.21.15.158:0/3568622535 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f14f405a510 0x7f14f405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:57.858 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.851+0000 7f1515bb7700 1 --2- 172.21.15.158:0/3568622535 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f14f405a510 0x7f14f405c9d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f150c007fd0 tx=0x7f150c007d30).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:57.864 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:57.859+0000 7f1505ffb700 1 -- 172.21.15.158:0/3568622535 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f1508048810 con 0x7f1510168170 2023-10-18T17:23:58.026 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.019+0000 7f1516bb9700 1 -- 172.21.15.158:0/3568622535 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1510046f00 con 0x7f1510168170 2023-10-18T17:23:58.672 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.667+0000 7f1505ffb700 1 -- 172.21.15.158:0/3568622535 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f150804be30 con 0x7f1510168170 2023-10-18T17:23:58.679 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.671+0000 7f1516bb9700 1 -- 172.21.15.158:0/3568622535 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f14f405a510 msgr2=0x7f14f405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:58.679 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.671+0000 7f1516bb9700 1 --2- 172.21.15.158:0/3568622535 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f14f405a510 0x7f14f405c9d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f150c007fd0 tx=0x7f150c007d30).stop 2023-10-18T17:23:58.679 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.671+0000 7f1516bb9700 1 -- 172.21.15.158:0/3568622535 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1510168170 msgr2=0x7f15101670a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:58.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.671+0000 7f1516bb9700 1 --2- 172.21.15.158:0/3568622535 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1510168170 0x7f15101670a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f1508009e90 tx=0x7f150800b040).stop 2023-10-18T17:23:58.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.671+0000 7f1516bb9700 1 -- 172.21.15.158:0/3568622535 shutdown_connections 2023-10-18T17:23:58.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.671+0000 7f1516bb9700 1 --2- 172.21.15.158:0/3568622535 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f14f405a510 0x7f14f405c9d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:58.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.671+0000 7f1516bb9700 1 --2- 172.21.15.158:0/3568622535 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1510168170 0x7f15101670a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:58.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.671+0000 7f1516bb9700 1 --2- 172.21.15.158:0/3568622535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15101541d0 0x7f151014fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:58.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.671+0000 7f1516bb9700 1 --2- 172.21.15.158:0/3568622535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15100bec80 0x7f1510167c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:58.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.671+0000 7f1516bb9700 1 -- 172.21.15.158:0/3568622535 >> 172.21.15.158:0/3568622535 conn(0x7f15100645a0 msgr2=0x7f1510152070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:58.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.671+0000 7f1516bb9700 1 -- 172.21.15.158:0/3568622535 shutdown_connections 2023-10-18T17:23:58.682 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.671+0000 7f1516bb9700 1 -- 172.21.15.158:0/3568622535 wait complete. 2023-10-18T17:23:58.683 INFO:teuthology.orchestra.run.smithi158.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-18T17:23:58.700 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-18T17:23:58.701 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-18T17:23:58.701 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-18T17:23:58.708 INFO:tasks.ceph.mds.a:Started 2023-10-18T17:23:58.708 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-18T17:23:58.708 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-18T17:23:58.713 INFO:tasks.ceph.mds.c:Started 2023-10-18T17:23:58.713 INFO:tasks.ceph.mds.e:Restarting daemon 2023-10-18T17:23:58.714 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2023-10-18T17:23:58.719 INFO:tasks.ceph.mds.e:Started 2023-10-18T17:23:58.719 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-18T17:23:58.719 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-18T17:23:58.722 INFO:tasks.ceph.mds.b:Started 2023-10-18T17:23:58.722 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-18T17:23:58.722 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-18T17:23:58.725 INFO:tasks.ceph.mds.d:Started 2023-10-18T17:23:58.725 INFO:tasks.ceph.mds.f:Restarting daemon 2023-10-18T17:23:58.725 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2023-10-18T17:23:58.728 INFO:tasks.ceph.mds.f:Started 2023-10-18T17:23:58.728 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-18T17:23:58.728 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T17:23:58.795 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-10-18T17:23:58.801 INFO:tasks.ceph.mds.f.smithi183.stdout:starting mds.f at 2023-10-18T17:23:58.809 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-10-18T17:23:58.810 INFO:tasks.ceph.mds.c.smithi158.stdout:starting mds.c at 2023-10-18T17:23:58.814 INFO:tasks.ceph.mds.e.smithi158.stdout:starting mds.e at 2023-10-18T17:23:58.818 INFO:tasks.ceph.mds.a.smithi158.stdout:starting mds.a at 2023-10-18T17:23:58.879 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.871+0000 7f9280d47700 1 Processor -- start 2023-10-18T17:23:58.879 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.871+0000 7f9280d47700 1 -- start start 2023-10-18T17:23:58.881 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.875+0000 7f9280d47700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f927c066340 0x7f927c062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:58.882 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.875+0000 7f9280d47700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f927c14d020 0x7f927c14d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:58.882 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.875+0000 7f9280d47700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927c0c1610 con 0x7f927c062270 2023-10-18T17:23:58.882 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.875+0000 7f9280d47700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927c14d980 con 0x7f927c066340 2023-10-18T17:23:58.882 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.875+0000 7f9280d47700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927c0c2dd0 con 0x7f927c14d020 2023-10-18T17:23:58.882 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.875+0000 7f927b7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f927c062270 0x7f927c0c0f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:59160/0 (socket says 172.21.15.158:59160) 2023-10-18T17:23:58.883 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.875+0000 7f927b7fe700 1 -- 172.21.15.158:0/1001171171 learned_addr learned my addr 172.21.15.158:0/1001171171 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:23:58.884 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.875+0000 7f9273fff700 1 --2- 172.21.15.158:0/1001171171 >> v2:172.21.15.158:3300/0 conn(0x7f927c066340 0x7f927c062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:58.884 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.875+0000 7f927bfff700 1 --2- 172.21.15.158:0/1001171171 >> v2:172.21.15.183:3300/0 conn(0x7f927c14d020 0x7f927c14d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:58.884 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.875+0000 7f927affd700 1 -- 172.21.15.158:0/1001171171 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88665986 0 0) 0x7f927c0c1610 con 0x7f927c062270 2023-10-18T17:23:58.885 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.875+0000 7f927affd700 1 -- 172.21.15.158:0/1001171171 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92680033f0 con 0x7f927c062270 2023-10-18T17:23:58.885 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.875+0000 7f9273fff700 1 -- 172.21.15.158:0/1001171171 >> v2:172.21.15.183:3300/0 conn(0x7f927c14d020 msgr2=0x7f927c14d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:58.885 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.875+0000 7f9273fff700 1 --2- 172.21.15.158:0/1001171171 >> v2:172.21.15.183:3300/0 conn(0x7f927c14d020 0x7f927c14d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:58.885 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.875+0000 7f9273fff700 1 -- 172.21.15.158:0/1001171171 >> v1:172.21.15.158:6789/0 conn(0x7f927c062270 legacy=0x7f927c0c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:58.885 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.875+0000 7f9273fff700 1 -- 172.21.15.158:0/1001171171 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c153570 con 0x7f927c066340 2023-10-18T17:23:58.886 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.875+0000 7f9273fff700 1 --2- 172.21.15.158:0/1001171171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f927c066340 0x7f927c062650 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f927c05e980 tx=0x7f9264009060).ready entity=mon.0 client_cookie=c702a74ae262d7a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:58.886 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.875+0000 7f927affd700 1 -- 172.21.15.158:0/1001171171 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926400f510 con 0x7f927c066340 2023-10-18T17:23:58.886 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.879+0000 7f927affd700 1 -- 172.21.15.158:0/1001171171 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926400f670 con 0x7f927c066340 2023-10-18T17:23:58.886 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.879+0000 7f927affd700 1 -- 172.21.15.158:0/1001171171 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926400f9f0 con 0x7f927c066340 2023-10-18T17:23:58.887 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.879+0000 7f9280d47700 1 -- 172.21.15.158:0/1001171171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f927c066340 msgr2=0x7f927c062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:58.888 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.879+0000 7f9280d47700 1 --2- 172.21.15.158:0/1001171171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f927c066340 0x7f927c062650 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f927c05e980 tx=0x7f9264009060).stop 2023-10-18T17:23:58.888 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.879+0000 7f9280d47700 1 -- 172.21.15.158:0/1001171171 shutdown_connections 2023-10-18T17:23:58.888 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.879+0000 7f9280d47700 1 --2- 172.21.15.158:0/1001171171 >> v2:172.21.15.183:3300/0 conn(0x7f927c14d020 0x7f927c14d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:58.888 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.879+0000 7f9280d47700 1 --2- 172.21.15.158:0/1001171171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f927c066340 0x7f927c062650 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:58.888 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.879+0000 7f9280d47700 1 -- 172.21.15.158:0/1001171171 >> 172.21.15.158:0/1001171171 conn(0x7f927c05ddc0 msgr2=0x7f927c05e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:58.889 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.879+0000 7f9280d47700 1 -- 172.21.15.158:0/1001171171 shutdown_connections 2023-10-18T17:23:58.889 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.879+0000 7f9280d47700 1 -- 172.21.15.158:0/1001171171 wait complete. 2023-10-18T17:23:58.889 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.879+0000 7f9280d47700 1 Processor -- start 2023-10-18T17:23:58.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.879+0000 7f9280d47700 1 -- start start 2023-10-18T17:23:58.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f9280d47700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f927c062270 0x7f927c150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:58.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f9280d47700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f927c066340 0x7f927c161430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:58.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f9280d47700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f927c14d020 0x7f927c14f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:58.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f9280d47700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c14eba0 con 0x7f927c062270 2023-10-18T17:23:58.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f9280d47700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c14dfd0 con 0x7f927c14d020 2023-10-18T17:23:58.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f9280d47700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927c14e270 con 0x7f927c066340 2023-10-18T17:23:58.893 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f927b7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f927c062270 0x7f927c150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:58.893 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f927b7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f927c062270 0x7f927c150090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55562/0 (socket says 172.21.15.158:55562) 2023-10-18T17:23:58.893 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f927b7fe700 1 -- 172.21.15.158:0/1031282612 learned_addr learned my addr 172.21.15.158:0/1031282612 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:23:58.893 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f927bfff700 1 --2- 172.21.15.158:0/1031282612 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f927c14d020 0x7f927c14f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:58.893 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f9273fff700 1 --2- 172.21.15.158:0/1031282612 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f927c066340 0x7f927c161430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:58.894 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f927b7fe700 1 -- 172.21.15.158:0/1031282612 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f927c066340 msgr2=0x7f927c161430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:58.894 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f927b7fe700 1 --2- 172.21.15.158:0/1031282612 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f927c066340 0x7f927c161430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:58.894 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f927b7fe700 1 -- 172.21.15.158:0/1031282612 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f927c14d020 msgr2=0x7f927c14f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:58.894 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f927b7fe700 1 --2- 172.21.15.158:0/1031282612 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f927c14d020 0x7f927c14f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:58.894 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f927b7fe700 1 -- 172.21.15.158:0/1031282612 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92640092a0 con 0x7f927c062270 2023-10-18T17:23:58.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f9273fff700 1 --2- 172.21.15.158:0/1031282612 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f927c066340 0x7f927c161430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T17:23:58.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f927b7fe700 1 --2- 172.21.15.158:0/1031282612 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f927c062270 0x7f927c150090 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f926c00c590 tx=0x7f926c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:58.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f92737fe700 1 -- 172.21.15.158:0/1031282612 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c007e40 con 0x7f927c062270 2023-10-18T17:23:58.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f92737fe700 1 -- 172.21.15.158:0/1031282612 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926c0072e0 con 0x7f927c062270 2023-10-18T17:23:58.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f9280d47700 1 -- 172.21.15.158:0/1031282612 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927c14e550 con 0x7f927c062270 2023-10-18T17:23:58.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f92737fe700 1 -- 172.21.15.158:0/1031282612 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c0057a0 con 0x7f927c062270 2023-10-18T17:23:58.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.883+0000 7f9280d47700 1 -- 172.21.15.158:0/1031282612 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927c1510f0 con 0x7f927c062270 2023-10-18T17:23:58.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.887+0000 7f9280d47700 1 -- 172.21.15.158:0/1031282612 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927c046f00 con 0x7f927c062270 2023-10-18T17:23:58.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.887+0000 7f92737fe700 1 -- 172.21.15.158:0/1031282612 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f926c005b90 con 0x7f927c062270 2023-10-18T17:23:58.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.887+0000 7f92737fe700 1 --2- 172.21.15.158:0/1031282612 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f925c05a540 0x7f925c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:58.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.887+0000 7f92737fe700 1 -- 172.21.15.158:0/1031282612 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f926c073dd0 con 0x7f927c062270 2023-10-18T17:23:58.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.887+0000 7f9273fff700 1 --2- 172.21.15.158:0/1031282612 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f925c05a540 0x7f925c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:58.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.891+0000 7f9273fff700 1 --2- 172.21.15.158:0/1031282612 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f925c05a540 0x7f925c05ca00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f927c05e980 tx=0x7f9264017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:58.902 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:58.895+0000 7f92737fe700 1 -- 172.21.15.158:0/1031282612 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f926c0478c0 con 0x7f927c062270 2023-10-18T17:23:59.064 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.059+0000 7f9280d47700 1 -- 172.21.15.158:0/1031282612 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f927c153850 con 0x7f927c062270 2023-10-18T17:23:59.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.059+0000 7f92737fe700 1 -- 172.21.15.158:0/1031282612 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13770 (secure 0 0 0) 0x7f926c04aee0 con 0x7f927c062270 2023-10-18T17:23:59.067 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:23:59.067 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":17,"fsid":"ca4bb219-38c8-4c5b-a49c-213b123db018","created":"2023-10-18T17:23:45.550173+0000","modified":"2023-10-18T17:23:58.655553+0000","last_up_change":"2023-10-18T17:23:55.617219+0000","last_in_change":"2023-10-18T17:23:47.727646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-18T17:23:54.686216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T17:23:56.743672+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1f621b1e-5ea4-4dc3-80e1-c415c7cc97d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6815","nonce":33195},{"type":"v1","addr":"172.21.15.158:6817","nonce":33195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":33195},{"type":"v1","addr":"172.21.15.158:6819","nonce":33195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":33195},{"type":"v1","addr":"172.21.15.158:6824","nonce":33195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":33195},{"type":"v1","addr":"172.21.15.158:6821","nonce":33195}]},"public_addr":"172.21.15.158:6817/33195","cluster_addr":"172.21.15.158:6819/33195","heartbeat_back_addr":"172.21.15.158:6824/33195","heartbeat_front_addr":"172.21.15.158:6821/33195","state":["exists","up"]},{"osd":1,"uuid":"769d7514-319f-4ac3-8cf3-6f88f4e7da2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6823","nonce":33196},{"type":"v1","addr":"172.21.15.158:6825","nonce":33196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":33196},{"type":"v1","addr":"172.21.15.158:6827","nonce":33196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":33196},{"type":"v1","addr":"172.21.15.158:6831","nonce":33196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":33196},{"type":"v1","addr":"172.21.15.158:6829","nonce":33196}]},"public_addr":"172.21.15.158:6825/33196","cluster_addr":"172.21.15.158:6827/33196","heartbeat_back_addr":"172.21.15.158:6831/33196","heartbeat_front_addr":"172.21.15.158:6829/33196","state":["exists","up"]},{"osd":2,"uuid":"b4459762-309d-454c-bd31-33b90192375f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":33193},{"type":"v1","addr":"172.21.15.158:6809","nonce":33193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":33193},{"type":"v1","addr":"172.21.15.158:6811","nonce":33193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":33193},{"type":"v1","addr":"172.21.15.158:6816","nonce":33193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":33193},{"type":"v1","addr":"172.21.15.158:6813","nonce":33193}]},"public_addr":"172.21.15.158:6809/33193","cluster_addr":"172.21.15.158:6811/33193","heartbeat_back_addr":"172.21.15.158:6816/33193","heartbeat_front_addr":"172.21.15.158:6813/33193","state":["exists","up"]},{"osd":3,"uuid":"7b78a411-1ae9-4051-ae9d-a03abc5a73ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":33194},{"type":"v1","addr":"172.21.15.158:6801","nonce":33194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":33194},{"type":"v1","addr":"172.21.15.158:6803","nonce":33194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":33194},{"type":"v1","addr":"172.21.15.158:6807","nonce":33194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":33194},{"type":"v1","addr":"172.21.15.158:6805","nonce":33194}]},"public_addr":"172.21.15.158:6801/33194","cluster_addr":"172.21.15.158:6803/33194","heartbeat_back_addr":"172.21.15.158:6807/33194","heartbeat_front_addr":"172.21.15.158:6805/33194","state":["exists","up"]},{"osd":4,"uuid":"58005b5f-2742-4ecb-8c3a-a2ae65c7fb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":33897},{"type":"v1","addr":"172.21.15.183:6801","nonce":33897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6803","nonce":33897},{"type":"v1","addr":"172.21.15.183:6805","nonce":33897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":33897},{"type":"v1","addr":"172.21.15.183:6812","nonce":33897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":33897},{"type":"v1","addr":"172.21.15.183:6808","nonce":33897}]},"public_addr":"172.21.15.183:6801/33897","cluster_addr":"172.21.15.183:6805/33897","heartbeat_back_addr":"172.21.15.183:6812/33897","heartbeat_front_addr":"172.21.15.183:6808/33897","state":["exists","up"]},{"osd":5,"uuid":"c0b217ed-1c09-4cde-b192-65624ab3a70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":33898},{"type":"v1","addr":"172.21.15.183:6804","nonce":33898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6807","nonce":33898},{"type":"v1","addr":"172.21.15.183:6809","nonce":33898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":33898},{"type":"v1","addr":"172.21.15.183:6815","nonce":33898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6811","nonce":33898},{"type":"v1","addr":"172.21.15.183:6813","nonce":33898}]},"public_addr":"172.21.15.183:6804/33898","cluster_addr":"172.21.15.183:6809/33898","heartbeat_back_addr":"172.21.15.183:6815/33898","heartbeat_front_addr":"172.21.15.183:6813/33898","state":["exists","up"]},{"osd":6,"uuid":"5f910aac-4091-408b-8b2b-19865b21395c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":33910},{"type":"v1","addr":"172.21.15.183:6825","nonce":33910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":33910},{"type":"v1","addr":"172.21.15.183:6827","nonce":33910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":33910},{"type":"v1","addr":"172.21.15.183:6831","nonce":33910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":33910},{"type":"v1","addr":"172.21.15.183:6829","nonce":33910}]},"public_addr":"172.21.15.183:6825/33910","cluster_addr":"172.21.15.183:6827/33910","heartbeat_back_addr":"172.21.15.183:6831/33910","heartbeat_front_addr":"172.21.15.183:6829/33910","state":["exists","up"]},{"osd":7,"uuid":"96d7b9aa-687e-42e3-a5cf-1533931ecce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":33903},{"type":"v1","addr":"172.21.15.183:6817","nonce":33903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":33903},{"type":"v1","addr":"172.21.15.183:6819","nonce":33903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":33903},{"type":"v1","addr":"172.21.15.183:6823","nonce":33903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":33903},{"type":"v1","addr":"172.21.15.183:6821","nonce":33903}]},"public_addr":"172.21.15.183:6817/33903","cluster_addr":"172.21.15.183:6819/33903","heartbeat_back_addr":"172.21.15.183:6823/33903","heartbeat_front_addr":"172.21.15.183:6821/33903","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.622366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.713036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.561097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.546583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.007074+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:52.994413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.176820+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:52.906075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T17:23:59.069 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.063+0000 7f9280d47700 1 -- 172.21.15.158:0/1031282612 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f925c05a540 msgr2=0x7f925c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:59.070 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.063+0000 7f9280d47700 1 --2- 172.21.15.158:0/1031282612 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f925c05a540 0x7f925c05ca00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f927c05e980 tx=0x7f9264017000).stop 2023-10-18T17:23:59.070 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.063+0000 7f9280d47700 1 -- 172.21.15.158:0/1031282612 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f927c062270 msgr2=0x7f927c150090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:59.070 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.063+0000 7f9280d47700 1 --2- 172.21.15.158:0/1031282612 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f927c062270 0x7f927c150090 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f926c00c590 tx=0x7f926c007c80).stop 2023-10-18T17:23:59.070 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.063+0000 7f9280d47700 1 -- 172.21.15.158:0/1031282612 shutdown_connections 2023-10-18T17:23:59.070 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.063+0000 7f9280d47700 1 --2- 172.21.15.158:0/1031282612 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f925c05a540 0x7f925c05ca00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.071 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.063+0000 7f9280d47700 1 --2- 172.21.15.158:0/1031282612 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f927c14d020 0x7f927c14f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.071 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.063+0000 7f9280d47700 1 --2- 172.21.15.158:0/1031282612 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f927c066340 0x7f927c161430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.071 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.063+0000 7f9280d47700 1 --2- 172.21.15.158:0/1031282612 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f927c062270 0x7f927c150090 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.071 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.063+0000 7f9280d47700 1 -- 172.21.15.158:0/1031282612 >> 172.21.15.158:0/1031282612 conn(0x7f927c05ddc0 msgr2=0x7f927c14af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:59.071 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.063+0000 7f9280d47700 1 -- 172.21.15.158:0/1031282612 shutdown_connections 2023-10-18T17:23:59.071 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.063+0000 7f9280d47700 1 -- 172.21.15.158:0/1031282612 wait complete. 2023-10-18T17:23:59.088 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-18T17:23:54.686216+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T17:23:56.743672+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-18T17:23:59.089 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-18T17:23:59.256 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.251+0000 7f255101b700 1 Processor -- start 2023-10-18T17:23:59.257 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.251+0000 7f255101b700 1 -- start start 2023-10-18T17:23:59.259 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.251+0000 7f255101b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f254c0bfd50 0x7f254c0c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:59.259 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.251+0000 7f255101b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254c0c4b60 con 0x7f254c0c4290 2023-10-18T17:23:59.259 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.251+0000 7f255101b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254c153720 con 0x7f254c068700 2023-10-18T17:23:59.259 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.251+0000 7f255101b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254c068c30 con 0x7f254c0bfd50 2023-10-18T17:23:59.261 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.251+0000 7f254ad9d700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f254c0c4290 0x7f254c067ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:58630/0 (socket says 172.21.15.158:58630) 2023-10-18T17:23:59.261 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.251+0000 7f254ad9d700 1 -- 172.21.15.158:0/958940939 learned_addr learned my addr 172.21.15.158:0/958940939 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:23:59.262 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.251+0000 7f254a59c700 1 --2- 172.21.15.158:0/958940939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f254c0bfd50 0x7f254c0c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:59.262 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.251+0000 7f2549d9b700 1 -- 172.21.15.158:0/958940939 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133106002 0 0) 0x7f254c0c4b60 con 0x7f254c0c4290 2023-10-18T17:23:59.262 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.251+0000 7f2549d9b700 1 -- 172.21.15.158:0/958940939 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25340033f0 con 0x7f254c0c4290 2023-10-18T17:23:59.263 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.255+0000 7f2549d9b700 1 -- 172.21.15.158:0/958940939 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019415555 0 0) 0x7f254c153720 con 0x7f254c068700 2023-10-18T17:23:59.263 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.255+0000 7f2549d9b700 1 -- 172.21.15.158:0/958940939 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f254c0c4b60 con 0x7f254c068700 2023-10-18T17:23:59.263 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.255+0000 7f254a59c700 1 -- 172.21.15.158:0/958940939 >> v1:172.21.15.183:6789/0 conn(0x7f254c068700 legacy=0x7f254c0c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:59.264 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.255+0000 7f254a59c700 1 -- 172.21.15.158:0/958940939 >> v1:172.21.15.158:6789/0 conn(0x7f254c0c4290 legacy=0x7f254c067ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:59.264 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.255+0000 7f254a59c700 1 -- 172.21.15.158:0/958940939 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c153a00 con 0x7f254c0bfd50 2023-10-18T17:23:59.264 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.255+0000 7f254a59c700 1 --2- 172.21.15.158:0/958940939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f254c0bfd50 0x7f254c0c4670 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2540009790 tx=0x7f2540009060).ready entity=mon.2 client_cookie=9049e8dc878884c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:59.264 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.255+0000 7f2549d9b700 1 -- 172.21.15.158:0/958940939 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254000f510 con 0x7f254c0bfd50 2023-10-18T17:23:59.265 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.255+0000 7f2549d9b700 1 -- 172.21.15.158:0/958940939 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254000f670 con 0x7f254c0bfd50 2023-10-18T17:23:59.265 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.255+0000 7f2549d9b700 1 -- 172.21.15.158:0/958940939 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254000f9f0 con 0x7f254c0bfd50 2023-10-18T17:23:59.267 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.255+0000 7f255101b700 1 -- 172.21.15.158:0/958940939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f254c0bfd50 msgr2=0x7f254c0c4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:59.267 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.255+0000 7f255101b700 1 --2- 172.21.15.158:0/958940939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f254c0bfd50 0x7f254c0c4670 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2540009790 tx=0x7f2540009060).stop 2023-10-18T17:23:59.268 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.255+0000 7f255101b700 1 -- 172.21.15.158:0/958940939 shutdown_connections 2023-10-18T17:23:59.268 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.255+0000 7f255101b700 1 --2- 172.21.15.158:0/958940939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f254c0bfd50 0x7f254c0c4670 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.268 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.255+0000 7f255101b700 1 -- 172.21.15.158:0/958940939 >> 172.21.15.158:0/958940939 conn(0x7f254c0667b0 msgr2=0x7f254c066bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:59.269 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.255+0000 7f255101b700 1 -- 172.21.15.158:0/958940939 shutdown_connections 2023-10-18T17:23:59.269 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.255+0000 7f255101b700 1 -- 172.21.15.158:0/958940939 wait complete. 2023-10-18T17:23:59.269 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.259+0000 7f255101b700 1 Processor -- start 2023-10-18T17:23:59.270 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.259+0000 7f255101b700 1 -- start start 2023-10-18T17:23:59.272 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f255101b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f254c068700 0x7f254c0a8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:59.272 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f255101b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f254c0bfd50 0x7f254c148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:59.272 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f255101b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f254c0c4290 0x7f254c14de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:59.273 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f255101b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c0bdeb0 con 0x7f254c0c4290 2023-10-18T17:23:59.273 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f255101b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c0be190 con 0x7f254c0bfd50 2023-10-18T17:23:59.273 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f255101b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254c149c00 con 0x7f254c068700 2023-10-18T17:23:59.273 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f254b59e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f254c0c4290 0x7f254c14de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:59.273 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f254ad9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f254c068700 0x7f254c0a8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:59.273 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f254a59c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f254c0bfd50 0x7f254c148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:59.274 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f254b59e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f254c0c4290 0x7f254c14de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56400/0 (socket says 172.21.15.158:56400) 2023-10-18T17:23:59.274 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f254ad9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f254c068700 0x7f254c0a8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:37974/0 (socket says 172.21.15.158:37974) 2023-10-18T17:23:59.274 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f254b59e700 1 -- 172.21.15.158:0/3533621583 learned_addr learned my addr 172.21.15.158:0/3533621583 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:23:59.274 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f254ad9d700 1 -- 172.21.15.158:0/3533621583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f254c0bfd50 msgr2=0x7f254c148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:59.275 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f254ad9d700 1 --2- 172.21.15.158:0/3533621583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f254c0bfd50 0x7f254c148f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.275 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f254ad9d700 1 -- 172.21.15.158:0/3533621583 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f254c0c4290 msgr2=0x7f254c14de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:59.275 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f254ad9d700 1 --2- 172.21.15.158:0/3533621583 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f254c0c4290 0x7f254c14de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.275 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f254ad9d700 1 -- 172.21.15.158:0/3533621583 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25400092a0 con 0x7f254c068700 2023-10-18T17:23:59.276 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f254ad9d700 1 --2- 172.21.15.158:0/3533621583 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f254c068700 0x7f254c0a8ad0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f253c00c3f0 tx=0x7f253c007bf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:59.276 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f2532ffd700 1 -- 172.21.15.158:0/3533621583 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c0070d0 con 0x7f254c068700 2023-10-18T17:23:59.276 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f2532ffd700 1 -- 172.21.15.158:0/3533621583 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253c007230 con 0x7f254c068700 2023-10-18T17:23:59.276 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f255101b700 1 -- 172.21.15.158:0/3533621583 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254c149ee0 con 0x7f254c068700 2023-10-18T17:23:59.276 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f2532ffd700 1 -- 172.21.15.158:0/3533621583 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c0075b0 con 0x7f254c068700 2023-10-18T17:23:59.277 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.263+0000 7f255101b700 1 -- 172.21.15.158:0/3533621583 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254c156420 con 0x7f254c068700 2023-10-18T17:23:59.277 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.267+0000 7f255101b700 1 -- 172.21.15.158:0/3533621583 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f254c14a3c0 con 0x7f254c068700 2023-10-18T17:23:59.278 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.267+0000 7f2532ffd700 1 -- 172.21.15.158:0/3533621583 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f253c0059b0 con 0x7f254c068700 2023-10-18T17:23:59.278 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.267+0000 7f2532ffd700 1 --2- 172.21.15.158:0/3533621583 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f253805a540 0x7f253805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:59.278 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.267+0000 7f2532ffd700 1 -- 172.21.15.158:0/3533621583 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f253c073a20 con 0x7f254c068700 2023-10-18T17:23:59.278 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.267+0000 7f254a59c700 1 --2- 172.21.15.158:0/3533621583 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f253805a540 0x7f253805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:59.279 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.271+0000 7f254a59c700 1 --2- 172.21.15.158:0/3533621583 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f253805a540 0x7f253805ca00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f254c0c0150 tx=0x7f2540017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:59.286 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.279+0000 7f2532ffd700 1 -- 172.21.15.158:0/3533621583 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f253c047600 con 0x7f254c068700 2023-10-18T17:23:59.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.451+0000 7f255101b700 1 -- 172.21.15.158:0/3533621583 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f254c06c190 con 0x7f254c068700 2023-10-18T17:23:59.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.451+0000 7f2532ffd700 1 -- 172.21.15.158:0/3533621583 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f253c04ac20 con 0x7f254c068700 2023-10-18T17:23:59.458 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 1 2023-10-18T17:23:59.461 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.455+0000 7f255101b700 1 -- 172.21.15.158:0/3533621583 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f253805a540 msgr2=0x7f253805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:59.461 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.455+0000 7f255101b700 1 --2- 172.21.15.158:0/3533621583 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f253805a540 0x7f253805ca00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f254c0c0150 tx=0x7f2540017000).stop 2023-10-18T17:23:59.461 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.455+0000 7f255101b700 1 -- 172.21.15.158:0/3533621583 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f254c068700 msgr2=0x7f254c0a8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:59.461 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.455+0000 7f255101b700 1 --2- 172.21.15.158:0/3533621583 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f254c068700 0x7f254c0a8ad0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f253c00c3f0 tx=0x7f253c007bf0).stop 2023-10-18T17:23:59.461 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.455+0000 7f255101b700 1 -- 172.21.15.158:0/3533621583 shutdown_connections 2023-10-18T17:23:59.462 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.455+0000 7f255101b700 1 --2- 172.21.15.158:0/3533621583 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f253805a540 0x7f253805ca00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.462 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.455+0000 7f255101b700 1 --2- 172.21.15.158:0/3533621583 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f254c0c4290 0x7f254c14de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.462 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.455+0000 7f255101b700 1 --2- 172.21.15.158:0/3533621583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f254c0bfd50 0x7f254c148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.462 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.455+0000 7f255101b700 1 --2- 172.21.15.158:0/3533621583 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f254c068700 0x7f254c0a8ad0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.462 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.455+0000 7f255101b700 1 -- 172.21.15.158:0/3533621583 >> 172.21.15.158:0/3533621583 conn(0x7f254c0667b0 msgr2=0x7f254c0be940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:59.463 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.455+0000 7f255101b700 1 -- 172.21.15.158:0/3533621583 shutdown_connections 2023-10-18T17:23:59.463 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.455+0000 7f255101b700 1 -- 172.21.15.158:0/3533621583 wait complete. 2023-10-18T17:23:59.479 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T17:23:59.645 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.639+0000 7f29f0c79700 1 Processor -- start 2023-10-18T17:23:59.645 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.639+0000 7f29f0c79700 1 -- start start 2023-10-18T17:23:59.647 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.639+0000 7f29f0c79700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f29ec14d690 0x7f29ec0be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:59.647 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.639+0000 7f29f0c79700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f29ec069c90 0x7f29ec0bedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:59.647 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.639+0000 7f29f0c79700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ec14ff90 con 0x7f29ec067d70 2023-10-18T17:23:59.647 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.639+0000 7f29f0c79700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec06a4e0 con 0x7f29ec069c90 2023-10-18T17:23:59.648 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.639+0000 7f29f0c79700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec0690f0 con 0x7f29ec14d690 2023-10-18T17:23:59.649 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.639+0000 7f29eaffd700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f29ec067d70 0x7f29ec069580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:40672/0 (socket says 172.21.15.158:40672) 2023-10-18T17:23:59.649 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.639+0000 7f29eaffd700 1 -- 172.21.15.158:0/1496155966 learned_addr learned my addr 172.21.15.158:0/1496155966 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:23:59.649 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.639+0000 7f29eb7fe700 1 --2- 172.21.15.158:0/1496155966 >> v2:172.21.15.183:3300/0 conn(0x7f29ec14d690 0x7f29ec0be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:59.649 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.639+0000 7f29ebfff700 1 --2- 172.21.15.158:0/1496155966 >> v2:172.21.15.158:3300/0 conn(0x7f29ec069c90 0x7f29ec0bedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:59.650 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.643+0000 7f29ea7fc700 1 -- 172.21.15.158:0/1496155966 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363076527 0 0) 0x7f29ec14ff90 con 0x7f29ec067d70 2023-10-18T17:23:59.650 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.643+0000 7f29ea7fc700 1 -- 172.21.15.158:0/1496155966 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29d40033f0 con 0x7f29ec067d70 2023-10-18T17:23:59.650 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.643+0000 7f29eb7fe700 1 -- 172.21.15.158:0/1496155966 >> v2:172.21.15.158:3300/0 conn(0x7f29ec069c90 msgr2=0x7f29ec0bedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:23:59.650 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.643+0000 7f29eb7fe700 1 --2- 172.21.15.158:0/1496155966 >> v2:172.21.15.158:3300/0 conn(0x7f29ec069c90 0x7f29ec0bedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.650 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.643+0000 7f29eb7fe700 1 -- 172.21.15.158:0/1496155966 >> v1:172.21.15.183:6789/0 conn(0x7f29ec067d70 legacy=0x7f29ec069580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:59.651 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.643+0000 7f29eb7fe700 1 -- 172.21.15.158:0/1496155966 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec1501e0 con 0x7f29ec14d690 2023-10-18T17:23:59.651 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.643+0000 7f29eb7fe700 1 --2- 172.21.15.158:0/1496155966 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29ec14d690 0x7f29ec0be8e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f29ec067820 tx=0x7f29dc009060).ready entity=mon.1 client_cookie=28e42a1b1380aa0c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:59.652 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.643+0000 7f29ea7fc700 1 -- 172.21.15.158:0/1496155966 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc00f510 con 0x7f29ec14d690 2023-10-18T17:23:59.652 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.643+0000 7f29ea7fc700 1 -- 172.21.15.158:0/1496155966 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc00f670 con 0x7f29ec14d690 2023-10-18T17:23:59.652 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.643+0000 7f29ea7fc700 1 -- 172.21.15.158:0/1496155966 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc00f9f0 con 0x7f29ec14d690 2023-10-18T17:23:59.652 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.643+0000 7f29f0c79700 1 -- 172.21.15.158:0/1496155966 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29ec14d690 msgr2=0x7f29ec0be8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:59.653 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.643+0000 7f29f0c79700 1 --2- 172.21.15.158:0/1496155966 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29ec14d690 0x7f29ec0be8e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f29ec067820 tx=0x7f29dc009060).stop 2023-10-18T17:23:59.653 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.643+0000 7f29f0c79700 1 -- 172.21.15.158:0/1496155966 shutdown_connections 2023-10-18T17:23:59.653 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.643+0000 7f29f0c79700 1 --2- 172.21.15.158:0/1496155966 >> v2:172.21.15.158:3300/0 conn(0x7f29ec069c90 0x7f29ec0bedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.653 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.643+0000 7f29f0c79700 1 --2- 172.21.15.158:0/1496155966 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29ec14d690 0x7f29ec0be8e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.653 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.643+0000 7f29f0c79700 1 -- 172.21.15.158:0/1496155966 >> 172.21.15.158:0/1496155966 conn(0x7f29ec0645a0 msgr2=0x7f29ec0649b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:59.654 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.643+0000 7f29f0c79700 1 -- 172.21.15.158:0/1496155966 shutdown_connections 2023-10-18T17:23:59.654 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.643+0000 7f29f0c79700 1 -- 172.21.15.158:0/1496155966 wait complete. 2023-10-18T17:23:59.654 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.647+0000 7f29f0c79700 1 Processor -- start 2023-10-18T17:23:59.655 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.647+0000 7f29f0c79700 1 -- start start 2023-10-18T17:23:59.656 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.647+0000 7f29f0c79700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f29ec067d70 0x7f29ec0c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:59.656 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.647+0000 7f29f0c79700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29ec069c90 0x7f29ec161b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:59.656 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.647+0000 7f29f0c79700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29ec14d690 0x7f29ec0b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:59.656 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.647+0000 7f29f0c79700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec1616c0 con 0x7f29ec067d70 2023-10-18T17:23:59.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.647+0000 7f29f0c79700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec162040 con 0x7f29ec069c90 2023-10-18T17:23:59.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.647+0000 7f29f0c79700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0bb880 con 0x7f29ec14d690 2023-10-18T17:23:59.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.647+0000 7f29eb7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f29ec067d70 0x7f29ec0c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:59.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.647+0000 7f29eb7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f29ec067d70 0x7f29ec0c2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56420/0 (socket says 172.21.15.158:56420) 2023-10-18T17:23:59.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.647+0000 7f29eb7fe700 1 -- 172.21.15.158:0/498732758 learned_addr learned my addr 172.21.15.158:0/498732758 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:23:59.658 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.647+0000 7f29ebfff700 1 --2- 172.21.15.158:0/498732758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29ec14d690 0x7f29ec0b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:59.658 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.647+0000 7f29eaffd700 1 --2- 172.21.15.158:0/498732758 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29ec069c90 0x7f29ec161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:59.659 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.651+0000 7f29eb7fe700 1 -- 172.21.15.158:0/498732758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29ec14d690 msgr2=0x7f29ec0b7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:59.659 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.651+0000 7f29eb7fe700 1 --2- 172.21.15.158:0/498732758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29ec14d690 0x7f29ec0b7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.659 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.651+0000 7f29eb7fe700 1 -- 172.21.15.158:0/498732758 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29ec069c90 msgr2=0x7f29ec161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:59.659 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.651+0000 7f29eb7fe700 1 --2- 172.21.15.158:0/498732758 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29ec069c90 0x7f29ec161b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.660 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.651+0000 7f29eb7fe700 1 -- 172.21.15.158:0/498732758 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc0092a0 con 0x7f29ec067d70 2023-10-18T17:23:59.660 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.651+0000 7f29eaffd700 1 --2- 172.21.15.158:0/498732758 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29ec069c90 0x7f29ec161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:23:59.660 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.651+0000 7f29eb7fe700 1 --2- 172.21.15.158:0/498732758 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f29ec067d70 0x7f29ec0c2270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f29dc011e50 tx=0x7f29dc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:59.660 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.651+0000 7f29d37fe700 1 -- 172.21.15.158:0/498732758 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc00f9f0 con 0x7f29ec067d70 2023-10-18T17:23:59.660 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.651+0000 7f29d37fe700 1 -- 172.21.15.158:0/498732758 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc000c90 con 0x7f29ec067d70 2023-10-18T17:23:59.661 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.651+0000 7f29f0c79700 1 -- 172.21.15.158:0/498732758 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ec15e620 con 0x7f29ec067d70 2023-10-18T17:23:59.661 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.651+0000 7f29d37fe700 1 -- 172.21.15.158:0/498732758 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc01b690 con 0x7f29ec067d70 2023-10-18T17:23:59.661 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.651+0000 7f29f0c79700 1 -- 172.21.15.158:0/498732758 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ec161350 con 0x7f29ec067d70 2023-10-18T17:23:59.661 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.651+0000 7f29f0c79700 1 -- 172.21.15.158:0/498732758 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ec1611b0 con 0x7f29ec067d70 2023-10-18T17:23:59.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.655+0000 7f29d37fe700 1 -- 172.21.15.158:0/498732758 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f29dc01ba00 con 0x7f29ec067d70 2023-10-18T17:23:59.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.655+0000 7f29d37fe700 1 --2- 172.21.15.158:0/498732758 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f29d805a540 0x7f29d805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:23:59.663 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.655+0000 7f29d37fe700 1 -- 172.21.15.158:0/498732758 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f29dc075da0 con 0x7f29ec067d70 2023-10-18T17:23:59.663 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.655+0000 7f29eaffd700 1 --2- 172.21.15.158:0/498732758 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f29d805a540 0x7f29d805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:23:59.663 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.655+0000 7f29eaffd700 1 --2- 172.21.15.158:0/498732758 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f29d805a540 0x7f29d805ca00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f29ec0bd280 tx=0x7f29e0009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:23:59.669 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.663+0000 7f29d37fe700 1 -- 172.21.15.158:0/498732758 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f29ec1611b0 con 0x7f29ec067d70 2023-10-18T17:23:59.842 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.835+0000 7f29f0c79700 1 -- 172.21.15.158:0/498732758 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f29ec1611b0 con 0x7f29ec067d70 2023-10-18T17:23:59.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.835+0000 7f29d37fe700 1 -- 172.21.15.158:0/498732758 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f29ec1611b0 con 0x7f29ec067d70 2023-10-18T17:23:59.843 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2023-10-18T17:23:59.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.839+0000 7f29f0c79700 1 -- 172.21.15.158:0/498732758 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f29d805a540 msgr2=0x7f29d805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:59.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.839+0000 7f29f0c79700 1 --2- 172.21.15.158:0/498732758 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f29d805a540 0x7f29d805ca00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f29ec0bd280 tx=0x7f29e0009040).stop 2023-10-18T17:23:59.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.839+0000 7f29f0c79700 1 -- 172.21.15.158:0/498732758 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f29ec067d70 msgr2=0x7f29ec0c2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:23:59.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.839+0000 7f29f0c79700 1 --2- 172.21.15.158:0/498732758 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f29ec067d70 0x7f29ec0c2270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f29dc011e50 tx=0x7f29dc017000).stop 2023-10-18T17:23:59.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.839+0000 7f29f0c79700 1 -- 172.21.15.158:0/498732758 shutdown_connections 2023-10-18T17:23:59.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.839+0000 7f29f0c79700 1 --2- 172.21.15.158:0/498732758 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f29d805a540 0x7f29d805ca00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.839+0000 7f29f0c79700 1 --2- 172.21.15.158:0/498732758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29ec14d690 0x7f29ec0b7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.839+0000 7f29f0c79700 1 --2- 172.21.15.158:0/498732758 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29ec069c90 0x7f29ec161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.839+0000 7f29f0c79700 1 --2- 172.21.15.158:0/498732758 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f29ec067d70 0x7f29ec0c2270 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:23:59.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.839+0000 7f29f0c79700 1 -- 172.21.15.158:0/498732758 >> 172.21.15.158:0/498732758 conn(0x7f29ec0645a0 msgr2=0x7f29ec069580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:23:59.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.839+0000 7f29f0c79700 1 -- 172.21.15.158:0/498732758 shutdown_connections 2023-10-18T17:23:59.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:23:59.839+0000 7f29f0c79700 1 -- 172.21.15.158:0/498732758 wait complete. 2023-10-18T17:23:59.866 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T17:24:00.028 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.019+0000 7f755b3f9700 1 Processor -- start 2023-10-18T17:24:00.028 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.019+0000 7f755b3f9700 1 -- start start 2023-10-18T17:24:00.030 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.023+0000 7f755b3f9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f75540bf340 0x7f75540bf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:00.030 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.023+0000 7f755b3f9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f755414e7e0 0x7f7554151820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:00.031 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.023+0000 7f755b3f9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755414dc30 con 0x7f755414e3d0 2023-10-18T17:24:00.031 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.023+0000 7f755b3f9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75540bbb60 con 0x7f75540bf340 2023-10-18T17:24:00.031 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.023+0000 7f755b3f9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75540bbe00 con 0x7f755414e7e0 2023-10-18T17:24:00.032 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.023+0000 7f7559bf6700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f755414e3d0 0x7f7554066180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:58644/0 (socket says 172.21.15.158:58644) 2023-10-18T17:24:00.032 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.023+0000 7f755abf8700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f755414e7e0 0x7f7554151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:00.032 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.023+0000 7f7559bf6700 1 -- 172.21.15.158:0/1808464016 learned_addr learned my addr 172.21.15.158:0/1808464016 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:00.033 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.023+0000 7f755a3f7700 1 --2- 172.21.15.158:0/1808464016 >> v2:172.21.15.158:3300/0 conn(0x7f75540bf340 0x7f75540bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:00.033 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.023+0000 7f755abf8700 1 -- 172.21.15.158:0/1808464016 >> v2:172.21.15.158:3300/0 conn(0x7f75540bf340 msgr2=0x7f75540bf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:00.033 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.023+0000 7f755abf8700 1 --2- 172.21.15.158:0/1808464016 >> v2:172.21.15.158:3300/0 conn(0x7f75540bf340 0x7f75540bf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.033 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.023+0000 7f755abf8700 1 -- 172.21.15.158:0/1808464016 >> v1:172.21.15.158:6789/0 conn(0x7f755414e3d0 legacy=0x7f7554066180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:00.033 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.023+0000 7f75593f5700 1 -- 172.21.15.158:0/1808464016 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616607733 0 0) 0x7f755414dc30 con 0x7f755414e3d0 2023-10-18T17:24:00.033 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.023+0000 7f755abf8700 1 -- 172.21.15.158:0/1808464016 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75540bc0c0 con 0x7f755414e7e0 2023-10-18T17:24:00.034 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.027+0000 7f755abf8700 1 --2- 172.21.15.158:0/1808464016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f755414e7e0 0x7f7554151820 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f7554148250 tx=0x7f754c009780).ready entity=mon.1 client_cookie=288f69699c6621e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:00.035 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.027+0000 7f75593f5700 1 -- 172.21.15.158:0/1808464016 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c00e070 con 0x7f755414e7e0 2023-10-18T17:24:00.035 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.027+0000 7f75593f5700 1 -- 172.21.15.158:0/1808464016 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c00bbf0 con 0x7f755414e7e0 2023-10-18T17:24:00.035 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.027+0000 7f75593f5700 1 -- 172.21.15.158:0/1808464016 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c012410 con 0x7f755414e7e0 2023-10-18T17:24:00.035 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.027+0000 7f755b3f9700 1 -- 172.21.15.158:0/1808464016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f755414e7e0 msgr2=0x7f7554151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:00.035 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.027+0000 7f755b3f9700 1 --2- 172.21.15.158:0/1808464016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f755414e7e0 0x7f7554151820 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f7554148250 tx=0x7f754c009780).stop 2023-10-18T17:24:00.035 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.027+0000 7f755b3f9700 1 -- 172.21.15.158:0/1808464016 shutdown_connections 2023-10-18T17:24:00.036 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.027+0000 7f755b3f9700 1 --2- 172.21.15.158:0/1808464016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f755414e7e0 0x7f7554151820 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.036 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.027+0000 7f755b3f9700 1 --2- 172.21.15.158:0/1808464016 >> v2:172.21.15.158:3300/0 conn(0x7f75540bf340 0x7f75540bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.036 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.027+0000 7f755b3f9700 1 -- 172.21.15.158:0/1808464016 >> 172.21.15.158:0/1808464016 conn(0x7f755405ddc0 msgr2=0x7f755405e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:00.036 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.027+0000 7f755b3f9700 1 -- 172.21.15.158:0/1808464016 shutdown_connections 2023-10-18T17:24:00.036 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.027+0000 7f755b3f9700 1 -- 172.21.15.158:0/1808464016 wait complete. 2023-10-18T17:24:00.037 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.027+0000 7f755b3f9700 1 Processor -- start 2023-10-18T17:24:00.037 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f755b3f9700 1 -- start start 2023-10-18T17:24:00.037 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f755b3f9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75540bf340 0x7f7554143cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:00.038 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f755b3f9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f755414e3d0 0x7f7554167b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:00.038 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f755b3f9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f755414e7e0 0x7f7554168030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:00.038 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f755b3f9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75540bcf30 con 0x7f75540bf340 2023-10-18T17:24:00.038 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f755b3f9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7554147360 con 0x7f755414e7e0 2023-10-18T17:24:00.038 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f755b3f9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7554168520 con 0x7f755414e3d0 2023-10-18T17:24:00.040 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f755abf8700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f755414e7e0 0x7f7554168030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:00.040 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f7559bf6700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f755414e3d0 0x7f7554167b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:00.040 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f755a3f7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75540bf340 0x7f7554143cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:00.040 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f755abf8700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f755414e7e0 0x7f7554168030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:37574/0 (socket says 172.21.15.158:37574) 2023-10-18T17:24:00.040 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f755abf8700 1 -- 172.21.15.158:0/2000918979 learned_addr learned my addr 172.21.15.158:0/2000918979 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:00.041 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f755abf8700 1 -- 172.21.15.158:0/2000918979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f755414e3d0 msgr2=0x7f7554167b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:00.041 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f755abf8700 1 --2- 172.21.15.158:0/2000918979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f755414e3d0 0x7f7554167b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.041 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f755abf8700 1 -- 172.21.15.158:0/2000918979 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75540bf340 msgr2=0x7f7554143cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:00.041 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f755abf8700 1 --2- 172.21.15.158:0/2000918979 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75540bf340 0x7f7554143cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.041 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f755abf8700 1 -- 172.21.15.158:0/2000918979 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c009a20 con 0x7f755414e7e0 2023-10-18T17:24:00.041 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f755abf8700 1 --2- 172.21.15.158:0/2000918979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f755414e7e0 0x7f7554168030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f754c00b6c0 tx=0x7f754c009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:00.042 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f754a7fc700 1 -- 172.21.15.158:0/2000918979 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c021070 con 0x7f755414e7e0 2023-10-18T17:24:00.042 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f754a7fc700 1 -- 172.21.15.158:0/2000918979 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c01d630 con 0x7f755414e7e0 2023-10-18T17:24:00.042 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f754a7fc700 1 -- 172.21.15.158:0/2000918979 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c012410 con 0x7f755414e7e0 2023-10-18T17:24:00.042 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f755b3f9700 1 -- 172.21.15.158:0/2000918979 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7554153a00 con 0x7f755414e7e0 2023-10-18T17:24:00.042 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.031+0000 7f755b3f9700 1 -- 172.21.15.158:0/2000918979 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7554146a30 con 0x7f755414e7e0 2023-10-18T17:24:00.043 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.035+0000 7f755b3f9700 1 -- 172.21.15.158:0/2000918979 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7554046f00 con 0x7f755414e7e0 2023-10-18T17:24:00.043 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.035+0000 7f754a7fc700 1 -- 172.21.15.158:0/2000918979 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f754c01dc00 con 0x7f755414e7e0 2023-10-18T17:24:00.044 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.035+0000 7f754a7fc700 1 --2- 172.21.15.158:0/2000918979 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f753805a510 0x7f753805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:00.044 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.035+0000 7f754a7fc700 1 -- 172.21.15.158:0/2000918979 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f754c0762b0 con 0x7f755414e7e0 2023-10-18T17:24:00.044 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.035+0000 7f755a3f7700 1 --2- 172.21.15.158:0/2000918979 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f753805a510 0x7f753805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:00.044 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.039+0000 7f755a3f7700 1 --2- 172.21.15.158:0/2000918979 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f753805a510 0x7f753805c9d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7550009b90 tx=0x7f7550009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:00.055 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.047+0000 7f754a7fc700 1 -- 172.21.15.158:0/2000918979 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f754c049d20 con 0x7f755414e7e0 2023-10-18T17:24:00.252 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.247+0000 7f755b3f9700 1 -- 172.21.15.158:0/2000918979 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75541511a0 con 0x7f755414e7e0 2023-10-18T17:24:00.254 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.247+0000 7f754a7fc700 1 -- 172.21.15.158:0/2000918979 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5054 (secure 0 0 0) 0x7f754c04d340 con 0x7f755414e7e0 2023-10-18T17:24:00.254 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:00.255 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/4166106461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":4166106461},{"type":"v1","addr":"172.21.15.183:6837","nonce":4166106461}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/3015150621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":3015150621},{"type":"v1","addr":"172.21.15.183:6839","nonce":3015150621}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2119572558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2119572558},{"type":"v1","addr":"172.21.15.158:6836","nonce":2119572558}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/3920532651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3920532651},{"type":"v1","addr":"172.21.15.158:6837","nonce":3920532651}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3431053572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":3431053572},{"type":"v1","addr":"172.21.15.183:6835","nonce":3431053572}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6833/3622415010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":3622415010},{"type":"v1","addr":"172.21.15.158:6833","nonce":3622415010}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-18T17:24:00.257 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.251+0000 7f755b3f9700 1 -- 172.21.15.158:0/2000918979 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f753805a510 msgr2=0x7f753805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:00.257 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.251+0000 7f755b3f9700 1 --2- 172.21.15.158:0/2000918979 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f753805a510 0x7f753805c9d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7550009b90 tx=0x7f7550009060).stop 2023-10-18T17:24:00.257 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.251+0000 7f755b3f9700 1 -- 172.21.15.158:0/2000918979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f755414e7e0 msgr2=0x7f7554168030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:00.257 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.251+0000 7f755b3f9700 1 --2- 172.21.15.158:0/2000918979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f755414e7e0 0x7f7554168030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f754c00b6c0 tx=0x7f754c009780).stop 2023-10-18T17:24:00.257 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.251+0000 7f755b3f9700 1 -- 172.21.15.158:0/2000918979 shutdown_connections 2023-10-18T17:24:00.258 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.251+0000 7f755b3f9700 1 --2- 172.21.15.158:0/2000918979 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f753805a510 0x7f753805c9d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.258 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.251+0000 7f755b3f9700 1 --2- 172.21.15.158:0/2000918979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f755414e7e0 0x7f7554168030 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.258 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.251+0000 7f755b3f9700 1 --2- 172.21.15.158:0/2000918979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f755414e3d0 0x7f7554167b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.258 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.251+0000 7f755b3f9700 1 --2- 172.21.15.158:0/2000918979 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75540bf340 0x7f7554143cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.259 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.251+0000 7f755b3f9700 1 -- 172.21.15.158:0/2000918979 >> 172.21.15.158:0/2000918979 conn(0x7f755405ddc0 msgr2=0x7f7554145ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:00.259 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.251+0000 7f755b3f9700 1 -- 172.21.15.158:0/2000918979 shutdown_connections 2023-10-18T17:24:00.259 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.251+0000 7f755b3f9700 1 -- 172.21.15.158:0/2000918979 wait complete. 2023-10-18T17:24:00.259 INFO:teuthology.orchestra.run.smithi158.stderr:dumped fsmap epoch 3 2023-10-18T17:24:00.277 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T17:24:00.435 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.427+0000 7f79ca039700 1 Processor -- start 2023-10-18T17:24:00.436 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.427+0000 7f79ca039700 1 -- start start 2023-10-18T17:24:00.437 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.431+0000 7f79ca039700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f79c40bf340 0x7f79c40bf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:00.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.431+0000 7f79ca039700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f79c414e3d0 0x7f79c4066180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:00.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.431+0000 7f79ca039700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c414dc30 con 0x7f79c414e7e0 2023-10-18T17:24:00.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.431+0000 7f79ca039700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c40bbb60 con 0x7f79c414e3d0 2023-10-18T17:24:00.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.431+0000 7f79ca039700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c40bbe00 con 0x7f79c40bf340 2023-10-18T17:24:00.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.431+0000 7f79c9037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f79c40bf340 0x7f79c40bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:00.440 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.431+0000 7f79c9037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f79c40bf340 0x7f79c40bf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:37582/0 (socket says 172.21.15.158:37582) 2023-10-18T17:24:00.440 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.431+0000 7f79c9037700 1 -- 172.21.15.158:0/3092356146 learned_addr learned my addr 172.21.15.158:0/3092356146 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:00.440 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.431+0000 7f79c9838700 1 --1- 172.21.15.158:0/3092356146 >> v1:172.21.15.158:6789/0 conn(0x7f79c414e7e0 0x7f79c4151820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:58650/0 (socket says 172.21.15.158:58650) 2023-10-18T17:24:00.440 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.431+0000 7f79c8836700 1 --2- 172.21.15.158:0/3092356146 >> v2:172.21.15.158:3300/0 conn(0x7f79c414e3d0 0x7f79c4066180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:00.440 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.431+0000 7f79c9037700 1 -- 172.21.15.158:0/3092356146 >> v2:172.21.15.158:3300/0 conn(0x7f79c414e3d0 msgr2=0x7f79c4066180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:00.441 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.431+0000 7f79c9037700 1 --2- 172.21.15.158:0/3092356146 >> v2:172.21.15.158:3300/0 conn(0x7f79c414e3d0 0x7f79c4066180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.441 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.431+0000 7f79c9037700 1 -- 172.21.15.158:0/3092356146 >> v1:172.21.15.158:6789/0 conn(0x7f79c414e7e0 legacy=0x7f79c4151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:00.441 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.431+0000 7f79c9037700 1 -- 172.21.15.158:0/3092356146 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c40bc0c0 con 0x7f79c40bf340 2023-10-18T17:24:00.441 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.431+0000 7f79c9037700 1 --2- 172.21.15.158:0/3092356146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c40bf340 0x7f79c40bf720 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f79c4067380 tx=0x7f79c0009840).ready entity=mon.1 client_cookie=aadd0885ff43c530 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:00.442 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.435+0000 7f79bbfff700 1 -- 172.21.15.158:0/3092356146 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c000e070 con 0x7f79c40bf340 2023-10-18T17:24:00.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.435+0000 7f79bbfff700 1 -- 172.21.15.158:0/3092356146 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c000bae0 con 0x7f79c40bf340 2023-10-18T17:24:00.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.435+0000 7f79bbfff700 1 -- 172.21.15.158:0/3092356146 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c000be60 con 0x7f79c40bf340 2023-10-18T17:24:00.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.435+0000 7f79ca039700 1 -- 172.21.15.158:0/3092356146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c40bf340 msgr2=0x7f79c40bf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:00.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.435+0000 7f79ca039700 1 --2- 172.21.15.158:0/3092356146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c40bf340 0x7f79c40bf720 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f79c4067380 tx=0x7f79c0009840).stop 2023-10-18T17:24:00.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.435+0000 7f79ca039700 1 -- 172.21.15.158:0/3092356146 shutdown_connections 2023-10-18T17:24:00.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.435+0000 7f79ca039700 1 --2- 172.21.15.158:0/3092356146 >> v2:172.21.15.158:3300/0 conn(0x7f79c414e3d0 0x7f79c4066180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.435+0000 7f79ca039700 1 --2- 172.21.15.158:0/3092356146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c40bf340 0x7f79c40bf720 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.435+0000 7f79ca039700 1 -- 172.21.15.158:0/3092356146 >> 172.21.15.158:0/3092356146 conn(0x7f79c405ddc0 msgr2=0x7f79c405e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:00.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.435+0000 7f79ca039700 1 -- 172.21.15.158:0/3092356146 shutdown_connections 2023-10-18T17:24:00.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.435+0000 7f79ca039700 1 -- 172.21.15.158:0/3092356146 wait complete. 2023-10-18T17:24:00.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.439+0000 7f79ca039700 1 Processor -- start 2023-10-18T17:24:00.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.439+0000 7f79ca039700 1 -- start start 2023-10-18T17:24:00.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.439+0000 7f79ca039700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c40bf340 0x7f79c4154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:00.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.439+0000 7f79ca039700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79c414e3d0 0x7f79c4161b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:00.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.439+0000 7f79ca039700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79c414e7e0 0x7f79c4163db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:00.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.439+0000 7f79ca039700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4153db0 con 0x7f79c414e3d0 2023-10-18T17:24:00.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.439+0000 7f79ca039700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4164870 con 0x7f79c40bf340 2023-10-18T17:24:00.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.439+0000 7f79ca039700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4162000 con 0x7f79c414e7e0 2023-10-18T17:24:00.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.439+0000 7f79c8836700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79c414e3d0 0x7f79c4161b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:00.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.439+0000 7f79c8836700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79c414e3d0 0x7f79c4161b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56450/0 (socket says 172.21.15.158:56450) 2023-10-18T17:24:00.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.439+0000 7f79c8836700 1 -- 172.21.15.158:0/4284828247 learned_addr learned my addr 172.21.15.158:0/4284828247 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:00.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.439+0000 7f79c9838700 1 --2- 172.21.15.158:0/4284828247 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79c414e7e0 0x7f79c4163db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:00.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.439+0000 7f79c9037700 1 --2- 172.21.15.158:0/4284828247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c40bf340 0x7f79c4154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:00.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.439+0000 7f79c8836700 1 -- 172.21.15.158:0/4284828247 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79c414e7e0 msgr2=0x7f79c4163db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:00.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.439+0000 7f79c8836700 1 --2- 172.21.15.158:0/4284828247 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79c414e7e0 0x7f79c4163db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.439+0000 7f79c8836700 1 -- 172.21.15.158:0/4284828247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c40bf340 msgr2=0x7f79c4154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:00.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.439+0000 7f79c8836700 1 --2- 172.21.15.158:0/4284828247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c40bf340 0x7f79c4154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.451 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.439+0000 7f79c8836700 1 -- 172.21.15.158:0/4284828247 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c0009ae0 con 0x7f79c414e3d0 2023-10-18T17:24:00.451 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.439+0000 7f79c8836700 1 --2- 172.21.15.158:0/4284828247 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79c414e3d0 0x7f79c4161b10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f79b400d890 tx=0x7f79b4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:00.451 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.443+0000 7f79b97fa700 1 -- 172.21.15.158:0/4284828247 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b4011590 con 0x7f79c414e3d0 2023-10-18T17:24:00.451 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.443+0000 7f79b97fa700 1 -- 172.21.15.158:0/4284828247 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b40116f0 con 0x7f79c414e3d0 2023-10-18T17:24:00.451 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.443+0000 7f79ca039700 1 -- 172.21.15.158:0/4284828247 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c4153fc0 con 0x7f79c414e3d0 2023-10-18T17:24:00.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.443+0000 7f79b97fa700 1 -- 172.21.15.158:0/4284828247 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b4011a70 con 0x7f79c414e3d0 2023-10-18T17:24:00.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.443+0000 7f79ca039700 1 -- 172.21.15.158:0/4284828247 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c4154580 con 0x7f79c414e3d0 2023-10-18T17:24:00.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.443+0000 7f79ca039700 1 -- 172.21.15.158:0/4284828247 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c4046f00 con 0x7f79c414e3d0 2023-10-18T17:24:00.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.443+0000 7f79b97fa700 1 -- 172.21.15.158:0/4284828247 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f79b401c460 con 0x7f79c414e3d0 2023-10-18T17:24:00.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.447+0000 7f79b97fa700 1 --2- 172.21.15.158:0/4284828247 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f79a805a510 0x7f79a805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:00.454 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.447+0000 7f79b97fa700 1 -- 172.21.15.158:0/4284828247 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f79b4074270 con 0x7f79c414e3d0 2023-10-18T17:24:00.454 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.447+0000 7f79c9037700 1 --2- 172.21.15.158:0/4284828247 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f79a805a510 0x7f79a805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:00.454 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.447+0000 7f79c9037700 1 --2- 172.21.15.158:0/4284828247 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f79a805a510 0x7f79a805c9d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f79c000bab0 tx=0x7f79c0009840).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:00.460 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.451+0000 7f79b97fa700 1 -- 172.21.15.158:0/4284828247 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f79b4047c80 con 0x7f79c414e3d0 2023-10-18T17:24:00.630 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.623+0000 7f79ca039700 1 -- 172.21.15.158:0/4284828247 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79c40bd320 con 0x7f79c414e3d0 2023-10-18T17:24:00.632 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.627+0000 7f79b97fa700 1 -- 172.21.15.158:0/4284828247 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13757 (secure 0 0 0) 0x7f79b4011e60 con 0x7f79c414e3d0 2023-10-18T17:24:00.633 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:00.633 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":18,"fsid":"ca4bb219-38c8-4c5b-a49c-213b123db018","created":"2023-10-18T17:23:45.550173+0000","modified":"2023-10-18T17:23:59.667347+0000","last_up_change":"2023-10-18T17:23:55.617219+0000","last_in_change":"2023-10-18T17:23:47.727646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-18T17:23:54.686216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T17:23:56.743672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1f621b1e-5ea4-4dc3-80e1-c415c7cc97d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6815","nonce":33195},{"type":"v1","addr":"172.21.15.158:6817","nonce":33195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":33195},{"type":"v1","addr":"172.21.15.158:6819","nonce":33195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":33195},{"type":"v1","addr":"172.21.15.158:6824","nonce":33195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":33195},{"type":"v1","addr":"172.21.15.158:6821","nonce":33195}]},"public_addr":"172.21.15.158:6817/33195","cluster_addr":"172.21.15.158:6819/33195","heartbeat_back_addr":"172.21.15.158:6824/33195","heartbeat_front_addr":"172.21.15.158:6821/33195","state":["exists","up"]},{"osd":1,"uuid":"769d7514-319f-4ac3-8cf3-6f88f4e7da2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6823","nonce":33196},{"type":"v1","addr":"172.21.15.158:6825","nonce":33196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":33196},{"type":"v1","addr":"172.21.15.158:6827","nonce":33196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":33196},{"type":"v1","addr":"172.21.15.158:6831","nonce":33196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":33196},{"type":"v1","addr":"172.21.15.158:6829","nonce":33196}]},"public_addr":"172.21.15.158:6825/33196","cluster_addr":"172.21.15.158:6827/33196","heartbeat_back_addr":"172.21.15.158:6831/33196","heartbeat_front_addr":"172.21.15.158:6829/33196","state":["exists","up"]},{"osd":2,"uuid":"b4459762-309d-454c-bd31-33b90192375f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":33193},{"type":"v1","addr":"172.21.15.158:6809","nonce":33193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":33193},{"type":"v1","addr":"172.21.15.158:6811","nonce":33193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":33193},{"type":"v1","addr":"172.21.15.158:6816","nonce":33193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":33193},{"type":"v1","addr":"172.21.15.158:6813","nonce":33193}]},"public_addr":"172.21.15.158:6809/33193","cluster_addr":"172.21.15.158:6811/33193","heartbeat_back_addr":"172.21.15.158:6816/33193","heartbeat_front_addr":"172.21.15.158:6813/33193","state":["exists","up"]},{"osd":3,"uuid":"7b78a411-1ae9-4051-ae9d-a03abc5a73ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":33194},{"type":"v1","addr":"172.21.15.158:6801","nonce":33194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":33194},{"type":"v1","addr":"172.21.15.158:6803","nonce":33194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":33194},{"type":"v1","addr":"172.21.15.158:6807","nonce":33194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":33194},{"type":"v1","addr":"172.21.15.158:6805","nonce":33194}]},"public_addr":"172.21.15.158:6801/33194","cluster_addr":"172.21.15.158:6803/33194","heartbeat_back_addr":"172.21.15.158:6807/33194","heartbeat_front_addr":"172.21.15.158:6805/33194","state":["exists","up"]},{"osd":4,"uuid":"58005b5f-2742-4ecb-8c3a-a2ae65c7fb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":33897},{"type":"v1","addr":"172.21.15.183:6801","nonce":33897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6803","nonce":33897},{"type":"v1","addr":"172.21.15.183:6805","nonce":33897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":33897},{"type":"v1","addr":"172.21.15.183:6812","nonce":33897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":33897},{"type":"v1","addr":"172.21.15.183:6808","nonce":33897}]},"public_addr":"172.21.15.183:6801/33897","cluster_addr":"172.21.15.183:6805/33897","heartbeat_back_addr":"172.21.15.183:6812/33897","heartbeat_front_addr":"172.21.15.183:6808/33897","state":["exists","up"]},{"osd":5,"uuid":"c0b217ed-1c09-4cde-b192-65624ab3a70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":33898},{"type":"v1","addr":"172.21.15.183:6804","nonce":33898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6807","nonce":33898},{"type":"v1","addr":"172.21.15.183:6809","nonce":33898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":33898},{"type":"v1","addr":"172.21.15.183:6815","nonce":33898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6811","nonce":33898},{"type":"v1","addr":"172.21.15.183:6813","nonce":33898}]},"public_addr":"172.21.15.183:6804/33898","cluster_addr":"172.21.15.183:6809/33898","heartbeat_back_addr":"172.21.15.183:6815/33898","heartbeat_front_addr":"172.21.15.183:6813/33898","state":["exists","up"]},{"osd":6,"uuid":"5f910aac-4091-408b-8b2b-19865b21395c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":33910},{"type":"v1","addr":"172.21.15.183:6825","nonce":33910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":33910},{"type":"v1","addr":"172.21.15.183:6827","nonce":33910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":33910},{"type":"v1","addr":"172.21.15.183:6831","nonce":33910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":33910},{"type":"v1","addr":"172.21.15.183:6829","nonce":33910}]},"public_addr":"172.21.15.183:6825/33910","cluster_addr":"172.21.15.183:6827/33910","heartbeat_back_addr":"172.21.15.183:6831/33910","heartbeat_front_addr":"172.21.15.183:6829/33910","state":["exists","up"]},{"osd":7,"uuid":"96d7b9aa-687e-42e3-a5cf-1533931ecce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":33903},{"type":"v1","addr":"172.21.15.183:6817","nonce":33903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":33903},{"type":"v1","addr":"172.21.15.183:6819","nonce":33903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":33903},{"type":"v1","addr":"172.21.15.183:6823","nonce":33903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":33903},{"type":"v1","addr":"172.21.15.183:6821","nonce":33903}]},"public_addr":"172.21.15.183:6817/33903","cluster_addr":"172.21.15.183:6819/33903","heartbeat_back_addr":"172.21.15.183:6823/33903","heartbeat_front_addr":"172.21.15.183:6821/33903","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.622366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.713036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.561097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.546583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.007074+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:52.994413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.176820+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:52.906075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T17:24:00.635 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.627+0000 7f79ca039700 1 -- 172.21.15.158:0/4284828247 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f79a805a510 msgr2=0x7f79a805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:00.635 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.627+0000 7f79ca039700 1 --2- 172.21.15.158:0/4284828247 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f79a805a510 0x7f79a805c9d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f79c000bab0 tx=0x7f79c0009840).stop 2023-10-18T17:24:00.635 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.627+0000 7f79ca039700 1 -- 172.21.15.158:0/4284828247 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79c414e3d0 msgr2=0x7f79c4161b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:00.636 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.627+0000 7f79ca039700 1 --2- 172.21.15.158:0/4284828247 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79c414e3d0 0x7f79c4161b10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f79b400d890 tx=0x7f79b4008040).stop 2023-10-18T17:24:00.636 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.627+0000 7f79ca039700 1 -- 172.21.15.158:0/4284828247 shutdown_connections 2023-10-18T17:24:00.637 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.627+0000 7f79ca039700 1 --2- 172.21.15.158:0/4284828247 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f79a805a510 0x7f79a805c9d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.637 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.627+0000 7f79ca039700 1 --2- 172.21.15.158:0/4284828247 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79c414e7e0 0x7f79c4163db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.637 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.627+0000 7f79ca039700 1 --2- 172.21.15.158:0/4284828247 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79c414e3d0 0x7f79c4161b10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.637 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.627+0000 7f79ca039700 1 --2- 172.21.15.158:0/4284828247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c40bf340 0x7f79c4154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.637 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.627+0000 7f79ca039700 1 -- 172.21.15.158:0/4284828247 >> 172.21.15.158:0/4284828247 conn(0x7f79c405ddc0 msgr2=0x7f79c40bff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:00.638 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.627+0000 7f79ca039700 1 -- 172.21.15.158:0/4284828247 shutdown_connections 2023-10-18T17:24:00.638 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.627+0000 7f79ca039700 1 -- 172.21.15.158:0/4284828247 wait complete. 2023-10-18T17:24:00.654 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-18T17:23:54.686216+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T17:23:56.743672+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-18T17:24:00.656 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-18T17:24:00.821 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.815+0000 7f9e75c1b700 1 Processor -- start 2023-10-18T17:24:00.822 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.815+0000 7f9e75c1b700 1 -- start start 2023-10-18T17:24:00.825 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.819+0000 7f9e75c1b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e700660c0 0x7f9e70068960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:00.825 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.819+0000 7f9e75c1b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9e7013d140 0x7f9e7013d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:00.826 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.819+0000 7f9e75c1b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e700bf6e0 con 0x7f9e70065ce0 2023-10-18T17:24:00.827 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.819+0000 7f9e75c1b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e7013da80 con 0x7f9e7013d140 2023-10-18T17:24:00.827 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.819+0000 7f9e75c1b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e70154360 con 0x7f9e700660c0 2023-10-18T17:24:00.827 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.819+0000 7f9e6effd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e700660c0 0x7f9e70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:00.827 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.819+0000 7f9e6f7fe700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f9e70065ce0 0x7f9e700bca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:40674/0 (socket says 172.21.15.158:40674) 2023-10-18T17:24:00.828 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.819+0000 7f9e6f7fe700 1 -- 172.21.15.158:0/3016207884 learned_addr learned my addr 172.21.15.158:0/3016207884 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:00.828 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.819+0000 7f9e6ffff700 1 --2- 172.21.15.158:0/3016207884 >> v2:172.21.15.183:3300/0 conn(0x7f9e7013d140 0x7f9e7013d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:00.828 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.819+0000 7f9e6effd700 1 -- 172.21.15.158:0/3016207884 >> v2:172.21.15.183:3300/0 conn(0x7f9e7013d140 msgr2=0x7f9e7013d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:00.828 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.819+0000 7f9e6effd700 1 --2- 172.21.15.158:0/3016207884 >> v2:172.21.15.183:3300/0 conn(0x7f9e7013d140 0x7f9e7013d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.828 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.819+0000 7f9e6effd700 1 -- 172.21.15.158:0/3016207884 >> v1:172.21.15.183:6789/0 conn(0x7f9e70065ce0 legacy=0x7f9e700bca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:00.828 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.819+0000 7f9e6effd700 1 -- 172.21.15.158:0/3016207884 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e70154620 con 0x7f9e700660c0 2023-10-18T17:24:00.829 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.819+0000 7f9e6effd700 1 --2- 172.21.15.158:0/3016207884 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e700660c0 0x7f9e70068960 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9e64009760 tx=0x7f9e64009060).ready entity=mon.2 client_cookie=ffb7f9e99014d415 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:00.830 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.819+0000 7f9e6e7fc700 1 -- 172.21.15.158:0/3016207884 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6400b590 con 0x7f9e700660c0 2023-10-18T17:24:00.830 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.819+0000 7f9e6e7fc700 1 -- 172.21.15.158:0/3016207884 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6400b6f0 con 0x7f9e700660c0 2023-10-18T17:24:00.830 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.819+0000 7f9e6e7fc700 1 -- 172.21.15.158:0/3016207884 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6400ba70 con 0x7f9e700660c0 2023-10-18T17:24:00.830 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.823+0000 7f9e75c1b700 1 -- 172.21.15.158:0/3016207884 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e700660c0 msgr2=0x7f9e70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:00.831 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.823+0000 7f9e75c1b700 1 --2- 172.21.15.158:0/3016207884 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e700660c0 0x7f9e70068960 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9e64009760 tx=0x7f9e64009060).stop 2023-10-18T17:24:00.831 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.823+0000 7f9e75c1b700 1 -- 172.21.15.158:0/3016207884 shutdown_connections 2023-10-18T17:24:00.831 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.823+0000 7f9e75c1b700 1 --2- 172.21.15.158:0/3016207884 >> v2:172.21.15.183:3300/0 conn(0x7f9e7013d140 0x7f9e7013d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.831 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.823+0000 7f9e75c1b700 1 --2- 172.21.15.158:0/3016207884 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e700660c0 0x7f9e70068960 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.831 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.823+0000 7f9e75c1b700 1 -- 172.21.15.158:0/3016207884 >> 172.21.15.158:0/3016207884 conn(0x7f9e700650d0 msgr2=0x7f9e7005dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:00.831 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.823+0000 7f9e75c1b700 1 -- 172.21.15.158:0/3016207884 shutdown_connections 2023-10-18T17:24:00.832 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.823+0000 7f9e75c1b700 1 -- 172.21.15.158:0/3016207884 wait complete. 2023-10-18T17:24:00.832 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.823+0000 7f9e75c1b700 1 Processor -- start 2023-10-18T17:24:00.833 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e75c1b700 1 -- start start 2023-10-18T17:24:00.834 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e75c1b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e70065ce0 0x7f9e701688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:00.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e75c1b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e700660c0 0x7f9e700be680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:00.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e75c1b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e7013d140 0x7f9e701668a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:00.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e75c1b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e70168de0 con 0x7f9e7013d140 2023-10-18T17:24:00.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e75c1b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e70165e50 con 0x7f9e700660c0 2023-10-18T17:24:00.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e75c1b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e70159690 con 0x7f9e70065ce0 2023-10-18T17:24:00.836 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e6ffff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e7013d140 0x7f9e701668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:00.836 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e6f7fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e70065ce0 0x7f9e701688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:00.836 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e6ffff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e7013d140 0x7f9e701668a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56454/0 (socket says 172.21.15.158:56454) 2023-10-18T17:24:00.836 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e6ffff700 1 -- 172.21.15.158:0/946967683 learned_addr learned my addr 172.21.15.158:0/946967683 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:00.836 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e6effd700 1 --2- 172.21.15.158:0/946967683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e700660c0 0x7f9e700be680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:00.837 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e6ffff700 1 -- 172.21.15.158:0/946967683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e70065ce0 msgr2=0x7f9e701688f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:00.838 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e6ffff700 1 --2- 172.21.15.158:0/946967683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e70065ce0 0x7f9e701688f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.838 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e6ffff700 1 -- 172.21.15.158:0/946967683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e700660c0 msgr2=0x7f9e700be680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:00.838 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e6ffff700 1 --2- 172.21.15.158:0/946967683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e700660c0 0x7f9e700be680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:00.838 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e6ffff700 1 -- 172.21.15.158:0/946967683 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e640092a0 con 0x7f9e7013d140 2023-10-18T17:24:00.839 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e6ffff700 1 --2- 172.21.15.158:0/946967683 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e7013d140 0x7f9e701668a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9e68009e20 tx=0x7f9e6800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:00.839 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e577fe700 1 -- 172.21.15.158:0/946967683 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6800caa0 con 0x7f9e7013d140 2023-10-18T17:24:00.839 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e577fe700 1 -- 172.21.15.158:0/946967683 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6800f040 con 0x7f9e7013d140 2023-10-18T17:24:00.839 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e577fe700 1 -- 172.21.15.158:0/946967683 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6800ce10 con 0x7f9e7013d140 2023-10-18T17:24:00.839 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.827+0000 7f9e75c1b700 1 -- 172.21.15.158:0/946967683 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e70159970 con 0x7f9e7013d140 2023-10-18T17:24:00.839 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.831+0000 7f9e75c1b700 1 -- 172.21.15.158:0/946967683 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e701660a0 con 0x7f9e7013d140 2023-10-18T17:24:00.840 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.831+0000 7f9e75c1b700 1 -- 172.21.15.158:0/946967683 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7005f1d0 con 0x7f9e7013d140 2023-10-18T17:24:00.840 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.831+0000 7f9e577fe700 1 -- 172.21.15.158:0/946967683 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9e68013610 con 0x7f9e7013d140 2023-10-18T17:24:00.840 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.835+0000 7f9e577fe700 1 --2- 172.21.15.158:0/946967683 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9e5c05a510 0x7f9e5c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:00.841 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.835+0000 7f9e577fe700 1 -- 172.21.15.158:0/946967683 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f9e68074c10 con 0x7f9e7013d140 2023-10-18T17:24:00.841 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.835+0000 7f9e6f7fe700 1 --2- 172.21.15.158:0/946967683 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9e5c05a510 0x7f9e5c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:00.842 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.835+0000 7f9e6f7fe700 1 --2- 172.21.15.158:0/946967683 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9e5c05a510 0x7f9e5c05c9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f9e60007fd0 tx=0x7f9e60007d30).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:00.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:00.843+0000 7f9e577fe700 1 -- 172.21.15.158:0/946967683 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f9e7005f1d0 con 0x7f9e7013d140 2023-10-18T17:24:01.009 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.003+0000 7f9e75c1b700 1 -- 172.21.15.158:0/946967683 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9e7005f1d0 con 0x7f9e7013d140 2023-10-18T17:24:01.010 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.003+0000 7f9e577fe700 1 -- 172.21.15.158:0/946967683 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9e7005f1d0 con 0x7f9e7013d140 2023-10-18T17:24:01.010 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 1 2023-10-18T17:24:01.013 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.007+0000 7f9e75c1b700 1 -- 172.21.15.158:0/946967683 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9e5c05a510 msgr2=0x7f9e5c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:01.013 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.007+0000 7f9e75c1b700 1 --2- 172.21.15.158:0/946967683 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9e5c05a510 0x7f9e5c05c9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f9e60007fd0 tx=0x7f9e60007d30).stop 2023-10-18T17:24:01.013 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.007+0000 7f9e75c1b700 1 -- 172.21.15.158:0/946967683 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e7013d140 msgr2=0x7f9e701668a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:01.013 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.007+0000 7f9e75c1b700 1 --2- 172.21.15.158:0/946967683 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e7013d140 0x7f9e701668a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9e68009e20 tx=0x7f9e6800b040).stop 2023-10-18T17:24:01.013 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.007+0000 7f9e75c1b700 1 -- 172.21.15.158:0/946967683 shutdown_connections 2023-10-18T17:24:01.014 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.007+0000 7f9e75c1b700 1 --2- 172.21.15.158:0/946967683 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9e5c05a510 0x7f9e5c05c9d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.014 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.007+0000 7f9e75c1b700 1 --2- 172.21.15.158:0/946967683 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9e7013d140 0x7f9e701668a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.014 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.007+0000 7f9e75c1b700 1 --2- 172.21.15.158:0/946967683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e700660c0 0x7f9e700be680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.014 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.007+0000 7f9e75c1b700 1 --2- 172.21.15.158:0/946967683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e70065ce0 0x7f9e701688f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.014 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.007+0000 7f9e75c1b700 1 -- 172.21.15.158:0/946967683 >> 172.21.15.158:0/946967683 conn(0x7f9e700650d0 msgr2=0x7f9e700c2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:01.015 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.007+0000 7f9e75c1b700 1 -- 172.21.15.158:0/946967683 shutdown_connections 2023-10-18T17:24:01.015 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.007+0000 7f9e75c1b700 1 -- 172.21.15.158:0/946967683 wait complete. 2023-10-18T17:24:01.034 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T17:24:01.198 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.191+0000 7fe11ffff700 1 Processor -- start 2023-10-18T17:24:01.199 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.191+0000 7fe11ffff700 1 -- start start 2023-10-18T17:24:01.201 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11ffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1200c23e0 0x7fe1200c11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:01.202 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11ffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe1200c27c0 0x7fe1200664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:01.202 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11ffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe120065670 0x7fe120065ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:01.202 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11ffff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe120150df0 con 0x7fe120065670 2023-10-18T17:24:01.202 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11ffff700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12014ffb0 con 0x7fe1200c27c0 2023-10-18T17:24:01.203 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11ffff700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe120150270 con 0x7fe1200c23e0 2023-10-18T17:24:01.204 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11e7fc700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe1200c27c0 0x7fe1200664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:01.204 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11effd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1200c23e0 0x7fe1200c11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:01.204 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11effd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1200c23e0 0x7fe1200c11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:38014/0 (socket says 172.21.15.158:38014) 2023-10-18T17:24:01.205 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11effd700 1 -- 172.21.15.158:0/2140239962 learned_addr learned my addr 172.21.15.158:0/2140239962 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:01.205 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11f7fe700 1 --2- 172.21.15.158:0/2140239962 >> v2:172.21.15.158:3300/0 conn(0x7fe120065670 0x7fe120065ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:01.205 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11effd700 1 -- 172.21.15.158:0/2140239962 >> v2:172.21.15.183:3300/0 conn(0x7fe1200c27c0 msgr2=0x7fe1200664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:01.205 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11effd700 1 --2- 172.21.15.158:0/2140239962 >> v2:172.21.15.183:3300/0 conn(0x7fe1200c27c0 0x7fe1200664a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.205 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11effd700 1 -- 172.21.15.158:0/2140239962 >> v2:172.21.15.158:3300/0 conn(0x7fe120065670 msgr2=0x7fe120065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:01.206 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11effd700 1 --2- 172.21.15.158:0/2140239962 >> v2:172.21.15.158:3300/0 conn(0x7fe120065670 0x7fe120065ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.206 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11effd700 1 -- 172.21.15.158:0/2140239962 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe120150550 con 0x7fe1200c23e0 2023-10-18T17:24:01.206 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11effd700 1 --2- 172.21.15.158:0/2140239962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1200c23e0 0x7fe1200c11f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe1200c7620 tx=0x7fe1100090f0).ready entity=mon.2 client_cookie=f2bfef3662e7d464 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:01.206 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11dffb700 1 -- 172.21.15.158:0/2140239962 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11000f510 con 0x7fe1200c23e0 2023-10-18T17:24:01.206 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11dffb700 1 -- 172.21.15.158:0/2140239962 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11000f670 con 0x7fe1200c23e0 2023-10-18T17:24:01.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.195+0000 7fe11dffb700 1 -- 172.21.15.158:0/2140239962 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11000f9f0 con 0x7fe1200c23e0 2023-10-18T17:24:01.208 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.199+0000 7fe11ffff700 1 -- 172.21.15.158:0/2140239962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1200c23e0 msgr2=0x7fe1200c11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:01.208 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.199+0000 7fe11ffff700 1 --2- 172.21.15.158:0/2140239962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1200c23e0 0x7fe1200c11f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe1200c7620 tx=0x7fe1100090f0).stop 2023-10-18T17:24:01.208 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.199+0000 7fe11ffff700 1 -- 172.21.15.158:0/2140239962 shutdown_connections 2023-10-18T17:24:01.208 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.199+0000 7fe11ffff700 1 --2- 172.21.15.158:0/2140239962 >> v2:172.21.15.158:3300/0 conn(0x7fe120065670 0x7fe120065ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.199+0000 7fe11ffff700 1 --2- 172.21.15.158:0/2140239962 >> v2:172.21.15.183:3300/0 conn(0x7fe1200c27c0 0x7fe1200664a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.199+0000 7fe11ffff700 1 --2- 172.21.15.158:0/2140239962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1200c23e0 0x7fe1200c11f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.199+0000 7fe11ffff700 1 -- 172.21.15.158:0/2140239962 >> 172.21.15.158:0/2140239962 conn(0x7fe1200620d0 msgr2=0x7fe1200624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:01.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.199+0000 7fe11ffff700 1 -- 172.21.15.158:0/2140239962 shutdown_connections 2023-10-18T17:24:01.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.199+0000 7fe11ffff700 1 -- 172.21.15.158:0/2140239962 wait complete. 2023-10-18T17:24:01.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.199+0000 7fe11ffff700 1 Processor -- start 2023-10-18T17:24:01.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.203+0000 7fe11ffff700 1 -- start start 2023-10-18T17:24:01.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.203+0000 7fe11ffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe120065670 0x7fe12014e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:01.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.203+0000 7fe11ffff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1200c23e0 0x7fe1201512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:01.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.203+0000 7fe11ffff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1200c27c0 0x7fe120151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:01.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.203+0000 7fe11ffff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1201543a0 con 0x7fe1200c23e0 2023-10-18T17:24:01.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.203+0000 7fe11ffff700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe120153f10 con 0x7fe1200c27c0 2023-10-18T17:24:01.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.203+0000 7fe11ffff700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe120152fc0 con 0x7fe120065670 2023-10-18T17:24:01.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.203+0000 7fe11effd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe120065670 0x7fe12014e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:01.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.203+0000 7fe11effd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe120065670 0x7fe12014e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:38026/0 (socket says 172.21.15.158:38026) 2023-10-18T17:24:01.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.203+0000 7fe11effd700 1 -- 172.21.15.158:0/3329641253 learned_addr learned my addr 172.21.15.158:0/3329641253 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:01.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.203+0000 7fe11f7fe700 1 --2- 172.21.15.158:0/3329641253 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1200c27c0 0x7fe120151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:01.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.203+0000 7fe11e7fc700 1 --2- 172.21.15.158:0/3329641253 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1200c23e0 0x7fe1201512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:01.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.203+0000 7fe11effd700 1 -- 172.21.15.158:0/3329641253 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1200c27c0 msgr2=0x7fe120151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:01.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.203+0000 7fe11effd700 1 --2- 172.21.15.158:0/3329641253 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1200c27c0 0x7fe120151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.203+0000 7fe11effd700 1 -- 172.21.15.158:0/3329641253 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1200c23e0 msgr2=0x7fe1201512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:01.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.203+0000 7fe11effd700 1 --2- 172.21.15.158:0/3329641253 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1200c23e0 0x7fe1201512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.203+0000 7fe11effd700 1 -- 172.21.15.158:0/3329641253 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe110009370 con 0x7fe120065670 2023-10-18T17:24:01.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.203+0000 7fe11f7fe700 1 --2- 172.21.15.158:0/3329641253 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1200c27c0 0x7fe120151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:01.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.203+0000 7fe11effd700 1 --2- 172.21.15.158:0/3329641253 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe120065670 0x7fe12014e700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fe110006fd0 tx=0x7fe110017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:01.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.207+0000 7fe106ffd700 1 -- 172.21.15.158:0/3329641253 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11000f7e0 con 0x7fe120065670 2023-10-18T17:24:01.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.207+0000 7fe106ffd700 1 -- 172.21.15.158:0/3329641253 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11000f940 con 0x7fe120065670 2023-10-18T17:24:01.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.207+0000 7fe106ffd700 1 -- 172.21.15.158:0/3329641253 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11001c670 con 0x7fe120065670 2023-10-18T17:24:01.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.207+0000 7fe11ffff700 1 -- 172.21.15.158:0/3329641253 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe120153280 con 0x7fe120065670 2023-10-18T17:24:01.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.207+0000 7fe11ffff700 1 -- 172.21.15.158:0/3329641253 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1201538c0 con 0x7fe120065670 2023-10-18T17:24:01.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.207+0000 7fe11ffff700 1 -- 172.21.15.158:0/3329641253 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe120046f00 con 0x7fe120065670 2023-10-18T17:24:01.218 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.207+0000 7fe106ffd700 1 -- 172.21.15.158:0/3329641253 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe11001ca60 con 0x7fe120065670 2023-10-18T17:24:01.218 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.211+0000 7fe106ffd700 1 --2- 172.21.15.158:0/3329641253 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fe10c05a590 0x7fe10c05ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:01.218 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.211+0000 7fe106ffd700 1 -- 172.21.15.158:0/3329641253 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fe1100760b0 con 0x7fe120065670 2023-10-18T17:24:01.218 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.211+0000 7fe11e7fc700 1 --2- 172.21.15.158:0/3329641253 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fe10c05a590 0x7fe10c05ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:01.219 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.211+0000 7fe11e7fc700 1 --2- 172.21.15.158:0/3329641253 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fe10c05a590 0x7fe10c05ca50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fe12014c0b0 tx=0x7fe114009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:01.229 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.223+0000 7fe106ffd700 1 -- 172.21.15.158:0/3329641253 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fe110049ba0 con 0x7fe120065670 2023-10-18T17:24:01.392 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.383+0000 7fe11ffff700 1 -- 172.21.15.158:0/3329641253 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe120063e20 con 0x7fe120065670 2023-10-18T17:24:01.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.387+0000 7fe106ffd700 1 -- 172.21.15.158:0/3329641253 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe110020070 con 0x7fe120065670 2023-10-18T17:24:01.393 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2023-10-18T17:24:01.395 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.387+0000 7fe11ffff700 1 -- 172.21.15.158:0/3329641253 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fe10c05a590 msgr2=0x7fe10c05ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:01.396 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.387+0000 7fe11ffff700 1 --2- 172.21.15.158:0/3329641253 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fe10c05a590 0x7fe10c05ca50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fe12014c0b0 tx=0x7fe114009060).stop 2023-10-18T17:24:01.396 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.387+0000 7fe11ffff700 1 -- 172.21.15.158:0/3329641253 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe120065670 msgr2=0x7fe12014e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:01.396 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.387+0000 7fe11ffff700 1 --2- 172.21.15.158:0/3329641253 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe120065670 0x7fe12014e700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fe110006fd0 tx=0x7fe110017000).stop 2023-10-18T17:24:01.397 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.387+0000 7fe11ffff700 1 -- 172.21.15.158:0/3329641253 shutdown_connections 2023-10-18T17:24:01.397 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.387+0000 7fe11ffff700 1 --2- 172.21.15.158:0/3329641253 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fe10c05a590 0x7fe10c05ca50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.397 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.387+0000 7fe11ffff700 1 --2- 172.21.15.158:0/3329641253 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1200c27c0 0x7fe120151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.398 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.387+0000 7fe11ffff700 1 --2- 172.21.15.158:0/3329641253 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1200c23e0 0x7fe1201512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.398 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.387+0000 7fe11ffff700 1 --2- 172.21.15.158:0/3329641253 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe120065670 0x7fe12014e700 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.398 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.387+0000 7fe11ffff700 1 -- 172.21.15.158:0/3329641253 >> 172.21.15.158:0/3329641253 conn(0x7fe1200620d0 msgr2=0x7fe12014dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:01.398 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.387+0000 7fe11ffff700 1 -- 172.21.15.158:0/3329641253 shutdown_connections 2023-10-18T17:24:01.398 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.387+0000 7fe11ffff700 1 -- 172.21.15.158:0/3329641253 wait complete. 2023-10-18T17:24:01.416 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-18T17:24:01.575 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.567+0000 7fc48ffff700 1 Processor -- start 2023-10-18T17:24:01.575 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.567+0000 7fc48ffff700 1 -- start start 2023-10-18T17:24:01.577 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48ffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc490066340 0x7fc490062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:01.577 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48ffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc49014d020 0x7fc49014d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:01.578 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48ffff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4900c1610 con 0x7fc490062270 2023-10-18T17:24:01.578 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48ffff700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc49014d9c0 con 0x7fc490066340 2023-10-18T17:24:01.578 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48ffff700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900c2dd0 con 0x7fc49014d020 2023-10-18T17:24:01.578 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48effd700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fc490062270 0x7fc4900c0f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:58656/0 (socket says 172.21.15.158:58656) 2023-10-18T17:24:01.579 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48effd700 1 -- 172.21.15.158:0/2652151352 learned_addr learned my addr 172.21.15.158:0/2652151352 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:01.580 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48f7fe700 1 --2- 172.21.15.158:0/2652151352 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc49014d020 0x7fc49014d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:01.581 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48e7fc700 1 --2- 172.21.15.158:0/2652151352 >> v2:172.21.15.183:3300/0 conn(0x7fc490066340 0x7fc490062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:01.581 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48dffb700 1 -- 172.21.15.158:0/2652151352 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228714741 0 0) 0x7fc4900c1610 con 0x7fc490062270 2023-10-18T17:24:01.581 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48f7fe700 1 -- 172.21.15.158:0/2652151352 >> v2:172.21.15.183:3300/0 conn(0x7fc490066340 msgr2=0x7fc490062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:01.581 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48f7fe700 1 --2- 172.21.15.158:0/2652151352 >> v2:172.21.15.183:3300/0 conn(0x7fc490066340 0x7fc490062650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.581 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48f7fe700 1 -- 172.21.15.158:0/2652151352 >> v1:172.21.15.158:6789/0 conn(0x7fc490062270 legacy=0x7fc4900c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:01.582 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48f7fe700 1 -- 172.21.15.158:0/2652151352 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc490153570 con 0x7fc49014d020 2023-10-18T17:24:01.582 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48f7fe700 1 --2- 172.21.15.158:0/2652151352 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc49014d020 0x7fc49014d4d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fc488009e60 tx=0x7fc488009780).ready entity=mon.2 client_cookie=fa2a336c6887359b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:01.582 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48dffb700 1 -- 172.21.15.158:0/2652151352 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48800e070 con 0x7fc49014d020 2023-10-18T17:24:01.582 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48dffb700 1 -- 172.21.15.158:0/2652151352 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48800bcc0 con 0x7fc49014d020 2023-10-18T17:24:01.582 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48dffb700 1 -- 172.21.15.158:0/2652151352 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488012620 con 0x7fc49014d020 2023-10-18T17:24:01.583 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48ffff700 1 -- 172.21.15.158:0/2652151352 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc49014d020 msgr2=0x7fc49014d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:01.583 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.571+0000 7fc48ffff700 1 --2- 172.21.15.158:0/2652151352 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc49014d020 0x7fc49014d4d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fc488009e60 tx=0x7fc488009780).stop 2023-10-18T17:24:01.583 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.575+0000 7fc48ffff700 1 -- 172.21.15.158:0/2652151352 shutdown_connections 2023-10-18T17:24:01.583 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.575+0000 7fc48ffff700 1 --2- 172.21.15.158:0/2652151352 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc49014d020 0x7fc49014d4d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.583 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.575+0000 7fc48ffff700 1 --2- 172.21.15.158:0/2652151352 >> v2:172.21.15.183:3300/0 conn(0x7fc490066340 0x7fc490062650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.584 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.575+0000 7fc48ffff700 1 -- 172.21.15.158:0/2652151352 >> 172.21.15.158:0/2652151352 conn(0x7fc49005ddc0 msgr2=0x7fc49005e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:01.584 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.575+0000 7fc48ffff700 1 -- 172.21.15.158:0/2652151352 shutdown_connections 2023-10-18T17:24:01.584 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.575+0000 7fc48ffff700 1 -- 172.21.15.158:0/2652151352 wait complete. 2023-10-18T17:24:01.585 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.575+0000 7fc48ffff700 1 Processor -- start 2023-10-18T17:24:01.585 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.575+0000 7fc48ffff700 1 -- start start 2023-10-18T17:24:01.586 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc48ffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc490062270 0x7fc490148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:01.586 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc48ffff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc490066340 0x7fc490163390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:01.586 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc48ffff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc49014d020 0x7fc490163880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:01.586 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc48ffff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900c2560 con 0x7fc490066340 2023-10-18T17:24:01.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc48ffff700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc490148850 con 0x7fc49014d020 2023-10-18T17:24:01.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc48ffff700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49014fb30 con 0x7fc490062270 2023-10-18T17:24:01.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc48e7fc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc490066340 0x7fc490163390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:01.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc48e7fc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc490066340 0x7fc490163390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56472/0 (socket says 172.21.15.158:56472) 2023-10-18T17:24:01.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc48e7fc700 1 -- 172.21.15.158:0/2752858777 learned_addr learned my addr 172.21.15.158:0/2752858777 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:01.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc48effd700 1 --2- 172.21.15.158:0/2752858777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc490062270 0x7fc490148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:01.588 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc48f7fe700 1 --2- 172.21.15.158:0/2752858777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc49014d020 0x7fc490163880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:01.589 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc48e7fc700 1 -- 172.21.15.158:0/2752858777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc490062270 msgr2=0x7fc490148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:01.589 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc48e7fc700 1 --2- 172.21.15.158:0/2752858777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc490062270 0x7fc490148360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.589 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc48e7fc700 1 -- 172.21.15.158:0/2752858777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc49014d020 msgr2=0x7fc490163880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:01.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc48e7fc700 1 --2- 172.21.15.158:0/2752858777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc49014d020 0x7fc490163880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc48e7fc700 1 -- 172.21.15.158:0/2752858777 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc488009a20 con 0x7fc490066340 2023-10-18T17:24:01.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc48e7fc700 1 --2- 172.21.15.158:0/2752858777 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc490066340 0x7fc490163390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc48400d890 tx=0x7fc484008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:01.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc476ffd700 1 -- 172.21.15.158:0/2752858777 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48400f520 con 0x7fc490066340 2023-10-18T17:24:01.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc476ffd700 1 -- 172.21.15.158:0/2752858777 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48400f680 con 0x7fc490066340 2023-10-18T17:24:01.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc476ffd700 1 -- 172.21.15.158:0/2752858777 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48400fa00 con 0x7fc490066340 2023-10-18T17:24:01.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc48ffff700 1 -- 172.21.15.158:0/2752858777 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49014fe10 con 0x7fc490066340 2023-10-18T17:24:01.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.579+0000 7fc48ffff700 1 -- 172.21.15.158:0/2752858777 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4901503d0 con 0x7fc490066340 2023-10-18T17:24:01.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.583+0000 7fc48ffff700 1 -- 172.21.15.158:0/2752858777 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc490046f00 con 0x7fc490066340 2023-10-18T17:24:01.592 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.583+0000 7fc476ffd700 1 -- 172.21.15.158:0/2752858777 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc484013480 con 0x7fc490066340 2023-10-18T17:24:01.592 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.583+0000 7fc476ffd700 1 --2- 172.21.15.158:0/2752858777 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc47c05a4e0 0x7fc47c05c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:01.593 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.583+0000 7fc476ffd700 1 -- 172.21.15.158:0/2752858777 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fc484073fe0 con 0x7fc490066340 2023-10-18T17:24:01.593 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.583+0000 7fc48effd700 1 --2- 172.21.15.158:0/2752858777 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc47c05a4e0 0x7fc47c05c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:01.593 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.587+0000 7fc48effd700 1 --2- 172.21.15.158:0/2752858777 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc47c05a4e0 0x7fc47c05c9a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc4800011e0 tx=0x7fc480007b90).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:01.598 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.591+0000 7fc476ffd700 1 -- 172.21.15.158:0/2752858777 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fc484047a30 con 0x7fc490066340 2023-10-18T17:24:01.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.759+0000 7fc48ffff700 1 -- 172.21.15.158:0/2752858777 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc490153850 con 0x7fc490066340 2023-10-18T17:24:01.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.763+0000 7fc476ffd700 1 -- 172.21.15.158:0/2752858777 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7fc48404b050 con 0x7fc490066340 2023-10-18T17:24:01.768 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:01.769 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2023-10-18T17:24:01.769 INFO:teuthology.orchestra.run.smithi158.stdout: { 2023-10-18T17:24:01.769 INFO:teuthology.orchestra.run.smithi158.stdout: "poolnum": 1, 2023-10-18T17:24:01.769 INFO:teuthology.orchestra.run.smithi158.stdout: "poolname": "device_health_metrics" 2023-10-18T17:24:01.769 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T17:24:01.770 INFO:teuthology.orchestra.run.smithi158.stdout: { 2023-10-18T17:24:01.770 INFO:teuthology.orchestra.run.smithi158.stdout: "poolnum": 2, 2023-10-18T17:24:01.770 INFO:teuthology.orchestra.run.smithi158.stdout: "poolname": "rbd" 2023-10-18T17:24:01.770 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T17:24:01.770 INFO:teuthology.orchestra.run.smithi158.stdout:] 2023-10-18T17:24:01.771 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.763+0000 7fc48ffff700 1 -- 172.21.15.158:0/2752858777 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc47c05a4e0 msgr2=0x7fc47c05c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:01.771 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.763+0000 7fc48ffff700 1 --2- 172.21.15.158:0/2752858777 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc47c05a4e0 0x7fc47c05c9a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc4800011e0 tx=0x7fc480007b90).stop 2023-10-18T17:24:01.772 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.763+0000 7fc48ffff700 1 -- 172.21.15.158:0/2752858777 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc490066340 msgr2=0x7fc490163390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:01.772 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.763+0000 7fc48ffff700 1 --2- 172.21.15.158:0/2752858777 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc490066340 0x7fc490163390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc48400d890 tx=0x7fc484008040).stop 2023-10-18T17:24:01.772 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.763+0000 7fc48ffff700 1 -- 172.21.15.158:0/2752858777 shutdown_connections 2023-10-18T17:24:01.772 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.763+0000 7fc48ffff700 1 --2- 172.21.15.158:0/2752858777 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc47c05a4e0 0x7fc47c05c9a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.772 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.763+0000 7fc48ffff700 1 --2- 172.21.15.158:0/2752858777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc49014d020 0x7fc490163880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.773 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.763+0000 7fc48ffff700 1 --2- 172.21.15.158:0/2752858777 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc490066340 0x7fc490163390 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.773 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.763+0000 7fc48ffff700 1 --2- 172.21.15.158:0/2752858777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc490062270 0x7fc490148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.773 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.763+0000 7fc48ffff700 1 -- 172.21.15.158:0/2752858777 >> 172.21.15.158:0/2752858777 conn(0x7fc49005ddc0 msgr2=0x7fc490152c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:01.773 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.763+0000 7fc48ffff700 1 -- 172.21.15.158:0/2752858777 shutdown_connections 2023-10-18T17:24:01.773 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.763+0000 7fc48ffff700 1 -- 172.21.15.158:0/2752858777 wait complete. 2023-10-18T17:24:01.790 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-18T17:24:01.790 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-10-18T17:24:01.948 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.943+0000 7f171721b700 1 Processor -- start 2023-10-18T17:24:01.949 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.943+0000 7f171721b700 1 -- start start 2023-10-18T17:24:01.952 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.943+0000 7f171721b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1710151ee0 0x7f17100689e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:01.952 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.943+0000 7f171721b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17101500e0 con 0x7f171014a160 2023-10-18T17:24:01.952 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f171721b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17101503c0 con 0x7f1710149d80 2023-10-18T17:24:01.952 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f171721b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17101506a0 con 0x7f1710151ee0 2023-10-18T17:24:01.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f170ffff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f171014a160 0x7f17101517d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:58668/0 (socket says 172.21.15.158:58668) 2023-10-18T17:24:01.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f1714fb7700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f1710149d80 0x7f17100c69f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:40676/0 (socket says 172.21.15.158:40676) 2023-10-18T17:24:01.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f170ffff700 1 -- 172.21.15.158:0/1282464935 learned_addr learned my addr 172.21.15.158:0/1282464935 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:01.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f17157b8700 1 --2- 172.21.15.158:0/1282464935 >> v2:172.21.15.158:3300/0 conn(0x7f1710151ee0 0x7f17100689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:01.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f170f7fe700 1 -- 172.21.15.158:0/1282464935 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776195749 0 0) 0x7f17101503c0 con 0x7f1710149d80 2023-10-18T17:24:01.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f170f7fe700 1 -- 172.21.15.158:0/1282464935 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17000033f0 con 0x7f1710149d80 2023-10-18T17:24:01.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f170f7fe700 1 -- 172.21.15.158:0/1282464935 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509321310 0 0) 0x7f17101500e0 con 0x7f171014a160 2023-10-18T17:24:01.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f170f7fe700 1 -- 172.21.15.158:0/1282464935 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17101503c0 con 0x7f171014a160 2023-10-18T17:24:01.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f17157b8700 1 -- 172.21.15.158:0/1282464935 >> v1:172.21.15.183:6789/0 conn(0x7f1710149d80 legacy=0x7f17100c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:01.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f17157b8700 1 -- 172.21.15.158:0/1282464935 >> v1:172.21.15.158:6789/0 conn(0x7f171014a160 legacy=0x7f17101517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:01.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f17157b8700 1 -- 172.21.15.158:0/1282464935 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1710150980 con 0x7f1710151ee0 2023-10-18T17:24:01.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f17157b8700 1 --2- 172.21.15.158:0/1282464935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1710151ee0 0x7f17100689e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f1708009e60 tx=0x7f1708009780).ready entity=mon.0 client_cookie=cd56bf143edddae5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:01.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f170f7fe700 1 -- 172.21.15.158:0/1282464935 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170800e070 con 0x7f1710151ee0 2023-10-18T17:24:01.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f170f7fe700 1 -- 172.21.15.158:0/1282464935 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170800bab0 con 0x7f1710151ee0 2023-10-18T17:24:01.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f170f7fe700 1 -- 172.21.15.158:0/1282464935 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170800be30 con 0x7f1710151ee0 2023-10-18T17:24:01.958 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f171721b700 1 -- 172.21.15.158:0/1282464935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1710151ee0 msgr2=0x7f17100689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:01.958 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f171721b700 1 --2- 172.21.15.158:0/1282464935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1710151ee0 0x7f17100689e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f1708009e60 tx=0x7f1708009780).stop 2023-10-18T17:24:01.958 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f171721b700 1 -- 172.21.15.158:0/1282464935 shutdown_connections 2023-10-18T17:24:01.958 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f171721b700 1 --2- 172.21.15.158:0/1282464935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1710151ee0 0x7f17100689e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.958 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f171721b700 1 -- 172.21.15.158:0/1282464935 >> 172.21.15.158:0/1282464935 conn(0x7f171005dc20 msgr2=0x7f171005e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:01.959 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f171721b700 1 -- 172.21.15.158:0/1282464935 shutdown_connections 2023-10-18T17:24:01.959 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.947+0000 7f171721b700 1 -- 172.21.15.158:0/1282464935 wait complete. 2023-10-18T17:24:01.959 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.951+0000 7f171721b700 1 Processor -- start 2023-10-18T17:24:01.959 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.951+0000 7f171721b700 1 -- start start 2023-10-18T17:24:01.961 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f171721b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1710149d80 0x7f17101614b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:01.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f171721b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f171014a160 0x7f17100c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:01.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f171721b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1710151ee0 0x7f1710154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:01.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f171721b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1710153cd0 con 0x7f171014a160 2023-10-18T17:24:01.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f171721b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17101619a0 con 0x7f1710149d80 2023-10-18T17:24:01.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f171721b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171014df10 con 0x7f1710151ee0 2023-10-18T17:24:01.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f170ffff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f171014a160 0x7f17100c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:01.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f1714fb7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1710149d80 0x7f17101614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:01.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f170ffff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f171014a160 0x7f17100c28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56492/0 (socket says 172.21.15.158:56492) 2023-10-18T17:24:01.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f170ffff700 1 -- 172.21.15.158:0/2513103046 learned_addr learned my addr 172.21.15.158:0/2513103046 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:01.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f17157b8700 1 --2- 172.21.15.158:0/2513103046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1710151ee0 0x7f1710154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:01.964 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f170ffff700 1 -- 172.21.15.158:0/2513103046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1710151ee0 msgr2=0x7f1710154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:01.965 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f170ffff700 1 --2- 172.21.15.158:0/2513103046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1710151ee0 0x7f1710154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.965 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f170ffff700 1 -- 172.21.15.158:0/2513103046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1710149d80 msgr2=0x7f17101614b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:01.965 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f170ffff700 1 --2- 172.21.15.158:0/2513103046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1710149d80 0x7f17101614b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:01.965 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f170ffff700 1 -- 172.21.15.158:0/2513103046 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1708009a20 con 0x7f171014a160 2023-10-18T17:24:01.965 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f170ffff700 1 --2- 172.21.15.158:0/2513103046 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f171014a160 0x7f17100c28d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f16fc00c470 tx=0x7f16fc007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:01.966 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f170cff9700 1 -- 172.21.15.158:0/2513103046 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc00ce70 con 0x7f171014a160 2023-10-18T17:24:01.966 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f170cff9700 1 -- 172.21.15.158:0/2513103046 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16fc0072e0 con 0x7f171014a160 2023-10-18T17:24:01.966 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f171721b700 1 -- 172.21.15.158:0/2513103046 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f171014e1f0 con 0x7f171014a160 2023-10-18T17:24:01.966 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f170cff9700 1 -- 172.21.15.158:0/2513103046 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc007660 con 0x7f171014a160 2023-10-18T17:24:01.966 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.955+0000 7f171721b700 1 -- 172.21.15.158:0/2513103046 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1710153960 con 0x7f171014a160 2023-10-18T17:24:01.967 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.959+0000 7f171721b700 1 -- 172.21.15.158:0/2513103046 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17101537c0 con 0x7f171014a160 2023-10-18T17:24:01.967 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.959+0000 7f170cff9700 1 -- 172.21.15.158:0/2513103046 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f16fc0059b0 con 0x7f171014a160 2023-10-18T17:24:01.969 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.963+0000 7f170cff9700 1 --2- 172.21.15.158:0/2513103046 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f16f405a540 0x7f16f405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:01.970 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.963+0000 7f170cff9700 1 -- 172.21.15.158:0/2513103046 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f16fc073950 con 0x7f171014a160 2023-10-18T17:24:01.970 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.963+0000 7f1714fb7700 1 --2- 172.21.15.158:0/2513103046 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f16f405a540 0x7f16f405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:01.970 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.963+0000 7f1714fb7700 1 --2- 172.21.15.158:0/2513103046 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f16f405a540 0x7f16f405ca00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f17040076c0 tx=0x7f1704007bc0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:01.974 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:01.967+0000 7f170cff9700 1 -- 172.21.15.158:0/2513103046 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f17101537c0 con 0x7f171014a160 2023-10-18T17:24:02.137 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.131+0000 7f171721b700 1 -- 172.21.15.158:0/2513103046 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f17101537c0 con 0x7f171014a160 2023-10-18T17:24:02.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.699+0000 7f170cff9700 1 -- 172.21.15.158:0/2513103046 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 152+0+0 (secure 0 0 0) 0x7f17101537c0 con 0x7f171014a160 2023-10-18T17:24:02.714 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.707+0000 7f171721b700 1 -- 172.21.15.158:0/2513103046 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f16f405a540 msgr2=0x7f16f405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:02.714 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.707+0000 7f171721b700 1 --2- 172.21.15.158:0/2513103046 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f16f405a540 0x7f16f405ca00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f17040076c0 tx=0x7f1704007bc0).stop 2023-10-18T17:24:02.714 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.707+0000 7f171721b700 1 -- 172.21.15.158:0/2513103046 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f171014a160 msgr2=0x7f17100c28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:02.714 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.707+0000 7f171721b700 1 --2- 172.21.15.158:0/2513103046 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f171014a160 0x7f17100c28d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f16fc00c470 tx=0x7f16fc007c50).stop 2023-10-18T17:24:02.715 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.707+0000 7f171721b700 1 -- 172.21.15.158:0/2513103046 shutdown_connections 2023-10-18T17:24:02.715 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.707+0000 7f171721b700 1 --2- 172.21.15.158:0/2513103046 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f16f405a540 0x7f16f405ca00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:02.715 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.707+0000 7f171721b700 1 --2- 172.21.15.158:0/2513103046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1710151ee0 0x7f1710154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:02.716 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.707+0000 7f171721b700 1 --2- 172.21.15.158:0/2513103046 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f171014a160 0x7f17100c28d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:02.716 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.707+0000 7f171721b700 1 --2- 172.21.15.158:0/2513103046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1710149d80 0x7f17101614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:02.716 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.707+0000 7f171721b700 1 -- 172.21.15.158:0/2513103046 >> 172.21.15.158:0/2513103046 conn(0x7f171005dc20 msgr2=0x7f17100c6890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:02.716 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.707+0000 7f171721b700 1 -- 172.21.15.158:0/2513103046 shutdown_connections 2023-10-18T17:24:02.716 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.707+0000 7f171721b700 1 -- 172.21.15.158:0/2513103046 wait complete. 2023-10-18T17:24:02.720 INFO:teuthology.orchestra.run.smithi158.stderr:pool 'cephfs_metadata' created 2023-10-18T17:24:02.737 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-18T17:24:02.905 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.899+0000 7faa9c11b700 1 Processor -- start 2023-10-18T17:24:02.906 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.899+0000 7faa9c11b700 1 -- start start 2023-10-18T17:24:02.909 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.903+0000 7faa9c11b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7faa94149d80 0x7faa9414a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:02.910 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.903+0000 7faa9c11b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faa940689e0 0x7faa940661c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:02.910 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.903+0000 7faa9c11b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa941500e0 con 0x7faa940c69f0 2023-10-18T17:24:02.910 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.903+0000 7faa9c11b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa941503c0 con 0x7faa94149d80 2023-10-18T17:24:02.910 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.903+0000 7faa9c11b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa941506a0 con 0x7faa940689e0 2023-10-18T17:24:02.912 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.903+0000 7faa99eb7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7faa94149d80 0x7faa9414a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:02.912 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.903+0000 7faa99eb7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7faa94149d80 0x7faa9414a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56498/0 (socket says 172.21.15.158:56498) 2023-10-18T17:24:02.912 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.903+0000 7faa99eb7700 1 -- 172.21.15.158:0/439111356 learned_addr learned my addr 172.21.15.158:0/439111356 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:02.912 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.903+0000 7faa996b6700 1 --2- 172.21.15.158:0/439111356 >> v2:172.21.15.183:3300/0 conn(0x7faa940689e0 0x7faa940661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:02.913 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.903+0000 7faa99eb7700 1 -- 172.21.15.158:0/439111356 >> v2:172.21.15.183:3300/0 conn(0x7faa940689e0 msgr2=0x7faa940661c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:02.913 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.903+0000 7faa99eb7700 1 --2- 172.21.15.158:0/439111356 >> v2:172.21.15.183:3300/0 conn(0x7faa940689e0 0x7faa940661c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:02.913 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.903+0000 7faa99eb7700 1 -- 172.21.15.158:0/439111356 >> v1:172.21.15.158:6789/0 conn(0x7faa940c69f0 legacy=0x7faa941517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:02.913 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.903+0000 7faa99eb7700 1 -- 172.21.15.158:0/439111356 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa94150980 con 0x7faa94149d80 2023-10-18T17:24:02.913 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.903+0000 7faa99eb7700 1 --2- 172.21.15.158:0/439111356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa94149d80 0x7faa9414a160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7faa940c0ad0 tx=0x7faa900090f0).ready entity=mon.0 client_cookie=2045a57df7d1b32d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:02.913 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.903+0000 7faa98eb5700 1 -- 172.21.15.158:0/439111356 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9000b520 con 0x7faa94149d80 2023-10-18T17:24:02.914 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.903+0000 7faa98eb5700 1 -- 172.21.15.158:0/439111356 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9000b680 con 0x7faa94149d80 2023-10-18T17:24:02.914 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.903+0000 7faa98eb5700 1 -- 172.21.15.158:0/439111356 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9000ba00 con 0x7faa94149d80 2023-10-18T17:24:02.915 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.907+0000 7faa9c11b700 1 -- 172.21.15.158:0/439111356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa94149d80 msgr2=0x7faa9414a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:02.915 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.907+0000 7faa9c11b700 1 --2- 172.21.15.158:0/439111356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa94149d80 0x7faa9414a160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7faa940c0ad0 tx=0x7faa900090f0).stop 2023-10-18T17:24:02.915 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.907+0000 7faa9c11b700 1 -- 172.21.15.158:0/439111356 shutdown_connections 2023-10-18T17:24:02.915 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.907+0000 7faa9c11b700 1 --2- 172.21.15.158:0/439111356 >> v2:172.21.15.183:3300/0 conn(0x7faa940689e0 0x7faa940661c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:02.916 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.907+0000 7faa9c11b700 1 --2- 172.21.15.158:0/439111356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa94149d80 0x7faa9414a160 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:02.916 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.907+0000 7faa9c11b700 1 -- 172.21.15.158:0/439111356 >> 172.21.15.158:0/439111356 conn(0x7faa9405dc20 msgr2=0x7faa9405e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:02.916 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.907+0000 7faa9c11b700 1 -- 172.21.15.158:0/439111356 shutdown_connections 2023-10-18T17:24:02.916 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.907+0000 7faa9c11b700 1 -- 172.21.15.158:0/439111356 wait complete. 2023-10-18T17:24:02.917 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa9c11b700 1 Processor -- start 2023-10-18T17:24:02.917 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa9c11b700 1 -- start start 2023-10-18T17:24:02.918 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa9c11b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa940689e0 0x7faa940b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:02.918 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa9c11b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa940c69f0 0x7faa940bfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:02.919 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa9c11b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa94149d80 0x7faa940ba840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:02.919 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa9c11b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa940b9c30 con 0x7faa94149d80 2023-10-18T17:24:02.919 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa9c11b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9414dfe0 con 0x7faa940c69f0 2023-10-18T17:24:02.919 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa9c11b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa940b90b0 con 0x7faa940689e0 2023-10-18T17:24:02.919 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa9a6b8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa94149d80 0x7faa940ba840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:02.920 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa99eb7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa940689e0 0x7faa940b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:02.920 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa996b6700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa940c69f0 0x7faa940bfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:02.920 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa9a6b8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa94149d80 0x7faa940ba840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56510/0 (socket says 172.21.15.158:56510) 2023-10-18T17:24:02.920 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa9a6b8700 1 -- 172.21.15.158:0/2354170372 learned_addr learned my addr 172.21.15.158:0/2354170372 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:02.922 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa9a6b8700 1 -- 172.21.15.158:0/2354170372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa940689e0 msgr2=0x7faa940b7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:02.922 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa9a6b8700 1 --2- 172.21.15.158:0/2354170372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa940689e0 0x7faa940b7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:02.922 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa9a6b8700 1 -- 172.21.15.158:0/2354170372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa940c69f0 msgr2=0x7faa940bfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:02.922 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa9a6b8700 1 --2- 172.21.15.158:0/2354170372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa940c69f0 0x7faa940bfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:02.922 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa9a6b8700 1 -- 172.21.15.158:0/2354170372 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa90009370 con 0x7faa94149d80 2023-10-18T17:24:02.923 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa9a6b8700 1 --2- 172.21.15.158:0/2354170372 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa94149d80 0x7faa940ba840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7faa8c00c7f0 tx=0x7faa8c001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:02.923 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.911+0000 7faa89ffb700 1 -- 172.21.15.158:0/2354170372 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c00e4a0 con 0x7faa94149d80 2023-10-18T17:24:02.923 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.915+0000 7faa89ffb700 1 -- 172.21.15.158:0/2354170372 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8c00e600 con 0x7faa94149d80 2023-10-18T17:24:02.923 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.915+0000 7faa89ffb700 1 -- 172.21.15.158:0/2354170372 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c00e980 con 0x7faa94149d80 2023-10-18T17:24:02.923 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.915+0000 7faa9c11b700 1 -- 172.21.15.158:0/2354170372 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa940b9390 con 0x7faa94149d80 2023-10-18T17:24:02.924 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.915+0000 7faa9c11b700 1 -- 172.21.15.158:0/2354170372 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa940b9950 con 0x7faa94149d80 2023-10-18T17:24:02.924 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.915+0000 7faa9c11b700 1 -- 172.21.15.158:0/2354170372 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa9406c190 con 0x7faa94149d80 2023-10-18T17:24:02.925 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.915+0000 7faa89ffb700 1 -- 172.21.15.158:0/2354170372 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7faa8c0123f0 con 0x7faa94149d80 2023-10-18T17:24:02.925 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.919+0000 7faa89ffb700 1 --2- 172.21.15.158:0/2354170372 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7faa7805a510 0x7faa7805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:02.925 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.919+0000 7faa89ffb700 1 -- 172.21.15.158:0/2354170372 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5639+0+0 (secure 0 0 0) 0x7faa8c073da0 con 0x7faa94149d80 2023-10-18T17:24:02.926 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.919+0000 7faa99eb7700 1 --2- 172.21.15.158:0/2354170372 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7faa7805a510 0x7faa7805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:02.926 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.919+0000 7faa99eb7700 1 --2- 172.21.15.158:0/2354170372 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7faa7805a510 0x7faa7805c9d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7faa90009130 tx=0x7faa90017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:02.932 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:02.927+0000 7faa89ffb700 1 -- 172.21.15.158:0/2354170372 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7faa8c047700 con 0x7faa94149d80 2023-10-18T17:24:03.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.091+0000 7faa9c11b700 1 -- 172.21.15.158:0/2354170372 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7faa940bb8d0 con 0x7faa94149d80 2023-10-18T17:24:03.722 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.715+0000 7faa89ffb700 1 -- 172.21.15.158:0/2354170372 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7faa8c04ad20 con 0x7faa94149d80 2023-10-18T17:24:03.728 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.723+0000 7faa9c11b700 1 -- 172.21.15.158:0/2354170372 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7faa7805a510 msgr2=0x7faa7805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:03.729 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.723+0000 7faa9c11b700 1 --2- 172.21.15.158:0/2354170372 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7faa7805a510 0x7faa7805c9d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7faa90009130 tx=0x7faa90017000).stop 2023-10-18T17:24:03.729 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.723+0000 7faa9c11b700 1 -- 172.21.15.158:0/2354170372 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa94149d80 msgr2=0x7faa940ba840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:03.729 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.723+0000 7faa9c11b700 1 --2- 172.21.15.158:0/2354170372 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa94149d80 0x7faa940ba840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7faa8c00c7f0 tx=0x7faa8c001510).stop 2023-10-18T17:24:03.731 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.723+0000 7faa9c11b700 1 -- 172.21.15.158:0/2354170372 shutdown_connections 2023-10-18T17:24:03.731 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.723+0000 7faa9c11b700 1 --2- 172.21.15.158:0/2354170372 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7faa7805a510 0x7faa7805c9d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:03.731 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.723+0000 7faa9c11b700 1 --2- 172.21.15.158:0/2354170372 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa94149d80 0x7faa940ba840 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:03.732 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.723+0000 7faa9c11b700 1 --2- 172.21.15.158:0/2354170372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa940c69f0 0x7faa940bfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:03.732 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.723+0000 7faa9c11b700 1 --2- 172.21.15.158:0/2354170372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa940689e0 0x7faa940b7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:03.732 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.723+0000 7faa9c11b700 1 -- 172.21.15.158:0/2354170372 >> 172.21.15.158:0/2354170372 conn(0x7faa9405dc20 msgr2=0x7faa940c1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:03.735 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.727+0000 7faa9c11b700 1 -- 172.21.15.158:0/2354170372 shutdown_connections 2023-10-18T17:24:03.736 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.731+0000 7faa9c11b700 1 -- 172.21.15.158:0/2354170372 wait complete. 2023-10-18T17:24:03.748 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:24:03.750 INFO:teuthology.orchestra.run.smithi158.stderr:pool 'cephfs_data' created 2023-10-18T17:24:03.755 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:24:03.774 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-18T17:24:03.981 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.975+0000 7f74c4f47700 1 Processor -- start 2023-10-18T17:24:03.982 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.975+0000 7f74c4f47700 1 -- start start 2023-10-18T17:24:03.985 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.979+0000 7f74c4f47700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f74c0065d80 0x7f74c00c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:03.986 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.979+0000 7f74c4f47700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c014ffb0 con 0x7f74c00c23e0 2023-10-18T17:24:03.986 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.979+0000 7f74c4f47700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c0150270 con 0x7f74c00c11f0 2023-10-18T17:24:03.986 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.979+0000 7f74c4f47700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c0150df0 con 0x7f74c0065d80 2023-10-18T17:24:03.986 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.979+0000 7f74bf7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f74c00c23e0 0x7f74c00664a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:58684/0 (socket says 172.21.15.158:58684) 2023-10-18T17:24:03.986 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.979+0000 7f74bf7fe700 1 -- 172.21.15.158:0/2647973376 learned_addr learned my addr 172.21.15.158:0/2647973376 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:03.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.979+0000 7f74bffff700 1 --2- 172.21.15.158:0/2647973376 >> v2:172.21.15.183:3300/0 conn(0x7f74c0065d80 0x7f74c00c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:03.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.979+0000 7f74be7fc700 1 -- 172.21.15.158:0/2647973376 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270577474 0 0) 0x7f74c014ffb0 con 0x7f74c00c23e0 2023-10-18T17:24:03.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.979+0000 7f74be7fc700 1 -- 172.21.15.158:0/2647973376 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74a80033f0 con 0x7f74c00c23e0 2023-10-18T17:24:03.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.979+0000 7f74bffff700 1 -- 172.21.15.158:0/2647973376 >> v1:172.21.15.183:6789/0 conn(0x7f74c00c11f0 legacy=0x7f74c0065670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:03.989 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.979+0000 7f74bffff700 1 -- 172.21.15.158:0/2647973376 >> v1:172.21.15.158:6789/0 conn(0x7f74c00c23e0 legacy=0x7f74c00664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:03.989 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.979+0000 7f74bffff700 1 -- 172.21.15.158:0/2647973376 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c0150550 con 0x7f74c0065d80 2023-10-18T17:24:03.989 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.979+0000 7f74bffff700 1 --2- 172.21.15.158:0/2647973376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74c0065d80 0x7f74c00c27c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f74b8009e60 tx=0x7f74b8009780).ready entity=mon.1 client_cookie=38e319aa27c86870 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:03.989 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.979+0000 7f74be7fc700 1 -- 172.21.15.158:0/2647973376 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b800e070 con 0x7f74c0065d80 2023-10-18T17:24:03.989 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.983+0000 7f74be7fc700 1 -- 172.21.15.158:0/2647973376 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b800bb60 con 0x7f74c0065d80 2023-10-18T17:24:03.990 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.983+0000 7f74be7fc700 1 -- 172.21.15.158:0/2647973376 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8012410 con 0x7f74c0065d80 2023-10-18T17:24:03.990 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.983+0000 7f74c4f47700 1 -- 172.21.15.158:0/2647973376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74c0065d80 msgr2=0x7f74c00c27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:03.990 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.983+0000 7f74c4f47700 1 --2- 172.21.15.158:0/2647973376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74c0065d80 0x7f74c00c27c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f74b8009e60 tx=0x7f74b8009780).stop 2023-10-18T17:24:03.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.983+0000 7f74c4f47700 1 -- 172.21.15.158:0/2647973376 shutdown_connections 2023-10-18T17:24:03.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.983+0000 7f74c4f47700 1 --2- 172.21.15.158:0/2647973376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74c0065d80 0x7f74c00c27c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:03.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.983+0000 7f74c4f47700 1 -- 172.21.15.158:0/2647973376 >> 172.21.15.158:0/2647973376 conn(0x7f74c00620d0 msgr2=0x7f74c00624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:03.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.983+0000 7f74c4f47700 1 -- 172.21.15.158:0/2647973376 shutdown_connections 2023-10-18T17:24:03.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.983+0000 7f74c4f47700 1 -- 172.21.15.158:0/2647973376 wait complete. 2023-10-18T17:24:03.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.983+0000 7f74c4f47700 1 Processor -- start 2023-10-18T17:24:03.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.983+0000 7f74c4f47700 1 -- start start 2023-10-18T17:24:03.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74c4f47700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74c0065d80 0x7f74c0160020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:03.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74c4f47700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74c00c11f0 0x7f74c0151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:03.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74c4f47700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74c00c23e0 0x7f74c00bcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:03.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74c4f47700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c0152b50 con 0x7f74c00c11f0 2023-10-18T17:24:03.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74c4f47700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c01605d0 con 0x7f74c0065d80 2023-10-18T17:24:03.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74c4f47700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c01608b0 con 0x7f74c00c23e0 2023-10-18T17:24:03.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74bffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74c00c23e0 0x7f74c00bcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:03.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74bf7fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74c0065d80 0x7f74c0160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:03.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74bffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74c00c23e0 0x7f74c00bcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:38074/0 (socket says 172.21.15.158:38074) 2023-10-18T17:24:03.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74bffff700 1 -- 172.21.15.158:0/1389663761 learned_addr learned my addr 172.21.15.158:0/1389663761 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:03.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74beffd700 1 --2- 172.21.15.158:0/1389663761 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74c00c11f0 0x7f74c0151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:03.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74bffff700 1 -- 172.21.15.158:0/1389663761 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74c0065d80 msgr2=0x7f74c0160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:03.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74bffff700 1 --2- 172.21.15.158:0/1389663761 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74c0065d80 0x7f74c0160020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:03.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74bffff700 1 -- 172.21.15.158:0/1389663761 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74c00c11f0 msgr2=0x7f74c0151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:03.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74bffff700 1 --2- 172.21.15.158:0/1389663761 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74c00c11f0 0x7f74c0151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:03.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74bffff700 1 -- 172.21.15.158:0/1389663761 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b8009a20 con 0x7f74c00c23e0 2023-10-18T17:24:03.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74beffd700 1 --2- 172.21.15.158:0/1389663761 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74c00c11f0 0x7f74c0151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:03.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74bffff700 1 --2- 172.21.15.158:0/1389663761 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74c00c23e0 0x7f74c00bcd40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f74b8011000 tx=0x7f74c0069ef0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:03.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74a77fe700 1 -- 172.21.15.158:0/1389663761 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8012410 con 0x7f74c00c23e0 2023-10-18T17:24:03.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74a77fe700 1 -- 172.21.15.158:0/1389663761 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b801d630 con 0x7f74c00c23e0 2023-10-18T17:24:03.999 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74c4f47700 1 -- 172.21.15.158:0/1389663761 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c0160b90 con 0x7f74c00c23e0 2023-10-18T17:24:03.999 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74a77fe700 1 -- 172.21.15.158:0/1389663761 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b801d9d0 con 0x7f74c00c23e0 2023-10-18T17:24:03.999 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.987+0000 7f74c4f47700 1 -- 172.21.15.158:0/1389663761 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c01527e0 con 0x7f74c00c23e0 2023-10-18T17:24:04.000 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.991+0000 7f74c4f47700 1 -- 172.21.15.158:0/1389663761 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c0152cc0 con 0x7f74c00c23e0 2023-10-18T17:24:04.000 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.991+0000 7f74a77fe700 1 -- 172.21.15.158:0/1389663761 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f74b801dd40 con 0x7f74c00c23e0 2023-10-18T17:24:04.000 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.991+0000 7f74a77fe700 1 --2- 172.21.15.158:0/1389663761 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f74ac05a510 0x7f74ac05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:04.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.991+0000 7f74a77fe700 1 -- 172.21.15.158:0/1389663761 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f74b8076580 con 0x7f74c00c23e0 2023-10-18T17:24:04.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.991+0000 7f74bf7fe700 1 --2- 172.21.15.158:0/1389663761 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f74ac05a510 0x7f74ac05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:04.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:03.995+0000 7f74bf7fe700 1 --2- 172.21.15.158:0/1389663761 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f74ac05a510 0x7f74ac05c9d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f74b0005750 tx=0x7f74b0009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:04.010 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.003+0000 7f74a77fe700 1 -- 172.21.15.158:0/1389663761 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f74b8049d00 con 0x7f74c00c23e0 2023-10-18T17:24:04.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.207+0000 7f74c4f47700 1 -- 172.21.15.158:0/1389663761 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f74c0046f00 con 0x7f74c00c23e0 2023-10-18T17:24:04.224 INFO:tasks.ceph.mds.c.smithi158.stderr:terminate called after throwing an instance of 'boost::wrapexcept' 2023-10-18T17:24:04.224 INFO:tasks.ceph.mds.c.smithi158.stderr: what(): boost::bad_get: failed value get using boost::get 2023-10-18T17:24:04.224 INFO:tasks.ceph.mds.c.smithi158.stderr:*** Caught signal (Aborted) ** 2023-10-18T17:24:04.225 INFO:tasks.ceph.mds.c.smithi158.stderr: in thread 7f0332d49700 thread_name:ms_dispatch 2023-10-18T17:24:04.226 INFO:tasks.ceph.mds.c.smithi158.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:24:04.226 INFO:tasks.ceph.mds.c.smithi158.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f0340cde420] 2023-10-18T17:24:04.226 INFO:tasks.ceph.mds.c.smithi158.stderr: 2: gsignal() 2023-10-18T17:24:04.227 INFO:tasks.ceph.mds.c.smithi158.stderr: 3: abort() 2023-10-18T17:24:04.227 INFO:tasks.ceph.mds.c.smithi158.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7f0337cbc911] 2023-10-18T17:24:04.227 INFO:tasks.ceph.mds.c.smithi158.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7f0337cc838c] 2023-10-18T17:24:04.227 INFO:tasks.ceph.mds.c.smithi158.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7f0337cc83f7] 2023-10-18T17:24:04.227 INFO:tasks.ceph.mds.c.smithi158.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7f0337cc86a9] 2023-10-18T17:24:04.228 INFO:tasks.ceph.mds.c.smithi158.stderr: 8: ceph-mds(+0x185107) [0x55c3775a5107] 2023-10-18T17:24:04.228 INFO:tasks.ceph.mds.c.smithi158.stderr: 9: ceph-mds(+0x18572d) [0x55c3775a572d] 2023-10-18T17:24:04.228 INFO:tasks.ceph.mds.c.smithi158.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x55c37761709f] 2023-10-18T17:24:04.228 INFO:tasks.ceph.mds.c.smithi158.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x55c377618a95] 2023-10-18T17:24:04.228 INFO:tasks.ceph.mds.c.smithi158.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x55c3775e3b10] 2023-10-18T17:24:04.228 INFO:tasks.ceph.mds.c.smithi158.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x55c3775e7abf] 2023-10-18T17:24:04.229 INFO:tasks.ceph.mds.c.smithi158.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x55c3775e8456] 2023-10-18T17:24:04.229 INFO:tasks.ceph.mds.c.smithi158.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7f03382bc710] 2023-10-18T17:24:04.229 INFO:tasks.ceph.mds.c.smithi158.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7f03382b9faf] 2023-10-18T17:24:04.229 INFO:tasks.ceph.mds.c.smithi158.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0338388b21] 2023-10-18T17:24:04.229 INFO:tasks.ceph.mds.c.smithi158.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f0340cd2609] 2023-10-18T17:24:04.229 INFO:tasks.ceph.mds.c.smithi158.stderr: 19: clone() 2023-10-18T17:24:04.230 INFO:tasks.ceph.mds.c.smithi158.stderr:2023-10-18T17:24:04.219+0000 7f0332d49700 -1 *** Caught signal (Aborted) ** 2023-10-18T17:24:04.230 INFO:tasks.ceph.mds.c.smithi158.stderr: in thread 7f0332d49700 thread_name:ms_dispatch 2023-10-18T17:24:04.231 INFO:tasks.ceph.mds.c.smithi158.stderr: 2023-10-18T17:24:04.231 INFO:tasks.ceph.mds.c.smithi158.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:24:04.231 INFO:tasks.ceph.mds.c.smithi158.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f0340cde420] 2023-10-18T17:24:04.231 INFO:tasks.ceph.mds.c.smithi158.stderr: 2: gsignal() 2023-10-18T17:24:04.231 INFO:tasks.ceph.mds.c.smithi158.stderr: 3: abort() 2023-10-18T17:24:04.231 INFO:tasks.ceph.mds.c.smithi158.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7f0337cbc911] 2023-10-18T17:24:04.232 INFO:tasks.ceph.mds.c.smithi158.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7f0337cc838c] 2023-10-18T17:24:04.232 INFO:tasks.ceph.mds.c.smithi158.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7f0337cc83f7] 2023-10-18T17:24:04.232 INFO:tasks.ceph.mds.c.smithi158.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7f0337cc86a9] 2023-10-18T17:24:04.232 INFO:tasks.ceph.mds.c.smithi158.stderr: 8: ceph-mds(+0x185107) [0x55c3775a5107] 2023-10-18T17:24:04.232 INFO:tasks.ceph.mds.c.smithi158.stderr: 9: ceph-mds(+0x18572d) [0x55c3775a572d] 2023-10-18T17:24:04.233 INFO:tasks.ceph.mds.c.smithi158.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x55c37761709f] 2023-10-18T17:24:04.233 INFO:tasks.ceph.mds.c.smithi158.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x55c377618a95] 2023-10-18T17:24:04.233 INFO:tasks.ceph.mds.c.smithi158.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x55c3775e3b10] 2023-10-18T17:24:04.233 INFO:tasks.ceph.mds.c.smithi158.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x55c3775e7abf] 2023-10-18T17:24:04.233 INFO:tasks.ceph.mds.c.smithi158.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x55c3775e8456] 2023-10-18T17:24:04.234 INFO:tasks.ceph.mds.c.smithi158.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7f03382bc710] 2023-10-18T17:24:04.234 INFO:tasks.ceph.mds.c.smithi158.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7f03382b9faf] 2023-10-18T17:24:04.234 INFO:tasks.ceph.mds.c.smithi158.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0338388b21] 2023-10-18T17:24:04.234 INFO:tasks.ceph.mds.c.smithi158.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f0340cd2609] 2023-10-18T17:24:04.234 INFO:tasks.ceph.mds.c.smithi158.stderr: 19: clone() 2023-10-18T17:24:04.235 INFO:tasks.ceph.mds.c.smithi158.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T17:24:04.235 INFO:tasks.ceph.mds.c.smithi158.stderr: 2023-10-18T17:24:04.235 INFO:tasks.ceph.mds.c.smithi158.stderr: 0> 2023-10-18T17:24:04.219+0000 7f0332d49700 -1 *** Caught signal (Aborted) ** 2023-10-18T17:24:04.235 INFO:tasks.ceph.mds.c.smithi158.stderr: in thread 7f0332d49700 thread_name:ms_dispatch 2023-10-18T17:24:04.235 INFO:tasks.ceph.mds.c.smithi158.stderr: 2023-10-18T17:24:04.236 INFO:tasks.ceph.mds.c.smithi158.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:24:04.236 INFO:tasks.ceph.mds.c.smithi158.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f0340cde420] 2023-10-18T17:24:04.236 INFO:tasks.ceph.mds.c.smithi158.stderr: 2: gsignal() 2023-10-18T17:24:04.236 INFO:tasks.ceph.mds.c.smithi158.stderr: 3: abort() 2023-10-18T17:24:04.237 INFO:tasks.ceph.mds.c.smithi158.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7f0337cbc911] 2023-10-18T17:24:04.237 INFO:tasks.ceph.mds.c.smithi158.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7f0337cc838c] 2023-10-18T17:24:04.237 INFO:tasks.ceph.mds.c.smithi158.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7f0337cc83f7] 2023-10-18T17:24:04.237 INFO:tasks.ceph.mds.c.smithi158.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7f0337cc86a9] 2023-10-18T17:24:04.237 INFO:tasks.ceph.mds.c.smithi158.stderr: 8: ceph-mds(+0x185107) [0x55c3775a5107] 2023-10-18T17:24:04.238 INFO:tasks.ceph.mds.c.smithi158.stderr: 9: ceph-mds(+0x18572d) [0x55c3775a572d] 2023-10-18T17:24:04.238 INFO:tasks.ceph.mds.c.smithi158.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x55c37761709f] 2023-10-18T17:24:04.238 INFO:tasks.ceph.mds.c.smithi158.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x55c377618a95] 2023-10-18T17:24:04.238 INFO:tasks.ceph.mds.c.smithi158.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x55c3775e3b10] 2023-10-18T17:24:04.238 INFO:tasks.ceph.mds.c.smithi158.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x55c3775e7abf] 2023-10-18T17:24:04.239 INFO:tasks.ceph.mds.c.smithi158.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x55c3775e8456] 2023-10-18T17:24:04.239 INFO:tasks.ceph.mds.c.smithi158.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7f03382bc710] 2023-10-18T17:24:04.239 INFO:tasks.ceph.mds.c.smithi158.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7f03382b9faf] 2023-10-18T17:24:04.239 INFO:tasks.ceph.mds.c.smithi158.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0338388b21] 2023-10-18T17:24:04.239 INFO:tasks.ceph.mds.c.smithi158.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f0340cd2609] 2023-10-18T17:24:04.240 INFO:tasks.ceph.mds.c.smithi158.stderr: 19: clone() 2023-10-18T17:24:04.240 INFO:tasks.ceph.mds.c.smithi158.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T17:24:04.240 INFO:tasks.ceph.mds.c.smithi158.stderr: 2023-10-18T17:24:04.243 INFO:tasks.ceph.mds.c.smithi158.stderr: 0> 2023-10-18T17:24:04.219+0000 7f0332d49700 -1 *** Caught signal (Aborted) ** 2023-10-18T17:24:04.244 INFO:tasks.ceph.mds.c.smithi158.stderr: in thread 7f0332d49700 thread_name:ms_dispatch 2023-10-18T17:24:04.244 INFO:tasks.ceph.mds.c.smithi158.stderr: 2023-10-18T17:24:04.244 INFO:tasks.ceph.mds.c.smithi158.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:24:04.244 INFO:tasks.ceph.mds.c.smithi158.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f0340cde420] 2023-10-18T17:24:04.245 INFO:tasks.ceph.mds.c.smithi158.stderr: 2: gsignal() 2023-10-18T17:24:04.245 INFO:tasks.ceph.mds.c.smithi158.stderr: 3: abort() 2023-10-18T17:24:04.245 INFO:tasks.ceph.mds.c.smithi158.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7f0337cbc911] 2023-10-18T17:24:04.245 INFO:tasks.ceph.mds.c.smithi158.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7f0337cc838c] 2023-10-18T17:24:04.246 INFO:tasks.ceph.mds.c.smithi158.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7f0337cc83f7] 2023-10-18T17:24:04.246 INFO:tasks.ceph.mds.c.smithi158.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7f0337cc86a9] 2023-10-18T17:24:04.246 INFO:tasks.ceph.mds.c.smithi158.stderr: 8: ceph-mds(+0x185107) [0x55c3775a5107] 2023-10-18T17:24:04.246 INFO:tasks.ceph.mds.c.smithi158.stderr: 9: ceph-mds(+0x18572d) [0x55c3775a572d] 2023-10-18T17:24:04.246 INFO:tasks.ceph.mds.c.smithi158.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x55c37761709f] 2023-10-18T17:24:04.247 INFO:tasks.ceph.mds.c.smithi158.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x55c377618a95] 2023-10-18T17:24:04.247 INFO:tasks.ceph.mds.c.smithi158.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x55c3775e3b10] 2023-10-18T17:24:04.247 INFO:tasks.ceph.mds.c.smithi158.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x55c3775e7abf] 2023-10-18T17:24:04.247 INFO:tasks.ceph.mds.c.smithi158.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x55c3775e8456] 2023-10-18T17:24:04.248 INFO:tasks.ceph.mds.c.smithi158.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7f03382bc710] 2023-10-18T17:24:04.248 INFO:tasks.ceph.mds.c.smithi158.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7f03382b9faf] 2023-10-18T17:24:04.248 INFO:tasks.ceph.mds.c.smithi158.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0338388b21] 2023-10-18T17:24:04.248 INFO:tasks.ceph.mds.c.smithi158.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f0340cd2609] 2023-10-18T17:24:04.248 INFO:tasks.ceph.mds.c.smithi158.stderr: 19: clone() 2023-10-18T17:24:04.249 INFO:tasks.ceph.mds.c.smithi158.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T17:24:04.249 INFO:tasks.ceph.mds.c.smithi158.stderr: 2023-10-18T17:24:04.249 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.235+0000 7f74a77fe700 1 -- 172.21.15.158:0/1389663761 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f74b804d320 con 0x7f74c00c23e0 2023-10-18T17:24:04.250 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.243+0000 7f74c4f47700 1 -- 172.21.15.158:0/1389663761 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f74ac05a510 msgr2=0x7f74ac05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:04.250 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.243+0000 7f74c4f47700 1 --2- 172.21.15.158:0/1389663761 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f74ac05a510 0x7f74ac05c9d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f74b0005750 tx=0x7f74b0009040).stop 2023-10-18T17:24:04.250 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.243+0000 7f74c4f47700 1 -- 172.21.15.158:0/1389663761 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74c00c23e0 msgr2=0x7f74c00bcd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:04.250 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.243+0000 7f74c4f47700 1 --2- 172.21.15.158:0/1389663761 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74c00c23e0 0x7f74c00bcd40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f74b8011000 tx=0x7f74c0069ef0).stop 2023-10-18T17:24:04.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.243+0000 7f74c4f47700 1 -- 172.21.15.158:0/1389663761 shutdown_connections 2023-10-18T17:24:04.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.243+0000 7f74c4f47700 1 --2- 172.21.15.158:0/1389663761 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f74ac05a510 0x7f74ac05c9d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:04.252 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.243+0000 7f74c4f47700 1 --2- 172.21.15.158:0/1389663761 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74c00c23e0 0x7f74c00bcd40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:04.252 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.243+0000 7f74c4f47700 1 --2- 172.21.15.158:0/1389663761 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74c00c11f0 0x7f74c0151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:04.252 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.243+0000 7f74c4f47700 1 --2- 172.21.15.158:0/1389663761 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74c0065d80 0x7f74c0160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:04.252 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.243+0000 7f74c4f47700 1 -- 172.21.15.158:0/1389663761 >> 172.21.15.158:0/1389663761 conn(0x7f74c00620d0 msgr2=0x7f74c014de90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:04.254 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.247+0000 7f74c4f47700 1 -- 172.21.15.158:0/1389663761 shutdown_connections 2023-10-18T17:24:04.255 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.247+0000 7f74c4f47700 1 -- 172.21.15.158:0/1389663761 wait complete. 2023-10-18T17:24:04.258 INFO:teuthology.orchestra.run.smithi158.stderr:new fs with metadata pool 3 and data pool 4 2023-10-18T17:24:04.276 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T17:24:04.390 INFO:tasks.ceph.mds.c.smithi158.stderr:daemon-helper: command crashed with signal 6 2023-10-18T17:24:04.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.423+0000 7f758d5a9700 1 Processor -- start 2023-10-18T17:24:04.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.423+0000 7f758d5a9700 1 -- start start 2023-10-18T17:24:04.433 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f758d5a9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f758814d100 0x7f75880c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:04.433 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f758d5a9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7588068d90 0x7f7588069590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:04.433 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f758d5a9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7588150ab0 con 0x7f758814d4e0 2023-10-18T17:24:04.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f758d5a9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75880c2450 con 0x7f7588068d90 2023-10-18T17:24:04.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f758d5a9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75880c2660 con 0x7f758814d100 2023-10-18T17:24:04.436 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f757ffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7588068d90 0x7f7588069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:04.436 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f757ffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7588068d90 0x7f7588069590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56522/0 (socket says 172.21.15.158:56522) 2023-10-18T17:24:04.436 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f757ffff700 1 -- 172.21.15.158:0/694628626 learned_addr learned my addr 172.21.15.158:0/694628626 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:04.436 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f7586ffd700 1 --2- 172.21.15.158:0/694628626 >> v2:172.21.15.183:3300/0 conn(0x7f758814d100 0x7f75880c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:04.437 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f757ffff700 1 -- 172.21.15.158:0/694628626 >> v2:172.21.15.183:3300/0 conn(0x7f758814d100 msgr2=0x7f75880c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:04.437 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f757ffff700 1 --2- 172.21.15.158:0/694628626 >> v2:172.21.15.183:3300/0 conn(0x7f758814d100 0x7f75880c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:04.437 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f757ffff700 1 -- 172.21.15.158:0/694628626 >> v1:172.21.15.183:6789/0 conn(0x7f758814d4e0 legacy=0x7f7588066bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:04.437 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f757ffff700 1 -- 172.21.15.158:0/694628626 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75880c2940 con 0x7f7588068d90 2023-10-18T17:24:04.437 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f757ffff700 1 --2- 172.21.15.158:0/694628626 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7588068d90 0x7f7588069590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f75880475a0 tx=0x7f75700090f0).ready entity=mon.0 client_cookie=762bde669b7e7e96 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:04.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f75867fc700 1 -- 172.21.15.158:0/694628626 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757000b5b0 con 0x7f7588068d90 2023-10-18T17:24:04.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f75867fc700 1 -- 172.21.15.158:0/694628626 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757000b710 con 0x7f7588068d90 2023-10-18T17:24:04.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f75867fc700 1 -- 172.21.15.158:0/694628626 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757000ba90 con 0x7f7588068d90 2023-10-18T17:24:04.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f758d5a9700 1 -- 172.21.15.158:0/694628626 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7588068d90 msgr2=0x7f7588069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:04.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f758d5a9700 1 --2- 172.21.15.158:0/694628626 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7588068d90 0x7f7588069590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f75880475a0 tx=0x7f75700090f0).stop 2023-10-18T17:24:04.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f758d5a9700 1 -- 172.21.15.158:0/694628626 shutdown_connections 2023-10-18T17:24:04.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f758d5a9700 1 --2- 172.21.15.158:0/694628626 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7588068d90 0x7f7588069590 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:04.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f758d5a9700 1 --2- 172.21.15.158:0/694628626 >> v2:172.21.15.183:3300/0 conn(0x7f758814d100 0x7f75880c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:04.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.427+0000 7f758d5a9700 1 -- 172.21.15.158:0/694628626 >> 172.21.15.158:0/694628626 conn(0x7f758805e6b0 msgr2=0x7f75880c7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:04.440 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.431+0000 7f758d5a9700 1 -- 172.21.15.158:0/694628626 shutdown_connections 2023-10-18T17:24:04.440 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.431+0000 7f758d5a9700 1 -- 172.21.15.158:0/694628626 wait complete. 2023-10-18T17:24:04.442 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.431+0000 7f758d5a9700 1 Processor -- start 2023-10-18T17:24:04.442 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.431+0000 7f758d5a9700 1 -- start start 2023-10-18T17:24:04.442 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.431+0000 7f758d5a9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7588068d90 0x7f7588161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:04.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.431+0000 7f758d5a9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f758814d100 0x7f75880bb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:04.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.431+0000 7f758d5a9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f758814d4e0 0x7f75881484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:04.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.431+0000 7f758d5a9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75880bcb70 con 0x7f758814d4e0 2023-10-18T17:24:04.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.431+0000 7f758d5a9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75880c0160 con 0x7f758814d100 2023-10-18T17:24:04.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.431+0000 7f758d5a9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7588160df0 con 0x7f7588068d90 2023-10-18T17:24:04.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.431+0000 7f7587fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f758814d4e0 0x7f75881484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:04.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.431+0000 7f7587fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f758814d4e0 0x7f75881484a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56534/0 (socket says 172.21.15.158:56534) 2023-10-18T17:24:04.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.431+0000 7f7587fff700 1 -- 172.21.15.158:0/474575215 learned_addr learned my addr 172.21.15.158:0/474575215 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:04.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.431+0000 7f757ffff700 1 --2- 172.21.15.158:0/474575215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f758814d100 0x7f75880bb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:04.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.431+0000 7f7586ffd700 1 --2- 172.21.15.158:0/474575215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7588068d90 0x7f7588161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:04.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.435+0000 7f7587fff700 1 -- 172.21.15.158:0/474575215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7588068d90 msgr2=0x7f7588161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:04.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.435+0000 7f7587fff700 1 --2- 172.21.15.158:0/474575215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7588068d90 0x7f7588161280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:04.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.435+0000 7f7587fff700 1 -- 172.21.15.158:0/474575215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f758814d100 msgr2=0x7f75880bb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:04.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.435+0000 7f7587fff700 1 --2- 172.21.15.158:0/474575215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f758814d100 0x7f75880bb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:04.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.435+0000 7f7587fff700 1 -- 172.21.15.158:0/474575215 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7570009370 con 0x7f758814d4e0 2023-10-18T17:24:04.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.435+0000 7f757ffff700 1 --2- 172.21.15.158:0/474575215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f758814d100 0x7f75880bb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:04.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.435+0000 7f7587fff700 1 --2- 172.21.15.158:0/474575215 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f758814d4e0 0x7f75881484a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f758000c790 tx=0x7f75800015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:04.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.435+0000 7f757effd700 1 -- 172.21.15.158:0/474575215 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758000e4a0 con 0x7f758814d4e0 2023-10-18T17:24:04.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.435+0000 7f757effd700 1 -- 172.21.15.158:0/474575215 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758000e600 con 0x7f758814d4e0 2023-10-18T17:24:04.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.435+0000 7f758d5a9700 1 -- 172.21.15.158:0/474575215 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758814f9f0 con 0x7f758814d4e0 2023-10-18T17:24:04.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.435+0000 7f757effd700 1 -- 172.21.15.158:0/474575215 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758000e980 con 0x7f758814d4e0 2023-10-18T17:24:04.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.435+0000 7f758d5a9700 1 -- 172.21.15.158:0/474575215 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75881607a0 con 0x7f758814d4e0 2023-10-18T17:24:04.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.435+0000 7f758d5a9700 1 -- 172.21.15.158:0/474575215 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7588046f00 con 0x7f758814d4e0 2023-10-18T17:24:04.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.435+0000 7f757effd700 1 -- 172.21.15.158:0/474575215 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f758001b3b0 con 0x7f758814d4e0 2023-10-18T17:24:04.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.439+0000 7f757effd700 1 --2- 172.21.15.158:0/474575215 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f756805a510 0x7f756805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:04.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.439+0000 7f757effd700 1 -- 172.21.15.158:0/474575215 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7580073f40 con 0x7f758814d4e0 2023-10-18T17:24:04.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.439+0000 7f7586ffd700 1 --2- 172.21.15.158:0/474575215 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f756805a510 0x7f756805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:04.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.439+0000 7f7586ffd700 1 --2- 172.21.15.158:0/474575215 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f756805a510 0x7f756805c9d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f7578009c30 tx=0x7f7578009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:04.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.443+0000 7f757effd700 1 -- 172.21.15.158:0/474575215 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f75800476b0 con 0x7f758814d4e0 2023-10-18T17:24:04.613 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.607+0000 7f758d5a9700 1 -- 172.21.15.158:0/474575215 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75880c1830 con 0x7f758814d4e0 2023-10-18T17:24:04.614 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.607+0000 7f757effd700 1 -- 172.21.15.158:0/474575215 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16989 (secure 0 0 0) 0x7f758004acd0 con 0x7f758814d4e0 2023-10-18T17:24:04.615 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:04.615 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":21,"fsid":"ca4bb219-38c8-4c5b-a49c-213b123db018","created":"2023-10-18T17:23:45.550173+0000","modified":"2023-10-18T17:24:04.214162+0000","last_up_change":"2023-10-18T17:23:55.617219+0000","last_in_change":"2023-10-18T17:23:47.727646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-18T17:23:54.686216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T17:23:56.743672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T17:24:02.200531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T17:24:03.168929+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f621b1e-5ea4-4dc3-80e1-c415c7cc97d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6815","nonce":33195},{"type":"v1","addr":"172.21.15.158:6817","nonce":33195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":33195},{"type":"v1","addr":"172.21.15.158:6819","nonce":33195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":33195},{"type":"v1","addr":"172.21.15.158:6824","nonce":33195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":33195},{"type":"v1","addr":"172.21.15.158:6821","nonce":33195}]},"public_addr":"172.21.15.158:6817/33195","cluster_addr":"172.21.15.158:6819/33195","heartbeat_back_addr":"172.21.15.158:6824/33195","heartbeat_front_addr":"172.21.15.158:6821/33195","state":["exists","up"]},{"osd":1,"uuid":"769d7514-319f-4ac3-8cf3-6f88f4e7da2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6823","nonce":33196},{"type":"v1","addr":"172.21.15.158:6825","nonce":33196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":33196},{"type":"v1","addr":"172.21.15.158:6827","nonce":33196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":33196},{"type":"v1","addr":"172.21.15.158:6831","nonce":33196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":33196},{"type":"v1","addr":"172.21.15.158:6829","nonce":33196}]},"public_addr":"172.21.15.158:6825/33196","cluster_addr":"172.21.15.158:6827/33196","heartbeat_back_addr":"172.21.15.158:6831/33196","heartbeat_front_addr":"172.21.15.158:6829/33196","state":["exists","up"]},{"osd":2,"uuid":"b4459762-309d-454c-bd31-33b90192375f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":33193},{"type":"v1","addr":"172.21.15.158:6809","nonce":33193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":33193},{"type":"v1","addr":"172.21.15.158:6811","nonce":33193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":33193},{"type":"v1","addr":"172.21.15.158:6816","nonce":33193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":33193},{"type":"v1","addr":"172.21.15.158:6813","nonce":33193}]},"public_addr":"172.21.15.158:6809/33193","cluster_addr":"172.21.15.158:6811/33193","heartbeat_back_addr":"172.21.15.158:6816/33193","heartbeat_front_addr":"172.21.15.158:6813/33193","state":["exists","up"]},{"osd":3,"uuid":"7b78a411-1ae9-4051-ae9d-a03abc5a73ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":33194},{"type":"v1","addr":"172.21.15.158:6801","nonce":33194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":33194},{"type":"v1","addr":"172.21.15.158:6803","nonce":33194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":33194},{"type":"v1","addr":"172.21.15.158:6807","nonce":33194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":33194},{"type":"v1","addr":"172.21.15.158:6805","nonce":33194}]},"public_addr":"172.21.15.158:6801/33194","cluster_addr":"172.21.15.158:6803/33194","heartbeat_back_addr":"172.21.15.158:6807/33194","heartbeat_front_addr":"172.21.15.158:6805/33194","state":["exists","up"]},{"osd":4,"uuid":"58005b5f-2742-4ecb-8c3a-a2ae65c7fb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":33897},{"type":"v1","addr":"172.21.15.183:6801","nonce":33897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6803","nonce":33897},{"type":"v1","addr":"172.21.15.183:6805","nonce":33897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":33897},{"type":"v1","addr":"172.21.15.183:6812","nonce":33897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":33897},{"type":"v1","addr":"172.21.15.183:6808","nonce":33897}]},"public_addr":"172.21.15.183:6801/33897","cluster_addr":"172.21.15.183:6805/33897","heartbeat_back_addr":"172.21.15.183:6812/33897","heartbeat_front_addr":"172.21.15.183:6808/33897","state":["exists","up"]},{"osd":5,"uuid":"c0b217ed-1c09-4cde-b192-65624ab3a70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":33898},{"type":"v1","addr":"172.21.15.183:6804","nonce":33898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6807","nonce":33898},{"type":"v1","addr":"172.21.15.183:6809","nonce":33898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":33898},{"type":"v1","addr":"172.21.15.183:6815","nonce":33898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6811","nonce":33898},{"type":"v1","addr":"172.21.15.183:6813","nonce":33898}]},"public_addr":"172.21.15.183:6804/33898","cluster_addr":"172.21.15.183:6809/33898","heartbeat_back_addr":"172.21.15.183:6815/33898","heartbeat_front_addr":"172.21.15.183:6813/33898","state":["exists","up"]},{"osd":6,"uuid":"5f910aac-4091-408b-8b2b-19865b21395c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":33910},{"type":"v1","addr":"172.21.15.183:6825","nonce":33910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":33910},{"type":"v1","addr":"172.21.15.183:6827","nonce":33910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":33910},{"type":"v1","addr":"172.21.15.183:6831","nonce":33910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":33910},{"type":"v1","addr":"172.21.15.183:6829","nonce":33910}]},"public_addr":"172.21.15.183:6825/33910","cluster_addr":"172.21.15.183:6827/33910","heartbeat_back_addr":"172.21.15.183:6831/33910","heartbeat_front_addr":"172.21.15.183:6829/33910","state":["exists","up"]},{"osd":7,"uuid":"96d7b9aa-687e-42e3-a5cf-1533931ecce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":33903},{"type":"v1","addr":"172.21.15.183:6817","nonce":33903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":33903},{"type":"v1","addr":"172.21.15.183:6819","nonce":33903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":33903},{"type":"v1","addr":"172.21.15.183:6823","nonce":33903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":33903},{"type":"v1","addr":"172.21.15.183:6821","nonce":33903}]},"public_addr":"172.21.15.183:6817/33903","cluster_addr":"172.21.15.183:6819/33903","heartbeat_back_addr":"172.21.15.183:6823/33903","heartbeat_front_addr":"172.21.15.183:6821/33903","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.622366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.713036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.561097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.546583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.007074+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:52.994413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.176820+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:52.906075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T17:24:04.619 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.611+0000 7f758d5a9700 1 -- 172.21.15.158:0/474575215 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f756805a510 msgr2=0x7f756805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:04.619 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.611+0000 7f758d5a9700 1 --2- 172.21.15.158:0/474575215 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f756805a510 0x7f756805c9d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f7578009c30 tx=0x7f7578009060).stop 2023-10-18T17:24:04.619 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.611+0000 7f758d5a9700 1 -- 172.21.15.158:0/474575215 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f758814d4e0 msgr2=0x7f75881484a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:04.619 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.611+0000 7f758d5a9700 1 --2- 172.21.15.158:0/474575215 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f758814d4e0 0x7f75881484a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f758000c790 tx=0x7f75800015e0).stop 2023-10-18T17:24:04.620 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.611+0000 7f758d5a9700 1 -- 172.21.15.158:0/474575215 shutdown_connections 2023-10-18T17:24:04.620 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.611+0000 7f758d5a9700 1 --2- 172.21.15.158:0/474575215 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f756805a510 0x7f756805c9d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:04.620 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.611+0000 7f758d5a9700 1 --2- 172.21.15.158:0/474575215 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f758814d4e0 0x7f75881484a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:04.620 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.611+0000 7f758d5a9700 1 --2- 172.21.15.158:0/474575215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f758814d100 0x7f75880bb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:04.620 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.611+0000 7f758d5a9700 1 --2- 172.21.15.158:0/474575215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7588068d90 0x7f7588161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:04.620 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.611+0000 7f758d5a9700 1 -- 172.21.15.158:0/474575215 >> 172.21.15.158:0/474575215 conn(0x7f758805e6b0 msgr2=0x7f7588066bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:04.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.611+0000 7f758d5a9700 1 -- 172.21.15.158:0/474575215 shutdown_connections 2023-10-18T17:24:04.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.611+0000 7f758d5a9700 1 -- 172.21.15.158:0/474575215 wait complete. 2023-10-18T17:24:04.639 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T17:24:04.839 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.831+0000 7f3a97d46700 1 Processor -- start 2023-10-18T17:24:04.840 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.831+0000 7f3a97d46700 1 -- start start 2023-10-18T17:24:04.842 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.835+0000 7f3a97d46700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3a900bcab0 0x7f3a9014a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:04.842 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.835+0000 7f3a97d46700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a900be020 con 0x7f3a90149cb0 2023-10-18T17:24:04.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.835+0000 7f3a97d46700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a90065130 con 0x7f3a90069d80 2023-10-18T17:24:04.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.835+0000 7f3a97d46700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a900bfa80 con 0x7f3a900bcab0 2023-10-18T17:24:04.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.835+0000 7f3a95ae2700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f3a90149cb0 0x7f3a900bd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:58698/0 (socket says 172.21.15.158:58698) 2023-10-18T17:24:04.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.835+0000 7f3a95ae2700 1 -- 172.21.15.158:0/877771941 learned_addr learned my addr 172.21.15.158:0/877771941 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:04.844 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.835+0000 7f3a952e1700 1 --2- 172.21.15.158:0/877771941 >> v2:172.21.15.183:3300/0 conn(0x7f3a900bcab0 0x7f3a9014a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:04.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.835+0000 7f3a94ae0700 1 -- 172.21.15.158:0/877771941 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254503104 0 0) 0x7f3a900be020 con 0x7f3a90149cb0 2023-10-18T17:24:04.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.835+0000 7f3a94ae0700 1 -- 172.21.15.158:0/877771941 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a7c0033f0 con 0x7f3a90149cb0 2023-10-18T17:24:04.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.835+0000 7f3a952e1700 1 -- 172.21.15.158:0/877771941 >> v1:172.21.15.183:6789/0 conn(0x7f3a90069d80 legacy=0x7f3a90067e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:04.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.835+0000 7f3a94ae0700 1 -- 172.21.15.158:0/877771941 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424944795 0 0) 0x7f3a90065130 con 0x7f3a90069d80 2023-10-18T17:24:04.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.835+0000 7f3a952e1700 1 -- 172.21.15.158:0/877771941 >> v1:172.21.15.158:6789/0 conn(0x7f3a90149cb0 legacy=0x7f3a900bd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:04.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.835+0000 7f3a952e1700 1 -- 172.21.15.158:0/877771941 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a900653f0 con 0x7f3a900bcab0 2023-10-18T17:24:04.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.839+0000 7f3a952e1700 1 --2- 172.21.15.158:0/877771941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a900bcab0 0x7f3a9014a090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3a80009760 tx=0x7f3a80009060).ready entity=mon.1 client_cookie=dfb6352de7e55f42 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:04.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.839+0000 7f3a94ae0700 1 -- 172.21.15.158:0/877771941 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8000b590 con 0x7f3a900bcab0 2023-10-18T17:24:04.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.839+0000 7f3a94ae0700 1 -- 172.21.15.158:0/877771941 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8000b6f0 con 0x7f3a900bcab0 2023-10-18T17:24:04.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.839+0000 7f3a94ae0700 1 -- 172.21.15.158:0/877771941 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8000ba70 con 0x7f3a900bcab0 2023-10-18T17:24:04.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.839+0000 7f3a97d46700 1 -- 172.21.15.158:0/877771941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a900bcab0 msgr2=0x7f3a9014a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:04.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.839+0000 7f3a97d46700 1 --2- 172.21.15.158:0/877771941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a900bcab0 0x7f3a9014a090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3a80009760 tx=0x7f3a80009060).stop 2023-10-18T17:24:04.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.839+0000 7f3a97d46700 1 -- 172.21.15.158:0/877771941 shutdown_connections 2023-10-18T17:24:04.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.839+0000 7f3a97d46700 1 --2- 172.21.15.158:0/877771941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a900bcab0 0x7f3a9014a090 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:04.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.839+0000 7f3a97d46700 1 -- 172.21.15.158:0/877771941 >> 172.21.15.158:0/877771941 conn(0x7f3a900620d0 msgr2=0x7f3a900624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:04.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.839+0000 7f3a97d46700 1 -- 172.21.15.158:0/877771941 shutdown_connections 2023-10-18T17:24:04.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.839+0000 7f3a97d46700 1 -- 172.21.15.158:0/877771941 wait complete. 2023-10-18T17:24:04.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.839+0000 7f3a97d46700 1 Processor -- start 2023-10-18T17:24:04.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.839+0000 7f3a97d46700 1 -- start start 2023-10-18T17:24:04.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a97d46700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a90069d80 0x7f3a90160e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:04.852 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a97d46700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a900bcab0 0x7f3a90151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:04.852 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a97d46700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a90149cb0 0x7f3a901438e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:04.852 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a97d46700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a900b6950 con 0x7f3a90149cb0 2023-10-18T17:24:04.852 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a97d46700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a90160990 con 0x7f3a90069d80 2023-10-18T17:24:04.852 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a97d46700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a900b5120 con 0x7f3a900bcab0 2023-10-18T17:24:04.853 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a962e3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a90149cb0 0x7f3a901438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:04.853 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a952e1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a900bcab0 0x7f3a90151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:04.853 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a95ae2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a90069d80 0x7f3a90160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:04.853 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a962e3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a90149cb0 0x7f3a901438e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56546/0 (socket says 172.21.15.158:56546) 2023-10-18T17:24:04.854 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a952e1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a900bcab0 0x7f3a90151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:38094/0 (socket says 172.21.15.158:38094) 2023-10-18T17:24:04.854 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a962e3700 1 -- 172.21.15.158:0/3205370177 learned_addr learned my addr 172.21.15.158:0/3205370177 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:04.854 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a95ae2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a90069d80 0x7f3a90160e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:37722/0 (socket says 172.21.15.158:37722) 2023-10-18T17:24:04.855 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a95ae2700 1 -- 172.21.15.158:0/3205370177 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a900bcab0 msgr2=0x7f3a90151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:04.855 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a95ae2700 1 --2- 172.21.15.158:0/3205370177 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a900bcab0 0x7f3a90151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:04.855 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a95ae2700 1 -- 172.21.15.158:0/3205370177 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a90149cb0 msgr2=0x7f3a901438e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:04.856 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a95ae2700 1 --2- 172.21.15.158:0/3205370177 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a90149cb0 0x7f3a901438e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:04.856 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a95ae2700 1 -- 172.21.15.158:0/3205370177 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a800092a0 con 0x7f3a90069d80 2023-10-18T17:24:04.856 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a962e3700 1 --2- 172.21.15.158:0/3205370177 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a90149cb0 0x7f3a901438e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:04.857 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a95ae2700 1 --2- 172.21.15.158:0/3205370177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a90069d80 0x7f3a90160e20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f3a8c00c410 tx=0x7f3a8c007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:04.858 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a85ffb700 1 -- 172.21.15.158:0/3205370177 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c0070d0 con 0x7f3a90069d80 2023-10-18T17:24:04.858 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a85ffb700 1 -- 172.21.15.158:0/3205370177 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8c007250 con 0x7f3a90069d80 2023-10-18T17:24:04.858 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a97d46700 1 -- 172.21.15.158:0/3205370177 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a901538e0 con 0x7f3a90069d80 2023-10-18T17:24:04.859 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a85ffb700 1 -- 172.21.15.158:0/3205370177 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c007610 con 0x7f3a90069d80 2023-10-18T17:24:04.859 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.843+0000 7f3a97d46700 1 -- 172.21.15.158:0/3205370177 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a90153ba0 con 0x7f3a90069d80 2023-10-18T17:24:04.859 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.847+0000 7f3a97d46700 1 -- 172.21.15.158:0/3205370177 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a9006c190 con 0x7f3a90069d80 2023-10-18T17:24:04.859 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.847+0000 7f3a85ffb700 1 -- 172.21.15.158:0/3205370177 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3a8c0059b0 con 0x7f3a90069d80 2023-10-18T17:24:04.859 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.851+0000 7f3a85ffb700 1 --2- 172.21.15.158:0/3205370177 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f3a7405a510 0x7f3a7405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:04.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.851+0000 7f3a85ffb700 1 -- 172.21.15.158:0/3205370177 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3a8c073cf0 con 0x7f3a90069d80 2023-10-18T17:24:04.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.851+0000 7f3a952e1700 1 --2- 172.21.15.158:0/3205370177 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f3a7405a510 0x7f3a7405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:04.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.851+0000 7f3a952e1700 1 --2- 172.21.15.158:0/3205370177 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f3a7405a510 0x7f3a7405c9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3a8000b350 tx=0x7f3a80017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:04.866 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:04.859+0000 7f3a85ffb700 1 -- 172.21.15.158:0/3205370177 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f3a8c047410 con 0x7f3a90069d80 2023-10-18T17:24:05.029 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.023+0000 7f3a97d46700 1 -- 172.21.15.158:0/3205370177 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a900656d0 con 0x7f3a90069d80 2023-10-18T17:24:05.031 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.023+0000 7f3a85ffb700 1 -- 172.21.15.158:0/3205370177 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16989 (secure 0 0 0) 0x7f3a8c04aa30 con 0x7f3a90069d80 2023-10-18T17:24:05.032 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:05.032 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":21,"fsid":"ca4bb219-38c8-4c5b-a49c-213b123db018","created":"2023-10-18T17:23:45.550173+0000","modified":"2023-10-18T17:24:04.214162+0000","last_up_change":"2023-10-18T17:23:55.617219+0000","last_in_change":"2023-10-18T17:23:47.727646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-18T17:23:54.686216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T17:23:56.743672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T17:24:02.200531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T17:24:03.168929+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f621b1e-5ea4-4dc3-80e1-c415c7cc97d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6815","nonce":33195},{"type":"v1","addr":"172.21.15.158:6817","nonce":33195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":33195},{"type":"v1","addr":"172.21.15.158:6819","nonce":33195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":33195},{"type":"v1","addr":"172.21.15.158:6824","nonce":33195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":33195},{"type":"v1","addr":"172.21.15.158:6821","nonce":33195}]},"public_addr":"172.21.15.158:6817/33195","cluster_addr":"172.21.15.158:6819/33195","heartbeat_back_addr":"172.21.15.158:6824/33195","heartbeat_front_addr":"172.21.15.158:6821/33195","state":["exists","up"]},{"osd":1,"uuid":"769d7514-319f-4ac3-8cf3-6f88f4e7da2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6823","nonce":33196},{"type":"v1","addr":"172.21.15.158:6825","nonce":33196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":33196},{"type":"v1","addr":"172.21.15.158:6827","nonce":33196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":33196},{"type":"v1","addr":"172.21.15.158:6831","nonce":33196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":33196},{"type":"v1","addr":"172.21.15.158:6829","nonce":33196}]},"public_addr":"172.21.15.158:6825/33196","cluster_addr":"172.21.15.158:6827/33196","heartbeat_back_addr":"172.21.15.158:6831/33196","heartbeat_front_addr":"172.21.15.158:6829/33196","state":["exists","up"]},{"osd":2,"uuid":"b4459762-309d-454c-bd31-33b90192375f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":33193},{"type":"v1","addr":"172.21.15.158:6809","nonce":33193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":33193},{"type":"v1","addr":"172.21.15.158:6811","nonce":33193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":33193},{"type":"v1","addr":"172.21.15.158:6816","nonce":33193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":33193},{"type":"v1","addr":"172.21.15.158:6813","nonce":33193}]},"public_addr":"172.21.15.158:6809/33193","cluster_addr":"172.21.15.158:6811/33193","heartbeat_back_addr":"172.21.15.158:6816/33193","heartbeat_front_addr":"172.21.15.158:6813/33193","state":["exists","up"]},{"osd":3,"uuid":"7b78a411-1ae9-4051-ae9d-a03abc5a73ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":33194},{"type":"v1","addr":"172.21.15.158:6801","nonce":33194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":33194},{"type":"v1","addr":"172.21.15.158:6803","nonce":33194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":33194},{"type":"v1","addr":"172.21.15.158:6807","nonce":33194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":33194},{"type":"v1","addr":"172.21.15.158:6805","nonce":33194}]},"public_addr":"172.21.15.158:6801/33194","cluster_addr":"172.21.15.158:6803/33194","heartbeat_back_addr":"172.21.15.158:6807/33194","heartbeat_front_addr":"172.21.15.158:6805/33194","state":["exists","up"]},{"osd":4,"uuid":"58005b5f-2742-4ecb-8c3a-a2ae65c7fb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":33897},{"type":"v1","addr":"172.21.15.183:6801","nonce":33897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6803","nonce":33897},{"type":"v1","addr":"172.21.15.183:6805","nonce":33897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":33897},{"type":"v1","addr":"172.21.15.183:6812","nonce":33897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":33897},{"type":"v1","addr":"172.21.15.183:6808","nonce":33897}]},"public_addr":"172.21.15.183:6801/33897","cluster_addr":"172.21.15.183:6805/33897","heartbeat_back_addr":"172.21.15.183:6812/33897","heartbeat_front_addr":"172.21.15.183:6808/33897","state":["exists","up"]},{"osd":5,"uuid":"c0b217ed-1c09-4cde-b192-65624ab3a70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":33898},{"type":"v1","addr":"172.21.15.183:6804","nonce":33898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6807","nonce":33898},{"type":"v1","addr":"172.21.15.183:6809","nonce":33898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":33898},{"type":"v1","addr":"172.21.15.183:6815","nonce":33898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6811","nonce":33898},{"type":"v1","addr":"172.21.15.183:6813","nonce":33898}]},"public_addr":"172.21.15.183:6804/33898","cluster_addr":"172.21.15.183:6809/33898","heartbeat_back_addr":"172.21.15.183:6815/33898","heartbeat_front_addr":"172.21.15.183:6813/33898","state":["exists","up"]},{"osd":6,"uuid":"5f910aac-4091-408b-8b2b-19865b21395c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":33910},{"type":"v1","addr":"172.21.15.183:6825","nonce":33910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":33910},{"type":"v1","addr":"172.21.15.183:6827","nonce":33910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":33910},{"type":"v1","addr":"172.21.15.183:6831","nonce":33910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":33910},{"type":"v1","addr":"172.21.15.183:6829","nonce":33910}]},"public_addr":"172.21.15.183:6825/33910","cluster_addr":"172.21.15.183:6827/33910","heartbeat_back_addr":"172.21.15.183:6831/33910","heartbeat_front_addr":"172.21.15.183:6829/33910","state":["exists","up"]},{"osd":7,"uuid":"96d7b9aa-687e-42e3-a5cf-1533931ecce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":33903},{"type":"v1","addr":"172.21.15.183:6817","nonce":33903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":33903},{"type":"v1","addr":"172.21.15.183:6819","nonce":33903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":33903},{"type":"v1","addr":"172.21.15.183:6823","nonce":33903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":33903},{"type":"v1","addr":"172.21.15.183:6821","nonce":33903}]},"public_addr":"172.21.15.183:6817/33903","cluster_addr":"172.21.15.183:6819/33903","heartbeat_back_addr":"172.21.15.183:6823/33903","heartbeat_front_addr":"172.21.15.183:6821/33903","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.622366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.713036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.561097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.546583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.007074+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:52.994413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.176820+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:52.906075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T17:24:05.036 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.027+0000 7f3a97d46700 1 -- 172.21.15.158:0/3205370177 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f3a7405a510 msgr2=0x7f3a7405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:05.037 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.027+0000 7f3a97d46700 1 --2- 172.21.15.158:0/3205370177 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f3a7405a510 0x7f3a7405c9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3a8000b350 tx=0x7f3a80017000).stop 2023-10-18T17:24:05.037 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.027+0000 7f3a97d46700 1 -- 172.21.15.158:0/3205370177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a90069d80 msgr2=0x7f3a90160e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:05.037 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.027+0000 7f3a97d46700 1 --2- 172.21.15.158:0/3205370177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a90069d80 0x7f3a90160e20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f3a8c00c410 tx=0x7f3a8c007b90).stop 2023-10-18T17:24:05.037 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.031+0000 7f3a97d46700 1 -- 172.21.15.158:0/3205370177 shutdown_connections 2023-10-18T17:24:05.037 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.031+0000 7f3a97d46700 1 --2- 172.21.15.158:0/3205370177 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f3a7405a510 0x7f3a7405c9d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:05.038 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.031+0000 7f3a97d46700 1 --2- 172.21.15.158:0/3205370177 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a90149cb0 0x7f3a901438e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:05.038 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.031+0000 7f3a97d46700 1 --2- 172.21.15.158:0/3205370177 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a900bcab0 0x7f3a90151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:05.038 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.031+0000 7f3a97d46700 1 --2- 172.21.15.158:0/3205370177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a90069d80 0x7f3a90160e20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:05.038 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.031+0000 7f3a97d46700 1 -- 172.21.15.158:0/3205370177 >> 172.21.15.158:0/3205370177 conn(0x7f3a900620d0 msgr2=0x7f3a901470c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:05.039 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.031+0000 7f3a97d46700 1 -- 172.21.15.158:0/3205370177 shutdown_connections 2023-10-18T17:24:05.039 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.031+0000 7f3a97d46700 1 -- 172.21.15.158:0/3205370177 wait complete. 2023-10-18T17:24:05.056 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-18T17:24:05.221 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.215+0000 7f360759e700 1 Processor -- start 2023-10-18T17:24:05.221 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.215+0000 7f360759e700 1 -- start start 2023-10-18T17:24:05.223 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.215+0000 7f360759e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36080c23e0 0x7f36080c11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:05.224 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.215+0000 7f360759e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3608065670 0x7f3608065ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:05.224 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.215+0000 7f360759e700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360814ffb0 con 0x7f36080c27c0 2023-10-18T17:24:05.224 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.215+0000 7f360759e700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3608150df0 con 0x7f3608065670 2023-10-18T17:24:05.224 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.215+0000 7f360759e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3608150270 con 0x7f36080c23e0 2023-10-18T17:24:05.225 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.219+0000 7f3605d9b700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f36080c27c0 0x7f36080664a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:40714/0 (socket says 172.21.15.158:40714) 2023-10-18T17:24:05.226 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.219+0000 7f3606d9d700 1 --2- 172.21.15.158:0/2612552839 >> v2:172.21.15.183:3300/0 conn(0x7f3608065670 0x7f3608065ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:05.226 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.219+0000 7f3605d9b700 1 -- 172.21.15.158:0/2612552839 learned_addr learned my addr 172.21.15.158:0/2612552839 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:05.226 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.219+0000 7f360659c700 1 --2- 172.21.15.158:0/2612552839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36080c23e0 0x7f36080c11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:05.226 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.219+0000 7f3606d9d700 1 -- 172.21.15.158:0/2612552839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36080c23e0 msgr2=0x7f36080c11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:05.226 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.219+0000 7f3606d9d700 1 --2- 172.21.15.158:0/2612552839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36080c23e0 0x7f36080c11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:05.227 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.219+0000 7f3606d9d700 1 -- 172.21.15.158:0/2612552839 >> v1:172.21.15.183:6789/0 conn(0x7f36080c27c0 legacy=0x7f36080664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:05.227 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.219+0000 7f3606d9d700 1 -- 172.21.15.158:0/2612552839 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3608150550 con 0x7f3608065670 2023-10-18T17:24:05.227 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.219+0000 7f3606d9d700 1 --2- 172.21.15.158:0/2612552839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3608065670 0x7f3608065ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3600009e60 tx=0x7f3600009780).ready entity=mon.1 client_cookie=67f34f380de0410f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:05.233 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.227+0000 7f360559a700 1 -- 172.21.15.158:0/2612552839 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360000e070 con 0x7f3608065670 2023-10-18T17:24:05.233 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.227+0000 7f360559a700 1 -- 172.21.15.158:0/2612552839 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360000bb60 con 0x7f3608065670 2023-10-18T17:24:05.233 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.227+0000 7f360559a700 1 -- 172.21.15.158:0/2612552839 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3600012410 con 0x7f3608065670 2023-10-18T17:24:05.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.227+0000 7f360759e700 1 -- 172.21.15.158:0/2612552839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3608065670 msgr2=0x7f3608065ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:05.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.227+0000 7f360759e700 1 --2- 172.21.15.158:0/2612552839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3608065670 0x7f3608065ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3600009e60 tx=0x7f3600009780).stop 2023-10-18T17:24:05.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.227+0000 7f360759e700 1 -- 172.21.15.158:0/2612552839 shutdown_connections 2023-10-18T17:24:05.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.227+0000 7f360759e700 1 --2- 172.21.15.158:0/2612552839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3608065670 0x7f3608065ac0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:05.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.227+0000 7f360759e700 1 --2- 172.21.15.158:0/2612552839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36080c23e0 0x7f36080c11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:05.236 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.227+0000 7f360759e700 1 -- 172.21.15.158:0/2612552839 >> 172.21.15.158:0/2612552839 conn(0x7f36080620d0 msgr2=0x7f36080624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:05.236 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.227+0000 7f360759e700 1 -- 172.21.15.158:0/2612552839 shutdown_connections 2023-10-18T17:24:05.236 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.227+0000 7f360759e700 1 -- 172.21.15.158:0/2612552839 wait complete. 2023-10-18T17:24:05.237 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f360759e700 1 Processor -- start 2023-10-18T17:24:05.237 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f360759e700 1 -- start start 2023-10-18T17:24:05.238 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f360759e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3608065670 0x7f36080bdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:05.238 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f360759e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36080c23e0 0x7f36081605c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:05.238 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f360759e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36080c27c0 0x7f3608160ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:05.238 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f360759e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36081535a0 con 0x7f3608065670 2023-10-18T17:24:05.239 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f360759e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3608154bc0 con 0x7f36080c23e0 2023-10-18T17:24:05.239 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f360759e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3608153800 con 0x7f36080c27c0 2023-10-18T17:24:05.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f3606d9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36080c27c0 0x7f3608160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:05.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f3605d9b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36080c23e0 0x7f36081605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:05.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f360659c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3608065670 0x7f36080bdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:05.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f3606d9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36080c27c0 0x7f3608160ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:38100/0 (socket says 172.21.15.158:38100) 2023-10-18T17:24:05.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f3606d9d700 1 -- 172.21.15.158:0/2904439912 learned_addr learned my addr 172.21.15.158:0/2904439912 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:05.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f3606d9d700 1 -- 172.21.15.158:0/2904439912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36080c23e0 msgr2=0x7f36081605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:05.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f3606d9d700 1 --2- 172.21.15.158:0/2904439912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36080c23e0 0x7f36081605c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:05.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f3606d9d700 1 -- 172.21.15.158:0/2904439912 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3608065670 msgr2=0x7f36080bdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:05.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f3606d9d700 1 --2- 172.21.15.158:0/2904439912 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3608065670 0x7f36080bdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:05.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f3606d9d700 1 -- 172.21.15.158:0/2904439912 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3600009a20 con 0x7f36080c27c0 2023-10-18T17:24:05.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f3606d9d700 1 --2- 172.21.15.158:0/2904439912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36080c27c0 0x7f3608160ab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f3608064f80 tx=0x7f360805e940).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:05.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.231+0000 7f35f67fc700 1 -- 172.21.15.158:0/2904439912 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360001d630 con 0x7f36080c27c0 2023-10-18T17:24:05.243 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.235+0000 7f35f67fc700 1 -- 172.21.15.158:0/2904439912 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360001d790 con 0x7f36080c27c0 2023-10-18T17:24:05.243 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.235+0000 7f360759e700 1 -- 172.21.15.158:0/2904439912 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36080bf190 con 0x7f36080c27c0 2023-10-18T17:24:05.243 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.235+0000 7f35f67fc700 1 -- 172.21.15.158:0/2904439912 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360001db50 con 0x7f36080c27c0 2023-10-18T17:24:05.243 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.235+0000 7f360759e700 1 -- 172.21.15.158:0/2904439912 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36080bf750 con 0x7f36080c27c0 2023-10-18T17:24:05.244 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.235+0000 7f360759e700 1 -- 172.21.15.158:0/2904439912 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3608046f00 con 0x7f36080c27c0 2023-10-18T17:24:05.244 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.235+0000 7f35f67fc700 1 -- 172.21.15.158:0/2904439912 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3600003040 con 0x7f36080c27c0 2023-10-18T17:24:05.245 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.239+0000 7f35f67fc700 1 --2- 172.21.15.158:0/2904439912 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f35e805a540 0x7f35e805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:05.245 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.239+0000 7f35f67fc700 1 -- 172.21.15.158:0/2904439912 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3600076820 con 0x7f36080c27c0 2023-10-18T17:24:05.245 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.239+0000 7f360659c700 1 --2- 172.21.15.158:0/2904439912 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f35e805a540 0x7f35e805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:05.246 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.239+0000 7f360659c700 1 --2- 172.21.15.158:0/2904439912 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f35e805a540 0x7f35e805ca00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f35f8009c30 tx=0x7f35f8009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:05.249 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.243+0000 7f35f67fc700 1 -- 172.21.15.158:0/2904439912 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f360004a000 con 0x7f36080c27c0 2023-10-18T17:24:05.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:05.447+0000 7f360759e700 1 -- 172.21.15.158:0/2904439912 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3608063e20 con 0x7f36080c27c0 2023-10-18T17:24:06.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.227+0000 7f35f67fc700 1 -- 172.21.15.158:0/2904439912 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f360004d620 con 0x7f36080c27c0 2023-10-18T17:24:06.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.231+0000 7f360759e700 1 -- 172.21.15.158:0/2904439912 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f35e805a540 msgr2=0x7f35e805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:06.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.231+0000 7f360759e700 1 --2- 172.21.15.158:0/2904439912 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f35e805a540 0x7f35e805ca00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f35f8009c30 tx=0x7f35f8009060).stop 2023-10-18T17:24:06.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.231+0000 7f360759e700 1 -- 172.21.15.158:0/2904439912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36080c27c0 msgr2=0x7f3608160ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:06.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.231+0000 7f360759e700 1 --2- 172.21.15.158:0/2904439912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36080c27c0 0x7f3608160ab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f3608064f80 tx=0x7f360805e940).stop 2023-10-18T17:24:06.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.231+0000 7f360759e700 1 -- 172.21.15.158:0/2904439912 shutdown_connections 2023-10-18T17:24:06.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.231+0000 7f360759e700 1 --2- 172.21.15.158:0/2904439912 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f35e805a540 0x7f35e805ca00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:06.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.231+0000 7f360759e700 1 --2- 172.21.15.158:0/2904439912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36080c27c0 0x7f3608160ab0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:06.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.231+0000 7f360759e700 1 --2- 172.21.15.158:0/2904439912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36080c23e0 0x7f36081605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:06.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.231+0000 7f360759e700 1 --2- 172.21.15.158:0/2904439912 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3608065670 0x7f36080bdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:06.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.231+0000 7f360759e700 1 -- 172.21.15.158:0/2904439912 >> 172.21.15.158:0/2904439912 conn(0x7f36080620d0 msgr2=0x7f3608068140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:06.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.231+0000 7f360759e700 1 -- 172.21.15.158:0/2904439912 shutdown_connections 2023-10-18T17:24:06.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.235+0000 7f360759e700 1 -- 172.21.15.158:0/2904439912 wait complete. 2023-10-18T17:24:06.261 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300} 2023-10-18T17:24:06.262 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-10-18T17:24:06.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.431+0000 7f75aacb9700 1 Processor -- start 2023-10-18T17:24:06.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.431+0000 7f75aacb9700 1 -- start start 2023-10-18T17:24:06.442 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75aacb9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f75a40bec80 0x7f75a40bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:06.442 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75aacb9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f75a40bf060 0x7f75a4068710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:06.442 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75aacb9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a4068c00 0x7f75a4157720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:06.442 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75aacb9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a40666a0 con 0x7f75a40bec80 2023-10-18T17:24:06.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75aacb9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a40bd5e0 con 0x7f75a40bf060 2023-10-18T17:24:06.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75aacb9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a4066170 con 0x7f75a4068c00 2023-10-18T17:24:06.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75a9cb7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f75a40bec80 0x7f75a40bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:06.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75a9cb7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f75a40bec80 0x7f75a40bc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56566/0 (socket says 172.21.15.158:56566) 2023-10-18T17:24:06.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75a9cb7700 1 -- 172.21.15.158:0/32129432 learned_addr learned my addr 172.21.15.158:0/32129432 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:06.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75a94b6700 1 --2- 172.21.15.158:0/32129432 >> v2:172.21.15.183:3300/0 conn(0x7f75a40bf060 0x7f75a4068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:06.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75aa4b8700 1 --2- 172.21.15.158:0/32129432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a4068c00 0x7f75a4157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:06.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75a9cb7700 1 -- 172.21.15.158:0/32129432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a4068c00 msgr2=0x7f75a4157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:06.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75a9cb7700 1 --2- 172.21.15.158:0/32129432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a4068c00 0x7f75a4157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:06.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75a9cb7700 1 -- 172.21.15.158:0/32129432 >> v2:172.21.15.183:3300/0 conn(0x7f75a40bf060 msgr2=0x7f75a4068710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:06.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75a9cb7700 1 --2- 172.21.15.158:0/32129432 >> v2:172.21.15.183:3300/0 conn(0x7f75a40bf060 0x7f75a4068710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:06.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75a9cb7700 1 -- 172.21.15.158:0/32129432 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a4068280 con 0x7f75a40bec80 2023-10-18T17:24:06.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75a9cb7700 1 --2- 172.21.15.158:0/32129432 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75a40bec80 0x7f75a40bc8b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f75a405e770 tx=0x7f75a00090f0).ready entity=mon.0 client_cookie=d482c65ad95151c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:06.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75a8cb5700 1 -- 172.21.15.158:0/32129432 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a000b520 con 0x7f75a40bec80 2023-10-18T17:24:06.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75a8cb5700 1 -- 172.21.15.158:0/32129432 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a000b680 con 0x7f75a40bec80 2023-10-18T17:24:06.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.435+0000 7f75a8cb5700 1 -- 172.21.15.158:0/32129432 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a000ba20 con 0x7f75a40bec80 2023-10-18T17:24:06.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.439+0000 7f75aacb9700 1 -- 172.21.15.158:0/32129432 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75a40bec80 msgr2=0x7f75a40bc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:06.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.439+0000 7f75aacb9700 1 --2- 172.21.15.158:0/32129432 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75a40bec80 0x7f75a40bc8b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f75a405e770 tx=0x7f75a00090f0).stop 2023-10-18T17:24:06.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.439+0000 7f75aacb9700 1 -- 172.21.15.158:0/32129432 shutdown_connections 2023-10-18T17:24:06.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.439+0000 7f75aacb9700 1 --2- 172.21.15.158:0/32129432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a4068c00 0x7f75a4157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:06.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.439+0000 7f75aacb9700 1 --2- 172.21.15.158:0/32129432 >> v2:172.21.15.183:3300/0 conn(0x7f75a40bf060 0x7f75a4068710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:06.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.439+0000 7f75aacb9700 1 --2- 172.21.15.158:0/32129432 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75a40bec80 0x7f75a40bc8b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:06.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.439+0000 7f75aacb9700 1 -- 172.21.15.158:0/32129432 >> 172.21.15.158:0/32129432 conn(0x7f75a40645a0 msgr2=0x7f75a40649b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:06.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.439+0000 7f75aacb9700 1 -- 172.21.15.158:0/32129432 shutdown_connections 2023-10-18T17:24:06.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.439+0000 7f75aacb9700 1 -- 172.21.15.158:0/32129432 wait complete. 2023-10-18T17:24:06.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.443+0000 7f75aacb9700 1 Processor -- start 2023-10-18T17:24:06.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.443+0000 7f75aacb9700 1 -- start start 2023-10-18T17:24:06.451 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.443+0000 7f75aacb9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75a4068c00 0x7f75a414e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:06.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.443+0000 7f75aacb9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75a40bec80 0x7f75a414e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:06.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.443+0000 7f75aacb9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a414ee50 0x7f75a4152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:06.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.443+0000 7f75aacb9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a414ecf0 con 0x7f75a40bec80 2023-10-18T17:24:06.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.443+0000 7f75aacb9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a4154d30 con 0x7f75a4068c00 2023-10-18T17:24:06.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.443+0000 7f75aacb9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a4152180 con 0x7f75a414ee50 2023-10-18T17:24:06.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.443+0000 7f75a94b6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75a40bec80 0x7f75a414e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:06.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.443+0000 7f75aa4b8700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a414ee50 0x7f75a4152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:06.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.443+0000 7f75a94b6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75a40bec80 0x7f75a414e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56582/0 (socket says 172.21.15.158:56582) 2023-10-18T17:24:06.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.443+0000 7f75a94b6700 1 -- 172.21.15.158:0/1718605525 learned_addr learned my addr 172.21.15.158:0/1718605525 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:06.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.443+0000 7f75a9cb7700 1 --2- 172.21.15.158:0/1718605525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75a4068c00 0x7f75a414e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:06.454 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.447+0000 7f75a94b6700 1 -- 172.21.15.158:0/1718605525 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a414ee50 msgr2=0x7f75a4152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:06.455 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.447+0000 7f75a94b6700 1 --2- 172.21.15.158:0/1718605525 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a414ee50 0x7f75a4152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:06.455 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.447+0000 7f75a94b6700 1 -- 172.21.15.158:0/1718605525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75a4068c00 msgr2=0x7f75a414e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:06.455 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.447+0000 7f75a94b6700 1 --2- 172.21.15.158:0/1718605525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75a4068c00 0x7f75a414e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:06.455 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.447+0000 7f75a94b6700 1 -- 172.21.15.158:0/1718605525 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a0009370 con 0x7f75a40bec80 2023-10-18T17:24:06.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.447+0000 7f75a94b6700 1 --2- 172.21.15.158:0/1718605525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75a40bec80 0x7f75a414e800 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f759400e930 tx=0x7f7594009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:06.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.447+0000 7f7599ffb700 1 -- 172.21.15.158:0/1718605525 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594009510 con 0x7f75a40bec80 2023-10-18T17:24:06.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.447+0000 7f7599ffb700 1 -- 172.21.15.158:0/1718605525 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7594012600 con 0x7f75a40bec80 2023-10-18T17:24:06.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.447+0000 7f7599ffb700 1 -- 172.21.15.158:0/1718605525 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594012980 con 0x7f75a40bec80 2023-10-18T17:24:06.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.447+0000 7f75aacb9700 1 -- 172.21.15.158:0/1718605525 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a4152460 con 0x7f75a40bec80 2023-10-18T17:24:06.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.447+0000 7f75aacb9700 1 -- 172.21.15.158:0/1718605525 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a4152a20 con 0x7f75a40bec80 2023-10-18T17:24:06.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.447+0000 7f75aacb9700 1 -- 172.21.15.158:0/1718605525 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a4152be0 con 0x7f75a40bec80 2023-10-18T17:24:06.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.447+0000 7f7599ffb700 1 -- 172.21.15.158:0/1718605525 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f759401b400 con 0x7f75a40bec80 2023-10-18T17:24:06.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.451+0000 7f7599ffb700 1 --2- 172.21.15.158:0/1718605525 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f758805a4e0 0x7f758805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:06.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.451+0000 7f7599ffb700 1 -- 172.21.15.158:0/1718605525 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7594074c00 con 0x7f75a40bec80 2023-10-18T17:24:06.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.451+0000 7f75a9cb7700 1 --2- 172.21.15.158:0/1718605525 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f758805a4e0 0x7f758805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:06.459 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.451+0000 7f75a9cb7700 1 --2- 172.21.15.158:0/1718605525 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f758805a4e0 0x7f758805c9a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f75a000b2e0 tx=0x7f75a0017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:06.466 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.459+0000 7f7599ffb700 1 -- 172.21.15.158:0/1718605525 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f759407b080 con 0x7f75a40bec80 2023-10-18T17:24:06.666 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:06.659+0000 7f75aacb9700 1 -- 172.21.15.158:0/1718605525 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f75a4062e40 con 0x7f75a40bec80 2023-10-18T17:24:07.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.235+0000 7f7599ffb700 1 -- 172.21.15.158:0/1718605525 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f7594048380 con 0x7f75a40bec80 2023-10-18T17:24:07.247 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.239+0000 7f75aacb9700 1 -- 172.21.15.158:0/1718605525 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f758805a4e0 msgr2=0x7f758805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:07.247 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.239+0000 7f75aacb9700 1 --2- 172.21.15.158:0/1718605525 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f758805a4e0 0x7f758805c9a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f75a000b2e0 tx=0x7f75a0017000).stop 2023-10-18T17:24:07.247 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.239+0000 7f75aacb9700 1 -- 172.21.15.158:0/1718605525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75a40bec80 msgr2=0x7f75a414e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:07.247 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.239+0000 7f75aacb9700 1 --2- 172.21.15.158:0/1718605525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75a40bec80 0x7f75a414e800 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f759400e930 tx=0x7f7594009060).stop 2023-10-18T17:24:07.247 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.239+0000 7f75aacb9700 1 -- 172.21.15.158:0/1718605525 shutdown_connections 2023-10-18T17:24:07.248 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.239+0000 7f75aacb9700 1 --2- 172.21.15.158:0/1718605525 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f758805a4e0 0x7f758805c9a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:07.248 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.239+0000 7f75aacb9700 1 --2- 172.21.15.158:0/1718605525 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a414ee50 0x7f75a4152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:07.248 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.239+0000 7f75aacb9700 1 --2- 172.21.15.158:0/1718605525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f75a40bec80 0x7f75a414e800 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:07.248 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.239+0000 7f75aacb9700 1 --2- 172.21.15.158:0/1718605525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75a4068c00 0x7f75a414e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:07.248 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.239+0000 7f75aacb9700 1 -- 172.21.15.158:0/1718605525 >> 172.21.15.158:0/1718605525 conn(0x7f75a40645a0 msgr2=0x7f75a40bd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:07.249 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.239+0000 7f75aacb9700 1 -- 172.21.15.158:0/1718605525 shutdown_connections 2023-10-18T17:24:07.249 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.239+0000 7f75aacb9700 1 -- 172.21.15.158:0/1718605525 wait complete. 2023-10-18T17:24:07.268 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-18T17:24:07.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.431+0000 7fdbbb107700 1 Processor -- start 2023-10-18T17:24:07.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.431+0000 7fdbbb107700 1 -- start start 2023-10-18T17:24:07.441 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.435+0000 7fdbbb107700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb40c11f0 0x7fdbb40c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:07.441 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.435+0000 7fdbbb107700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fdbb4065670 0x7fdbb4065ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:07.441 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.435+0000 7fdbbb107700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb414ffb0 con 0x7fdbb40c23e0 2023-10-18T17:24:07.442 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.435+0000 7fdbbb107700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb4150df0 con 0x7fdbb4065670 2023-10-18T17:24:07.442 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.435+0000 7fdbbb107700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb4150270 con 0x7fdbb40c11f0 2023-10-18T17:24:07.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.435+0000 7fdbba906700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fdbb4065670 0x7fdbb4065ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:07.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.435+0000 7fdbba906700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fdbb4065670 0x7fdbb4065ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56598/0 (socket says 172.21.15.158:56598) 2023-10-18T17:24:07.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.435+0000 7fdbba105700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fdbb40c23e0 0x7fdbb40664a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:58714/0 (socket says 172.21.15.158:58714) 2023-10-18T17:24:07.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.435+0000 7fdbba906700 1 -- 172.21.15.158:0/3787622978 learned_addr learned my addr 172.21.15.158:0/3787622978 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:07.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.435+0000 7fdbb9904700 1 --2- 172.21.15.158:0/3787622978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb40c11f0 0x7fdbb40c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:07.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.435+0000 7fdbba906700 1 -- 172.21.15.158:0/3787622978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb40c11f0 msgr2=0x7fdbb40c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:07.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.435+0000 7fdbba906700 1 --2- 172.21.15.158:0/3787622978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb40c11f0 0x7fdbb40c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:07.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.435+0000 7fdbba906700 1 -- 172.21.15.158:0/3787622978 >> v1:172.21.15.158:6789/0 conn(0x7fdbb40c23e0 legacy=0x7fdbb40664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:07.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.435+0000 7fdbba906700 1 -- 172.21.15.158:0/3787622978 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb4150550 con 0x7fdbb4065670 2023-10-18T17:24:07.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.435+0000 7fdbb9904700 1 --2- 172.21.15.158:0/3787622978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb40c11f0 0x7fdbb40c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:24:07.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.435+0000 7fdbba906700 1 --2- 172.21.15.158:0/3787622978 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdbb4065670 0x7fdbb4065ae0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fdbac009f20 tx=0x7fdbac009840).ready entity=mon.0 client_cookie=955cae1719e27c66 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:07.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.435+0000 7fdbb9103700 1 -- 172.21.15.158:0/3787622978 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac00e070 con 0x7fdbb4065670 2023-10-18T17:24:07.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.435+0000 7fdbb9103700 1 -- 172.21.15.158:0/3787622978 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbac00ba80 con 0x7fdbb4065670 2023-10-18T17:24:07.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.435+0000 7fdbb9103700 1 -- 172.21.15.158:0/3787622978 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac00be00 con 0x7fdbb4065670 2023-10-18T17:24:07.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.439+0000 7fdbbb107700 1 -- 172.21.15.158:0/3787622978 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdbb4065670 msgr2=0x7fdbb4065ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:07.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.439+0000 7fdbbb107700 1 --2- 172.21.15.158:0/3787622978 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdbb4065670 0x7fdbb4065ae0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fdbac009f20 tx=0x7fdbac009840).stop 2023-10-18T17:24:07.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.439+0000 7fdbbb107700 1 -- 172.21.15.158:0/3787622978 shutdown_connections 2023-10-18T17:24:07.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.439+0000 7fdbbb107700 1 --2- 172.21.15.158:0/3787622978 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdbb4065670 0x7fdbb4065ae0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:07.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.439+0000 7fdbbb107700 1 --2- 172.21.15.158:0/3787622978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb40c11f0 0x7fdbb40c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:07.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.439+0000 7fdbbb107700 1 -- 172.21.15.158:0/3787622978 >> 172.21.15.158:0/3787622978 conn(0x7fdbb40620d0 msgr2=0x7fdbb40624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:07.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.439+0000 7fdbbb107700 1 -- 172.21.15.158:0/3787622978 shutdown_connections 2023-10-18T17:24:07.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.439+0000 7fdbbb107700 1 -- 172.21.15.158:0/3787622978 wait complete. 2023-10-18T17:24:07.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.443+0000 7fdbbb107700 1 Processor -- start 2023-10-18T17:24:07.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.443+0000 7fdbbb107700 1 -- start start 2023-10-18T17:24:07.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.443+0000 7fdbbb107700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdbb4065670 0x7fdbb4152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:07.451 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.443+0000 7fdbbb107700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbb40c11f0 0x7fdbb4152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:07.451 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.443+0000 7fdbbb107700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb40c23e0 0x7fdbb414b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:07.451 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.443+0000 7fdbbb107700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb41539c0 con 0x7fdbb4065670 2023-10-18T17:24:07.451 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.443+0000 7fdbbb107700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb4151c30 con 0x7fdbb40c11f0 2023-10-18T17:24:07.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.443+0000 7fdbbb107700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb41521f0 con 0x7fdbb40c23e0 2023-10-18T17:24:07.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.443+0000 7fdbba105700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdbb4065670 0x7fdbb4152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:07.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.443+0000 7fdbba105700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdbb4065670 0x7fdbb4152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56602/0 (socket says 172.21.15.158:56602) 2023-10-18T17:24:07.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.443+0000 7fdbba105700 1 -- 172.21.15.158:0/2050216710 learned_addr learned my addr 172.21.15.158:0/2050216710 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:07.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.443+0000 7fdbb9904700 1 --2- 172.21.15.158:0/2050216710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbb40c11f0 0x7fdbb4152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:07.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.443+0000 7fdbba906700 1 --2- 172.21.15.158:0/2050216710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb40c23e0 0x7fdbb414b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:07.454 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.443+0000 7fdbba105700 1 -- 172.21.15.158:0/2050216710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb40c23e0 msgr2=0x7fdbb414b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:07.454 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.443+0000 7fdbba105700 1 --2- 172.21.15.158:0/2050216710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb40c23e0 0x7fdbb414b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:07.454 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.443+0000 7fdbba105700 1 -- 172.21.15.158:0/2050216710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbb40c11f0 msgr2=0x7fdbb4152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:07.454 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.443+0000 7fdbba105700 1 --2- 172.21.15.158:0/2050216710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbb40c11f0 0x7fdbb4152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:07.455 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.443+0000 7fdbba105700 1 -- 172.21.15.158:0/2050216710 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac009ae0 con 0x7fdbb4065670 2023-10-18T17:24:07.455 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.447+0000 7fdbba105700 1 --2- 172.21.15.158:0/2050216710 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdbb4065670 0x7fdbb4152680 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fdbb0001eb0 tx=0x7fdbb0007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:07.455 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.447+0000 7fdbaa7fc700 1 -- 172.21.15.158:0/2050216710 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb00070d0 con 0x7fdbb4065670 2023-10-18T17:24:07.455 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.447+0000 7fdbaa7fc700 1 -- 172.21.15.158:0/2050216710 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb0007230 con 0x7fdbb4065670 2023-10-18T17:24:07.455 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.447+0000 7fdbbb107700 1 -- 172.21.15.158:0/2050216710 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb4153060 con 0x7fdbb4065670 2023-10-18T17:24:07.455 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.447+0000 7fdbaa7fc700 1 -- 172.21.15.158:0/2050216710 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb00075b0 con 0x7fdbb4065670 2023-10-18T17:24:07.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.447+0000 7fdbbb107700 1 -- 172.21.15.158:0/2050216710 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb40bf550 con 0x7fdbb4065670 2023-10-18T17:24:07.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.447+0000 7fdbbb107700 1 -- 172.21.15.158:0/2050216710 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb4046f00 con 0x7fdbb4065670 2023-10-18T17:24:07.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.447+0000 7fdbaa7fc700 1 -- 172.21.15.158:0/2050216710 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdbb00058f0 con 0x7fdbb4065670 2023-10-18T17:24:07.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.451+0000 7fdbaa7fc700 1 --2- 172.21.15.158:0/2050216710 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fdb9805a4e0 0x7fdb9805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:07.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.451+0000 7fdbaa7fc700 1 -- 172.21.15.158:0/2050216710 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdbb0073d40 con 0x7fdbb4065670 2023-10-18T17:24:07.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.451+0000 7fdbb9904700 1 --2- 172.21.15.158:0/2050216710 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fdb9805a4e0 0x7fdb9805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:07.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.451+0000 7fdbb9904700 1 --2- 172.21.15.158:0/2050216710 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fdb9805a4e0 0x7fdb9805c9a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fdbb40c6440 tx=0x7fdba4008040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:07.462 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.455+0000 7fdbaa7fc700 1 -- 172.21.15.158:0/2050216710 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fdbb0047520 con 0x7fdbb4065670 2023-10-18T17:24:07.658 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:07.651+0000 7fdbbb107700 1 -- 172.21.15.158:0/2050216710 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdbb4150830 con 0x7fdbb4065670 2023-10-18T17:24:08.246 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.239+0000 7fdbaa7fc700 1 -- 172.21.15.158:0/2050216710 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdbb004ab40 con 0x7fdbb4065670 2023-10-18T17:24:08.250 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.243+0000 7fdbbb107700 1 -- 172.21.15.158:0/2050216710 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fdb9805a4e0 msgr2=0x7fdb9805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:08.250 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.243+0000 7fdbbb107700 1 --2- 172.21.15.158:0/2050216710 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fdb9805a4e0 0x7fdb9805c9a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fdbb40c6440 tx=0x7fdba4008040).stop 2023-10-18T17:24:08.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.243+0000 7fdbbb107700 1 -- 172.21.15.158:0/2050216710 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdbb4065670 msgr2=0x7fdbb4152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:08.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.243+0000 7fdbbb107700 1 --2- 172.21.15.158:0/2050216710 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdbb4065670 0x7fdbb4152680 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fdbb0001eb0 tx=0x7fdbb0007df0).stop 2023-10-18T17:24:08.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.243+0000 7fdbbb107700 1 -- 172.21.15.158:0/2050216710 shutdown_connections 2023-10-18T17:24:08.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.243+0000 7fdbbb107700 1 --2- 172.21.15.158:0/2050216710 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fdb9805a4e0 0x7fdb9805c9a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:08.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.243+0000 7fdbbb107700 1 --2- 172.21.15.158:0/2050216710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb40c23e0 0x7fdbb414b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:08.252 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.243+0000 7fdbbb107700 1 --2- 172.21.15.158:0/2050216710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbb40c11f0 0x7fdbb4152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:08.252 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.243+0000 7fdbbb107700 1 --2- 172.21.15.158:0/2050216710 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdbb4065670 0x7fdbb4152680 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:08.252 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.243+0000 7fdbbb107700 1 -- 172.21.15.158:0/2050216710 >> 172.21.15.158:0/2050216710 conn(0x7fdbb40620d0 msgr2=0x7fdbb414c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:08.252 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.243+0000 7fdbbb107700 1 -- 172.21.15.158:0/2050216710 shutdown_connections 2023-10-18T17:24:08.252 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.243+0000 7fdbbb107700 1 -- 172.21.15.158:0/2050216710 wait complete. 2023-10-18T17:24:08.271 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-10-18T17:24:08.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.423+0000 7f6110f69700 1 Processor -- start 2023-10-18T17:24:08.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.427+0000 7f6110f69700 1 -- start start 2023-10-18T17:24:08.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.427+0000 7f6110f69700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f610c065ce0 0x7f610c0660c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:08.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.427+0000 7f6110f69700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f610c0b9550 0x7f610c0b99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:08.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.427+0000 7f6110f69700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610c0bcd70 con 0x7f610c1515a0 2023-10-18T17:24:08.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.427+0000 7f6110f69700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f610c0bb810 con 0x7f610c065ce0 2023-10-18T17:24:08.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.427+0000 7f6110f69700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0bbab0 con 0x7f610c0b9550 2023-10-18T17:24:08.436 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.427+0000 7f610ad9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f610c0b9550 0x7f610c0b99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:08.436 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.427+0000 7f610a59c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f610c065ce0 0x7f610c0660c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:08.436 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.427+0000 7f610ad9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f610c0b9550 0x7f610c0b99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:38136/0 (socket says 172.21.15.158:38136) 2023-10-18T17:24:08.436 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.427+0000 7f610ad9d700 1 -- 172.21.15.158:0/1812753461 learned_addr learned my addr 172.21.15.158:0/1812753461 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:08.437 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.427+0000 7f610a59c700 1 -- 172.21.15.158:0/1812753461 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f610c0b9550 msgr2=0x7f610c0b99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:08.437 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.427+0000 7f610a59c700 1 --2- 172.21.15.158:0/1812753461 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f610c0b9550 0x7f610c0b99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:08.437 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.427+0000 7f610a59c700 1 -- 172.21.15.158:0/1812753461 >> v1:172.21.15.158:6789/0 conn(0x7f610c1515a0 legacy=0x7f610c1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:08.437 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.427+0000 7f610a59c700 1 -- 172.21.15.158:0/1812753461 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c0bbd50 con 0x7f610c065ce0 2023-10-18T17:24:08.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.427+0000 7f610ad9d700 1 --2- 172.21.15.158:0/1812753461 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f610c0b9550 0x7f610c0b99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:08.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.431+0000 7f610a59c700 1 --2- 172.21.15.158:0/1812753461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f610c065ce0 0x7f610c0660c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f60fc009760 tx=0x7f60fc009060).ready entity=mon.1 client_cookie=e6c5897e4a78f745 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:08.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.431+0000 7f610959a700 1 -- 172.21.15.158:0/1812753461 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc00f510 con 0x7f610c065ce0 2023-10-18T17:24:08.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.431+0000 7f610959a700 1 -- 172.21.15.158:0/1812753461 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60fc00f670 con 0x7f610c065ce0 2023-10-18T17:24:08.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.431+0000 7f610959a700 1 -- 172.21.15.158:0/1812753461 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc00f9f0 con 0x7f610c065ce0 2023-10-18T17:24:08.440 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.431+0000 7f6110f69700 1 -- 172.21.15.158:0/1812753461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f610c065ce0 msgr2=0x7f610c0660c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:08.440 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.431+0000 7f6110f69700 1 --2- 172.21.15.158:0/1812753461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f610c065ce0 0x7f610c0660c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f60fc009760 tx=0x7f60fc009060).stop 2023-10-18T17:24:08.440 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.431+0000 7f6110f69700 1 -- 172.21.15.158:0/1812753461 shutdown_connections 2023-10-18T17:24:08.440 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.431+0000 7f6110f69700 1 --2- 172.21.15.158:0/1812753461 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f610c0b9550 0x7f610c0b99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:08.440 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.431+0000 7f6110f69700 1 --2- 172.21.15.158:0/1812753461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f610c065ce0 0x7f610c0660c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:08.441 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.431+0000 7f6110f69700 1 -- 172.21.15.158:0/1812753461 >> 172.21.15.158:0/1812753461 conn(0x7f610c0650d0 msgr2=0x7f610c05dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:08.441 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.431+0000 7f6110f69700 1 -- 172.21.15.158:0/1812753461 shutdown_connections 2023-10-18T17:24:08.441 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.431+0000 7f6110f69700 1 -- 172.21.15.158:0/1812753461 wait complete. 2023-10-18T17:24:08.441 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.435+0000 7f6110f69700 1 Processor -- start 2023-10-18T17:24:08.442 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.435+0000 7f6110f69700 1 -- start start 2023-10-18T17:24:08.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.435+0000 7f6110f69700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f610c065ce0 0x7f610c1459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:08.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.435+0000 7f6110f69700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f610c0b9550 0x7f610c1559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:08.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.435+0000 7f6110f69700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f610c1515a0 0x7f610c160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:08.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.435+0000 7f6110f69700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c146eb0 con 0x7f610c065ce0 2023-10-18T17:24:08.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.435+0000 7f6110f69700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c160090 con 0x7f610c0b9550 2023-10-18T17:24:08.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.435+0000 7f6110f69700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c156410 con 0x7f610c1515a0 2023-10-18T17:24:08.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.435+0000 7f610a59c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f610c065ce0 0x7f610c1459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:08.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.435+0000 7f610a59c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f610c065ce0 0x7f610c1459b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56612/0 (socket says 172.21.15.158:56612) 2023-10-18T17:24:08.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.435+0000 7f610a59c700 1 -- 172.21.15.158:0/292481714 learned_addr learned my addr 172.21.15.158:0/292481714 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:08.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.435+0000 7f610ad9d700 1 --2- 172.21.15.158:0/292481714 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f610c1515a0 0x7f610c160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:08.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.435+0000 7f6109d9b700 1 --2- 172.21.15.158:0/292481714 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f610c0b9550 0x7f610c1559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:08.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.435+0000 7f610a59c700 1 -- 172.21.15.158:0/292481714 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f610c1515a0 msgr2=0x7f610c160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:08.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.435+0000 7f610a59c700 1 --2- 172.21.15.158:0/292481714 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f610c1515a0 0x7f610c160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:08.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.435+0000 7f610a59c700 1 -- 172.21.15.158:0/292481714 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f610c0b9550 msgr2=0x7f610c1559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:08.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.435+0000 7f610a59c700 1 --2- 172.21.15.158:0/292481714 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f610c0b9550 0x7f610c1559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:08.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.435+0000 7f610a59c700 1 -- 172.21.15.158:0/292481714 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6104009ae0 con 0x7f610c065ce0 2023-10-18T17:24:08.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.439+0000 7f610a59c700 1 --2- 172.21.15.158:0/292481714 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f610c065ce0 0x7f610c1459b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f60fc009e00 tx=0x7f60fc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:08.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.439+0000 7f60fa7fc700 1 -- 172.21.15.158:0/292481714 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc00f510 con 0x7f610c065ce0 2023-10-18T17:24:08.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.439+0000 7f60fa7fc700 1 -- 172.21.15.158:0/292481714 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60fc00f7e0 con 0x7f610c065ce0 2023-10-18T17:24:08.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.439+0000 7f60fa7fc700 1 -- 172.21.15.158:0/292481714 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc01b440 con 0x7f610c065ce0 2023-10-18T17:24:08.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.439+0000 7f6110f69700 1 -- 172.21.15.158:0/292481714 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60fc0092a0 con 0x7f610c065ce0 2023-10-18T17:24:08.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.439+0000 7f6110f69700 1 -- 172.21.15.158:0/292481714 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610c146610 con 0x7f610c065ce0 2023-10-18T17:24:08.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.439+0000 7f6110f69700 1 -- 172.21.15.158:0/292481714 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610c06c190 con 0x7f610c065ce0 2023-10-18T17:24:08.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.439+0000 7f60fa7fc700 1 -- 172.21.15.158:0/292481714 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f60fc01b830 con 0x7f610c065ce0 2023-10-18T17:24:08.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.443+0000 7f60fa7fc700 1 --2- 172.21.15.158:0/292481714 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f60ec05a510 0x7f60ec05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:08.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.443+0000 7f60fa7fc700 1 -- 172.21.15.158:0/292481714 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f60fc075d50 con 0x7f610c065ce0 2023-10-18T17:24:08.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.443+0000 7f6109d9b700 1 --2- 172.21.15.158:0/292481714 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f60ec05a510 0x7f60ec05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:08.451 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.443+0000 7f6109d9b700 1 --2- 172.21.15.158:0/292481714 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f60ec05a510 0x7f60ec05c9d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f610c14e9e0 tx=0x7f6100009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:08.454 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.447+0000 7f60fa7fc700 1 -- 172.21.15.158:0/292481714 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f60fc049470 con 0x7f610c065ce0 2023-10-18T17:24:08.647 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:08.639+0000 7f6110f69700 1 -- 172.21.15.158:0/292481714 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f610c0bbff0 con 0x7f610c065ce0 2023-10-18T17:24:09.257 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.251+0000 7f60fa7fc700 1 -- 172.21.15.158:0/292481714 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v8) v1 ==== 115+0+0 (secure 0 0 0) 0x7f60fc04ca90 con 0x7f610c065ce0 2023-10-18T17:24:09.262 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.255+0000 7f6110f69700 1 -- 172.21.15.158:0/292481714 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f60ec05a510 msgr2=0x7f60ec05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:09.263 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.255+0000 7f6110f69700 1 --2- 172.21.15.158:0/292481714 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f60ec05a510 0x7f60ec05c9d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f610c14e9e0 tx=0x7f6100009040).stop 2023-10-18T17:24:09.263 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.255+0000 7f6110f69700 1 -- 172.21.15.158:0/292481714 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f610c065ce0 msgr2=0x7f610c1459b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:09.263 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.255+0000 7f6110f69700 1 --2- 172.21.15.158:0/292481714 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f610c065ce0 0x7f610c1459b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f60fc009e00 tx=0x7f60fc017000).stop 2023-10-18T17:24:09.263 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.255+0000 7f6110f69700 1 -- 172.21.15.158:0/292481714 shutdown_connections 2023-10-18T17:24:09.263 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.255+0000 7f6110f69700 1 --2- 172.21.15.158:0/292481714 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f60ec05a510 0x7f60ec05c9d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:09.264 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.255+0000 7f6110f69700 1 --2- 172.21.15.158:0/292481714 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f610c1515a0 0x7f610c160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:09.264 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.255+0000 7f6110f69700 1 --2- 172.21.15.158:0/292481714 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f610c0b9550 0x7f610c1559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:09.264 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.255+0000 7f6110f69700 1 --2- 172.21.15.158:0/292481714 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f610c065ce0 0x7f610c1459b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:09.264 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.255+0000 7f6110f69700 1 -- 172.21.15.158:0/292481714 >> 172.21.15.158:0/292481714 conn(0x7f610c0650d0 msgr2=0x7f610c14a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:09.264 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.255+0000 7f6110f69700 1 -- 172.21.15.158:0/292481714 shutdown_connections 2023-10-18T17:24:09.265 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.255+0000 7f6110f69700 1 -- 172.21.15.158:0/292481714 wait complete. 2023-10-18T17:24:09.284 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-18T17:24:09.285 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T17:24:09.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.443+0000 7f234ffff700 1 Processor -- start 2023-10-18T17:24:09.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.443+0000 7f234ffff700 1 -- start start 2023-10-18T17:24:09.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234ffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2350066340 0x7f2350062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:09.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234ffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f235014d020 0x7f235014d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:09.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234ffff700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23500c1610 con 0x7f2350062270 2023-10-18T17:24:09.454 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234ffff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235014d9c0 con 0x7f2350066340 2023-10-18T17:24:09.454 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234ffff700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23500c2dd0 con 0x7f235014d020 2023-10-18T17:24:09.454 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234effd700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f2350062270 0x7f23500c0f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:38570/0 (socket says 172.21.15.158:38570) 2023-10-18T17:24:09.454 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234effd700 1 -- 172.21.15.158:0/2762857030 learned_addr learned my addr 172.21.15.158:0/2762857030 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:09.454 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234e7fc700 1 --2- 172.21.15.158:0/2762857030 >> v2:172.21.15.158:3300/0 conn(0x7f2350066340 0x7f2350062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:09.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234f7fe700 1 --2- 172.21.15.158:0/2762857030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f235014d020 0x7f235014d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:09.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234dffb700 1 -- 172.21.15.158:0/2762857030 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602213510 0 0) 0x7f23500c1610 con 0x7f2350062270 2023-10-18T17:24:09.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234dffb700 1 -- 172.21.15.158:0/2762857030 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23380033f0 con 0x7f2350062270 2023-10-18T17:24:09.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234dffb700 1 -- 172.21.15.158:0/2762857030 <== mon.0 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 975243700 0 0) 0x7f23380033f0 con 0x7f2350062270 2023-10-18T17:24:09.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234dffb700 1 -- 172.21.15.158:0/2762857030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f235014d020 msgr2=0x7f235014d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:09.459 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234dffb700 1 --2- 172.21.15.158:0/2762857030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f235014d020 0x7f235014d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:09.459 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234dffb700 1 -- 172.21.15.158:0/2762857030 >> v2:172.21.15.158:3300/0 conn(0x7f2350066340 msgr2=0x7f2350062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:09.459 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234dffb700 1 --2- 172.21.15.158:0/2762857030 >> v2:172.21.15.158:3300/0 conn(0x7f2350066340 0x7f2350062650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:09.459 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234dffb700 1 -- 172.21.15.158:0/2762857030 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2350153570 con 0x7f2350062270 2023-10-18T17:24:09.459 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234dffb700 1 -- 172.21.15.158:0/2762857030 <== mon.0 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2074596555 0 0) 0x7f2340001470 con 0x7f2350062270 2023-10-18T17:24:09.460 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234dffb700 1 -- 172.21.15.158:0/2762857030 >> v1:172.21.15.158:6789/0 conn(0x7f2350062270 legacy=0x7f23500c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:09.460 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234dffb700 1 --2- 172.21.15.158:0/2762857030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23380038e0 0x7f2338003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:09.460 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234dffb700 1 --2- 172.21.15.158:0/2762857030 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2338004690 0x7f2338004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:09.460 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234dffb700 1 --2- 172.21.15.158:0/2762857030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f235014d020 0x7f2338005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:09.460 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234dffb700 1 -- 172.21.15.158:0/2762857030 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235014d9c0 con 0x7f2338004690 2023-10-18T17:24:09.461 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234dffb700 1 -- 172.21.15.158:0/2762857030 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23500c2dd0 con 0x7f23380038e0 2023-10-18T17:24:09.461 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234dffb700 1 -- 172.21.15.158:0/2762857030 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233800b8e0 con 0x7f235014d020 2023-10-18T17:24:09.461 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234e7fc700 1 --2- 172.21.15.158:0/2762857030 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2338004690 0x7f2338004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:09.461 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234effd700 1 --2- 172.21.15.158:0/2762857030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23380038e0 0x7f2338003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:09.461 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234f7fe700 1 --2- 172.21.15.158:0/2762857030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f235014d020 0x7f2338005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:09.462 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234e7fc700 1 -- 172.21.15.158:0/2762857030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f235014d020 msgr2=0x7f2338005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:09.462 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234e7fc700 1 --2- 172.21.15.158:0/2762857030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f235014d020 0x7f2338005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:09.462 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234e7fc700 1 -- 172.21.15.158:0/2762857030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23380038e0 msgr2=0x7f2338003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:09.462 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234e7fc700 1 --2- 172.21.15.158:0/2762857030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23380038e0 0x7f2338003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:09.463 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234e7fc700 1 -- 172.21.15.158:0/2762857030 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23380033f0 con 0x7f2338004690 2023-10-18T17:24:09.463 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.447+0000 7f234effd700 1 --2- 172.21.15.158:0/2762857030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23380038e0 0x7f2338003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:24:09.463 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.451+0000 7f234e7fc700 1 --2- 172.21.15.158:0/2762857030 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2338004690 0x7f2338004b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f2350062b40 tx=0x7f2344009060).ready entity=mon.0 client_cookie=c59090a795d2e20f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:09.463 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.451+0000 7f234dffb700 1 -- 172.21.15.158:0/2762857030 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2344009e90 con 0x7f2338004690 2023-10-18T17:24:09.463 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.451+0000 7f234dffb700 1 -- 172.21.15.158:0/2762857030 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2344009430 con 0x7f2338004690 2023-10-18T17:24:09.464 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.451+0000 7f234dffb700 1 -- 172.21.15.158:0/2762857030 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234400e850 con 0x7f2338004690 2023-10-18T17:24:09.464 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.451+0000 7f234ffff700 1 -- 172.21.15.158:0/2762857030 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2338004690 msgr2=0x7f2338004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:09.464 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.451+0000 7f234ffff700 1 --2- 172.21.15.158:0/2762857030 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2338004690 0x7f2338004b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f2350062b40 tx=0x7f2344009060).stop 2023-10-18T17:24:09.464 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.451+0000 7f234f7fe700 1 -- 172.21.15.158:0/2762857030 reap_dead start 2023-10-18T17:24:09.465 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.451+0000 7f234ffff700 1 -- 172.21.15.158:0/2762857030 shutdown_connections 2023-10-18T17:24:09.465 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.451+0000 7f234ffff700 1 -- 172.21.15.158:0/2762857030 >> 172.21.15.158:0/2762857030 conn(0x7f235005ddc0 msgr2=0x7f235005e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:09.465 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.451+0000 7f234ffff700 1 -- 172.21.15.158:0/2762857030 shutdown_connections 2023-10-18T17:24:09.465 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.451+0000 7f234ffff700 1 -- 172.21.15.158:0/2762857030 wait complete. 2023-10-18T17:24:09.468 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.455+0000 7f234ffff700 1 Processor -- start 2023-10-18T17:24:09.468 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.455+0000 7f234ffff700 1 -- start start 2023-10-18T17:24:09.468 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.455+0000 7f234ffff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2338004690 0x7f23500bbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:09.468 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.455+0000 7f234ffff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23500626c0 0x7f23500bc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:09.469 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.455+0000 7f234ffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2350164bd0 0x7f2350146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:09.469 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.455+0000 7f234ffff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2350165100 con 0x7f23500626c0 2023-10-18T17:24:09.469 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.455+0000 7f234ffff700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23500be7b0 con 0x7f2338004690 2023-10-18T17:24:09.469 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.455+0000 7f234ffff700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23500bdbe0 con 0x7f2350164bd0 2023-10-18T17:24:09.470 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.455+0000 7f234e7fc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23500626c0 0x7f23500bc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:09.470 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.455+0000 7f234f7fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2350164bd0 0x7f2350146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:09.470 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.455+0000 7f234effd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2338004690 0x7f23500bbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:09.470 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.455+0000 7f234e7fc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23500626c0 0x7f23500bc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56002/0 (socket says 172.21.15.158:56002) 2023-10-18T17:24:09.470 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.455+0000 7f234f7fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2350164bd0 0x7f2350146ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:60866/0 (socket says 172.21.15.158:60866) 2023-10-18T17:24:09.471 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.455+0000 7f234e7fc700 1 -- 172.21.15.158:0/3813736314 learned_addr learned my addr 172.21.15.158:0/3813736314 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:09.471 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.455+0000 7f234effd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2338004690 0x7f23500bbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:43578/0 (socket says 172.21.15.158:43578) 2023-10-18T17:24:09.471 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.459+0000 7f234e7fc700 1 -- 172.21.15.158:0/3813736314 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2350164bd0 msgr2=0x7f2350146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:09.471 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.459+0000 7f234e7fc700 1 --2- 172.21.15.158:0/3813736314 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2350164bd0 0x7f2350146ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:09.472 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.459+0000 7f234e7fc700 1 -- 172.21.15.158:0/3813736314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2338004690 msgr2=0x7f23500bbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:09.472 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.459+0000 7f234e7fc700 1 --2- 172.21.15.158:0/3813736314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2338004690 0x7f23500bbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:09.472 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.459+0000 7f234e7fc700 1 -- 172.21.15.158:0/3813736314 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23500c56e0 con 0x7f23500626c0 2023-10-18T17:24:09.472 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.459+0000 7f234e7fc700 1 --2- 172.21.15.158:0/3813736314 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23500626c0 0x7f23500bc000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f234400e4b0 tx=0x7f234401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:09.472 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.459+0000 7f2336ffd700 1 -- 172.21.15.158:0/3813736314 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234401d7a0 con 0x7f23500626c0 2023-10-18T17:24:09.473 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.459+0000 7f2336ffd700 1 -- 172.21.15.158:0/3813736314 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234401d900 con 0x7f23500626c0 2023-10-18T17:24:09.473 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.459+0000 7f2336ffd700 1 -- 172.21.15.158:0/3813736314 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234401dcc0 con 0x7f23500626c0 2023-10-18T17:24:09.473 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.459+0000 7f234ffff700 1 -- 172.21.15.158:0/3813736314 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23500bde80 con 0x7f23500626c0 2023-10-18T17:24:09.473 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.459+0000 7f234ffff700 1 -- 172.21.15.158:0/3813736314 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23500be440 con 0x7f23500626c0 2023-10-18T17:24:09.473 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.459+0000 7f234ffff700 1 -- 172.21.15.158:0/3813736314 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2350046f00 con 0x7f23500626c0 2023-10-18T17:24:09.474 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.463+0000 7f2336ffd700 1 -- 172.21.15.158:0/3813736314 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f234402f440 con 0x7f23500626c0 2023-10-18T17:24:09.474 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.463+0000 7f2336ffd700 1 --2- 172.21.15.158:0/3813736314 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f233c05a540 0x7f233c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:09.475 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.463+0000 7f2336ffd700 1 -- 172.21.15.158:0/3813736314 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f23440763c0 con 0x7f23500626c0 2023-10-18T17:24:09.475 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.463+0000 7f234effd700 1 --2- 172.21.15.158:0/3813736314 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f233c05a540 0x7f233c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:09.475 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.463+0000 7f234effd700 1 --2- 172.21.15.158:0/3813736314 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f233c05a540 0x7f233c05ca00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2340000c00 tx=0x7f2340007040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:09.475 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.467+0000 7f2336ffd700 1 -- 172.21.15.158:0/3813736314 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f2344049ac0 con 0x7f23500626c0 2023-10-18T17:24:09.672 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.667+0000 7f234ffff700 1 -- 172.21.15.158:0/3813736314 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2350153850 con 0x7f23500626c0 2023-10-18T17:24:09.674 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.667+0000 7f2336ffd700 1 -- 172.21.15.158:0/3813736314 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6016 (secure 0 0 0) 0x7f2344016020 con 0x7f23500626c0 2023-10-18T17:24:09.674 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:09.674 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/4166106461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":4166106461},{"type":"v1","addr":"172.21.15.183:6837","nonce":4166106461}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/3015150621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":3015150621},{"type":"v1","addr":"172.21.15.183:6839","nonce":3015150621}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6836/2119572558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2119572558},{"type":"v1","addr":"172.21.15.158:6836","nonce":2119572558}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/3920532651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6835","nonce":3920532651},{"type":"v1","addr":"172.21.15.158:6837","nonce":3920532651}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3431053572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":3431053572},{"type":"v1","addr":"172.21.15.183:6835","nonce":3431053572}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T17:24:04.215086+0000","modified":"2023-10-18T17:24:09.250188+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"c","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.158:6833/3622415010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":3622415010},{"type":"v1","addr":"172.21.15.158:6833","nonce":3622415010}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T17:24:09.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.671+0000 7f234ffff700 1 -- 172.21.15.158:0/3813736314 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f233c05a540 msgr2=0x7f233c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:09.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.671+0000 7f234ffff700 1 --2- 172.21.15.158:0/3813736314 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f233c05a540 0x7f233c05ca00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2340000c00 tx=0x7f2340007040).stop 2023-10-18T17:24:09.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.671+0000 7f234ffff700 1 -- 172.21.15.158:0/3813736314 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23500626c0 msgr2=0x7f23500bc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:09.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.671+0000 7f234ffff700 1 --2- 172.21.15.158:0/3813736314 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23500626c0 0x7f23500bc000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f234400e4b0 tx=0x7f234401a000).stop 2023-10-18T17:24:09.678 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.671+0000 7f234ffff700 1 -- 172.21.15.158:0/3813736314 shutdown_connections 2023-10-18T17:24:09.678 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.671+0000 7f234ffff700 1 --2- 172.21.15.158:0/3813736314 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f233c05a540 0x7f233c05ca00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:09.678 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.671+0000 7f234ffff700 1 --2- 172.21.15.158:0/3813736314 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2350164bd0 0x7f2350146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:09.678 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.671+0000 7f234ffff700 1 --2- 172.21.15.158:0/3813736314 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23500626c0 0x7f23500bc000 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:09.679 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.671+0000 7f234ffff700 1 --2- 172.21.15.158:0/3813736314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2338004690 0x7f23500bbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:09.679 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.671+0000 7f234ffff700 1 -- 172.21.15.158:0/3813736314 >> 172.21.15.158:0/3813736314 conn(0x7f235005ddc0 msgr2=0x7f23500c4460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:09.679 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.671+0000 7f234ffff700 1 -- 172.21.15.158:0/3813736314 shutdown_connections 2023-10-18T17:24:09.679 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.671+0000 7f234ffff700 1 -- 172.21.15.158:0/3813736314 wait complete. 2023-10-18T17:24:09.680 INFO:teuthology.orchestra.run.smithi158.stderr:dumped fsmap epoch 8 2023-10-18T17:24:09.699 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T17:24:09.863 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.855+0000 7f3a47a1b700 1 Processor -- start 2023-10-18T17:24:09.864 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.855+0000 7f3a47a1b700 1 -- start start 2023-10-18T17:24:09.866 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.859+0000 7f3a47a1b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3a400691c0 0x7f3a400695a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:09.866 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.859+0000 7f3a47a1b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3a40067070 0x7f3a400b6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:09.866 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.859+0000 7f3a47a1b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a400679d0 con 0x7f3a400674e0 2023-10-18T17:24:09.867 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.859+0000 7f3a47a1b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a400c39d0 con 0x7f3a40067070 2023-10-18T17:24:09.867 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.859+0000 7f3a47a1b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a400c3660 con 0x7f3a400691c0 2023-10-18T17:24:09.868 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.859+0000 7f3a45fb8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3a40067070 0x7f3a400b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:09.868 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.859+0000 7f3a457b7700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3a400691c0 0x7f3a400695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:09.868 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.859+0000 7f3a44fb6700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f3a400674e0 0x7f3a4014fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:38572/0 (socket says 172.21.15.158:38572) 2023-10-18T17:24:09.869 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.859+0000 7f3a44fb6700 1 -- 172.21.15.158:0/549834718 learned_addr learned my addr 172.21.15.158:0/549834718 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:09.869 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.859+0000 7f3a457b7700 1 -- 172.21.15.158:0/549834718 >> v2:172.21.15.158:3300/0 conn(0x7f3a40067070 msgr2=0x7f3a400b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:09.869 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.859+0000 7f3a457b7700 1 --2- 172.21.15.158:0/549834718 >> v2:172.21.15.158:3300/0 conn(0x7f3a40067070 0x7f3a400b6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:09.869 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.859+0000 7f3a457b7700 1 -- 172.21.15.158:0/549834718 >> v1:172.21.15.158:6789/0 conn(0x7f3a400674e0 legacy=0x7f3a4014fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:09.869 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.859+0000 7f3a457b7700 1 -- 172.21.15.158:0/549834718 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a40150320 con 0x7f3a400691c0 2023-10-18T17:24:09.870 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.863+0000 7f3a457b7700 1 --2- 172.21.15.158:0/549834718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a400691c0 0x7f3a400695a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f3a40065f40 tx=0x7f3a3c009060).ready entity=mon.1 client_cookie=c13b40a82d39ff42 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:09.870 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.863+0000 7f3a37fff700 1 -- 172.21.15.158:0/549834718 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c00f510 con 0x7f3a400691c0 2023-10-18T17:24:09.870 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.863+0000 7f3a37fff700 1 -- 172.21.15.158:0/549834718 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c00f670 con 0x7f3a400691c0 2023-10-18T17:24:09.870 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.863+0000 7f3a37fff700 1 -- 172.21.15.158:0/549834718 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c00f9f0 con 0x7f3a400691c0 2023-10-18T17:24:09.871 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.863+0000 7f3a47a1b700 1 -- 172.21.15.158:0/549834718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a400691c0 msgr2=0x7f3a400695a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:09.871 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.863+0000 7f3a47a1b700 1 --2- 172.21.15.158:0/549834718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a400691c0 0x7f3a400695a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f3a40065f40 tx=0x7f3a3c009060).stop 2023-10-18T17:24:09.872 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.863+0000 7f3a47a1b700 1 -- 172.21.15.158:0/549834718 shutdown_connections 2023-10-18T17:24:09.872 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.863+0000 7f3a47a1b700 1 --2- 172.21.15.158:0/549834718 >> v2:172.21.15.158:3300/0 conn(0x7f3a40067070 0x7f3a400b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:09.872 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.863+0000 7f3a47a1b700 1 --2- 172.21.15.158:0/549834718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a400691c0 0x7f3a400695a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:09.872 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.863+0000 7f3a47a1b700 1 -- 172.21.15.158:0/549834718 >> 172.21.15.158:0/549834718 conn(0x7f3a40065130 msgr2=0x7f3a400631e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:09.872 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.863+0000 7f3a47a1b700 1 -- 172.21.15.158:0/549834718 shutdown_connections 2023-10-18T17:24:09.872 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.863+0000 7f3a47a1b700 1 -- 172.21.15.158:0/549834718 wait complete. 2023-10-18T17:24:09.873 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.867+0000 7f3a47a1b700 1 Processor -- start 2023-10-18T17:24:09.873 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.867+0000 7f3a47a1b700 1 -- start start 2023-10-18T17:24:09.874 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.867+0000 7f3a47a1b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a40067070 0x7f3a40160200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:09.874 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.867+0000 7f3a47a1b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a400674e0 0x7f3a40163770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:09.875 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.867+0000 7f3a47a1b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a400691c0 0x7f3a400c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:09.875 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.867+0000 7f3a47a1b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a40146850 con 0x7f3a400691c0 2023-10-18T17:24:09.875 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.867+0000 7f3a47a1b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a40163fb0 con 0x7f3a400674e0 2023-10-18T17:24:09.875 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.867+0000 7f3a47a1b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a40164290 con 0x7f3a40067070 2023-10-18T17:24:09.875 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.867+0000 7f3a45fb8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a400691c0 0x7f3a400c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:09.876 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.867+0000 7f3a457b7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a40067070 0x7f3a40160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:09.876 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.867+0000 7f3a457b7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a40067070 0x7f3a40160200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:60868/0 (socket says 172.21.15.158:60868) 2023-10-18T17:24:09.876 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.867+0000 7f3a457b7700 1 -- 172.21.15.158:0/1534963991 learned_addr learned my addr 172.21.15.158:0/1534963991 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:09.876 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.867+0000 7f3a44fb6700 1 --2- 172.21.15.158:0/1534963991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a400674e0 0x7f3a40163770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:09.877 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.867+0000 7f3a45fb8700 1 -- 172.21.15.158:0/1534963991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a40067070 msgr2=0x7f3a40160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:09.877 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.867+0000 7f3a45fb8700 1 --2- 172.21.15.158:0/1534963991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a40067070 0x7f3a40160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:09.877 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.867+0000 7f3a45fb8700 1 -- 172.21.15.158:0/1534963991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a400674e0 msgr2=0x7f3a40163770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:09.878 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.867+0000 7f3a45fb8700 1 --2- 172.21.15.158:0/1534963991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a400674e0 0x7f3a40163770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:09.878 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.867+0000 7f3a45fb8700 1 -- 172.21.15.158:0/1534963991 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3c0092a0 con 0x7f3a400691c0 2023-10-18T17:24:09.878 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.867+0000 7f3a45fb8700 1 --2- 172.21.15.158:0/1534963991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a400691c0 0x7f3a400c2800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f3a3800ec90 tx=0x7f3a3800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:09.878 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.871+0000 7f3a357fa700 1 -- 172.21.15.158:0/1534963991 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3800c920 con 0x7f3a400691c0 2023-10-18T17:24:09.878 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.871+0000 7f3a357fa700 1 -- 172.21.15.158:0/1534963991 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3800f040 con 0x7f3a400691c0 2023-10-18T17:24:09.879 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.871+0000 7f3a47a1b700 1 -- 172.21.15.158:0/1534963991 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a40164570 con 0x7f3a400691c0 2023-10-18T17:24:09.879 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.871+0000 7f3a357fa700 1 -- 172.21.15.158:0/1534963991 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3800cc90 con 0x7f3a400691c0 2023-10-18T17:24:09.879 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.871+0000 7f3a47a1b700 1 -- 172.21.15.158:0/1534963991 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a40151810 con 0x7f3a400691c0 2023-10-18T17:24:09.880 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.871+0000 7f3a47a1b700 1 -- 172.21.15.158:0/1534963991 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4006c190 con 0x7f3a400691c0 2023-10-18T17:24:09.880 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.871+0000 7f3a357fa700 1 -- 172.21.15.158:0/1534963991 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3a3801d460 con 0x7f3a400691c0 2023-10-18T17:24:09.880 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.875+0000 7f3a357fa700 1 --2- 172.21.15.158:0/1534963991 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f3a2405a510 0x7f3a2405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:09.881 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.875+0000 7f3a357fa700 1 -- 172.21.15.158:0/1534963991 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3a38074e90 con 0x7f3a400691c0 2023-10-18T17:24:09.881 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.875+0000 7f3a457b7700 1 --2- 172.21.15.158:0/1534963991 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f3a2405a510 0x7f3a2405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:09.881 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.875+0000 7f3a457b7700 1 --2- 172.21.15.158:0/1534963991 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f3a2405a510 0x7f3a2405c9d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f3a40150d10 tx=0x7f3a3c017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:09.887 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:09.879+0000 7f3a357fa700 1 -- 172.21.15.158:0/1534963991 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f3a38048610 con 0x7f3a400691c0 2023-10-18T17:24:10.052 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.047+0000 7f3a47a1b700 1 -- 172.21.15.158:0/1534963991 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a40063cc0 con 0x7f3a400691c0 2023-10-18T17:24:10.054 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.047+0000 7f3a357fa700 1 -- 172.21.15.158:0/1534963991 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f3a3804bc30 con 0x7f3a400691c0 2023-10-18T17:24:10.055 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:10.055 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":22,"fsid":"ca4bb219-38c8-4c5b-a49c-213b123db018","created":"2023-10-18T17:23:45.550173+0000","modified":"2023-10-18T17:24:05.219394+0000","last_up_change":"2023-10-18T17:23:55.617219+0000","last_in_change":"2023-10-18T17:23:47.727646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-18T17:23:54.686216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T17:23:56.743672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T17:24:02.200531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T17:24:03.168929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f621b1e-5ea4-4dc3-80e1-c415c7cc97d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6815","nonce":33195},{"type":"v1","addr":"172.21.15.158:6817","nonce":33195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":33195},{"type":"v1","addr":"172.21.15.158:6819","nonce":33195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":33195},{"type":"v1","addr":"172.21.15.158:6824","nonce":33195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":33195},{"type":"v1","addr":"172.21.15.158:6821","nonce":33195}]},"public_addr":"172.21.15.158:6817/33195","cluster_addr":"172.21.15.158:6819/33195","heartbeat_back_addr":"172.21.15.158:6824/33195","heartbeat_front_addr":"172.21.15.158:6821/33195","state":["exists","up"]},{"osd":1,"uuid":"769d7514-319f-4ac3-8cf3-6f88f4e7da2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6823","nonce":33196},{"type":"v1","addr":"172.21.15.158:6825","nonce":33196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":33196},{"type":"v1","addr":"172.21.15.158:6827","nonce":33196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":33196},{"type":"v1","addr":"172.21.15.158:6831","nonce":33196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":33196},{"type":"v1","addr":"172.21.15.158:6829","nonce":33196}]},"public_addr":"172.21.15.158:6825/33196","cluster_addr":"172.21.15.158:6827/33196","heartbeat_back_addr":"172.21.15.158:6831/33196","heartbeat_front_addr":"172.21.15.158:6829/33196","state":["exists","up"]},{"osd":2,"uuid":"b4459762-309d-454c-bd31-33b90192375f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":33193},{"type":"v1","addr":"172.21.15.158:6809","nonce":33193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":33193},{"type":"v1","addr":"172.21.15.158:6811","nonce":33193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":33193},{"type":"v1","addr":"172.21.15.158:6816","nonce":33193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":33193},{"type":"v1","addr":"172.21.15.158:6813","nonce":33193}]},"public_addr":"172.21.15.158:6809/33193","cluster_addr":"172.21.15.158:6811/33193","heartbeat_back_addr":"172.21.15.158:6816/33193","heartbeat_front_addr":"172.21.15.158:6813/33193","state":["exists","up"]},{"osd":3,"uuid":"7b78a411-1ae9-4051-ae9d-a03abc5a73ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":33194},{"type":"v1","addr":"172.21.15.158:6801","nonce":33194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":33194},{"type":"v1","addr":"172.21.15.158:6803","nonce":33194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":33194},{"type":"v1","addr":"172.21.15.158:6807","nonce":33194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":33194},{"type":"v1","addr":"172.21.15.158:6805","nonce":33194}]},"public_addr":"172.21.15.158:6801/33194","cluster_addr":"172.21.15.158:6803/33194","heartbeat_back_addr":"172.21.15.158:6807/33194","heartbeat_front_addr":"172.21.15.158:6805/33194","state":["exists","up"]},{"osd":4,"uuid":"58005b5f-2742-4ecb-8c3a-a2ae65c7fb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":33897},{"type":"v1","addr":"172.21.15.183:6801","nonce":33897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6803","nonce":33897},{"type":"v1","addr":"172.21.15.183:6805","nonce":33897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":33897},{"type":"v1","addr":"172.21.15.183:6812","nonce":33897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":33897},{"type":"v1","addr":"172.21.15.183:6808","nonce":33897}]},"public_addr":"172.21.15.183:6801/33897","cluster_addr":"172.21.15.183:6805/33897","heartbeat_back_addr":"172.21.15.183:6812/33897","heartbeat_front_addr":"172.21.15.183:6808/33897","state":["exists","up"]},{"osd":5,"uuid":"c0b217ed-1c09-4cde-b192-65624ab3a70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":33898},{"type":"v1","addr":"172.21.15.183:6804","nonce":33898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6807","nonce":33898},{"type":"v1","addr":"172.21.15.183:6809","nonce":33898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":33898},{"type":"v1","addr":"172.21.15.183:6815","nonce":33898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6811","nonce":33898},{"type":"v1","addr":"172.21.15.183:6813","nonce":33898}]},"public_addr":"172.21.15.183:6804/33898","cluster_addr":"172.21.15.183:6809/33898","heartbeat_back_addr":"172.21.15.183:6815/33898","heartbeat_front_addr":"172.21.15.183:6813/33898","state":["exists","up"]},{"osd":6,"uuid":"5f910aac-4091-408b-8b2b-19865b21395c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":33910},{"type":"v1","addr":"172.21.15.183:6825","nonce":33910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":33910},{"type":"v1","addr":"172.21.15.183:6827","nonce":33910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":33910},{"type":"v1","addr":"172.21.15.183:6831","nonce":33910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":33910},{"type":"v1","addr":"172.21.15.183:6829","nonce":33910}]},"public_addr":"172.21.15.183:6825/33910","cluster_addr":"172.21.15.183:6827/33910","heartbeat_back_addr":"172.21.15.183:6831/33910","heartbeat_front_addr":"172.21.15.183:6829/33910","state":["exists","up"]},{"osd":7,"uuid":"96d7b9aa-687e-42e3-a5cf-1533931ecce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":33903},{"type":"v1","addr":"172.21.15.183:6817","nonce":33903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":33903},{"type":"v1","addr":"172.21.15.183:6819","nonce":33903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":33903},{"type":"v1","addr":"172.21.15.183:6823","nonce":33903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":33903},{"type":"v1","addr":"172.21.15.183:6821","nonce":33903}]},"public_addr":"172.21.15.183:6817/33903","cluster_addr":"172.21.15.183:6819/33903","heartbeat_back_addr":"172.21.15.183:6823/33903","heartbeat_front_addr":"172.21.15.183:6821/33903","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.622366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.713036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.561097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.546583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.007074+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:52.994413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.176820+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:52.906075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T17:24:10.058 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.051+0000 7f3a47a1b700 1 -- 172.21.15.158:0/1534963991 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f3a2405a510 msgr2=0x7f3a2405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:10.059 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.051+0000 7f3a47a1b700 1 --2- 172.21.15.158:0/1534963991 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f3a2405a510 0x7f3a2405c9d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f3a40150d10 tx=0x7f3a3c017000).stop 2023-10-18T17:24:10.059 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.051+0000 7f3a47a1b700 1 -- 172.21.15.158:0/1534963991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a400691c0 msgr2=0x7f3a400c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:10.059 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.051+0000 7f3a47a1b700 1 --2- 172.21.15.158:0/1534963991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a400691c0 0x7f3a400c2800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f3a3800ec90 tx=0x7f3a3800b040).stop 2023-10-18T17:24:10.060 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.051+0000 7f3a47a1b700 1 -- 172.21.15.158:0/1534963991 shutdown_connections 2023-10-18T17:24:10.060 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.051+0000 7f3a47a1b700 1 --2- 172.21.15.158:0/1534963991 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f3a2405a510 0x7f3a2405c9d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.060 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.051+0000 7f3a47a1b700 1 --2- 172.21.15.158:0/1534963991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3a400691c0 0x7f3a400c2800 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.060 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.051+0000 7f3a47a1b700 1 --2- 172.21.15.158:0/1534963991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a400674e0 0x7f3a40163770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.061 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.051+0000 7f3a47a1b700 1 --2- 172.21.15.158:0/1534963991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a40067070 0x7f3a40160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.061 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.051+0000 7f3a47a1b700 1 -- 172.21.15.158:0/1534963991 >> 172.21.15.158:0/1534963991 conn(0x7f3a40065130 msgr2=0x7f3a400bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:10.061 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.051+0000 7f3a47a1b700 1 -- 172.21.15.158:0/1534963991 shutdown_connections 2023-10-18T17:24:10.061 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.051+0000 7f3a47a1b700 1 -- 172.21.15.158:0/1534963991 wait complete. 2023-10-18T17:24:10.078 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-18T17:24:10.079 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T17:24:10.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.231+0000 7f6fad7b9700 1 Processor -- start 2023-10-18T17:24:10.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.235+0000 7f6fad7b9700 1 -- start start 2023-10-18T17:24:10.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.235+0000 7f6fad7b9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6fa80bf720 0x7f6fa8066180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:10.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.235+0000 7f6fad7b9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6fa8066670 0x7f6fa8151820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:10.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.235+0000 7f6fad7b9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa814eae0 con 0x7f6fa80bf340 2023-10-18T17:24:10.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.235+0000 7f6fad7b9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa80bfb00 con 0x7f6fa8066670 2023-10-18T17:24:10.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.235+0000 7f6fad7b9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa814dc30 con 0x7f6fa80bf720 2023-10-18T17:24:10.243 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.235+0000 7f6f9f7fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6fa80bf720 0x7f6fa8066180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:10.244 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.235+0000 7f6fa7fff700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f6fa80bf340 0x7f6fa814e3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:56984/0 (socket says 172.21.15.158:56984) 2023-10-18T17:24:10.244 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.235+0000 7f6fa7fff700 1 -- 172.21.15.158:0/4229700588 learned_addr learned my addr 172.21.15.158:0/4229700588 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:10.244 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.235+0000 7f6facfb8700 1 --2- 172.21.15.158:0/4229700588 >> v2:172.21.15.183:3300/0 conn(0x7f6fa8066670 0x7f6fa8151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:10.244 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.235+0000 7f6f9f7fe700 1 -- 172.21.15.158:0/4229700588 >> v2:172.21.15.183:3300/0 conn(0x7f6fa8066670 msgr2=0x7f6fa8151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:10.244 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.235+0000 7f6f9f7fe700 1 --2- 172.21.15.158:0/4229700588 >> v2:172.21.15.183:3300/0 conn(0x7f6fa8066670 0x7f6fa8151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.245 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.235+0000 7f6f9f7fe700 1 -- 172.21.15.158:0/4229700588 >> v1:172.21.15.183:6789/0 conn(0x7f6fa80bf340 legacy=0x7f6fa814e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:10.245 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.235+0000 7f6f9f7fe700 1 -- 172.21.15.158:0/4229700588 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa80bbb60 con 0x7f6fa80bf720 2023-10-18T17:24:10.245 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.235+0000 7f6fa77fe700 1 -- 172.21.15.158:0/4229700588 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105540304 0 0) 0x7f6fa814eae0 con 0x7f6fa80bf340 2023-10-18T17:24:10.245 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.235+0000 7f6f9f7fe700 1 --2- 172.21.15.158:0/4229700588 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6fa80bf720 0x7f6fa8066180 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6f90009760 tx=0x7f6f90009060).ready entity=mon.2 client_cookie=940be921e3c02d3b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:10.245 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.235+0000 7f6fa77fe700 1 -- 172.21.15.158:0/4229700588 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9000b610 con 0x7f6fa80bf720 2023-10-18T17:24:10.246 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.235+0000 7f6fa77fe700 1 -- 172.21.15.158:0/4229700588 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9000b770 con 0x7f6fa80bf720 2023-10-18T17:24:10.246 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.235+0000 7f6fa77fe700 1 -- 172.21.15.158:0/4229700588 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9000baf0 con 0x7f6fa80bf720 2023-10-18T17:24:10.247 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.239+0000 7f6fad7b9700 1 -- 172.21.15.158:0/4229700588 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6fa80bf720 msgr2=0x7f6fa8066180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:10.247 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.239+0000 7f6fad7b9700 1 --2- 172.21.15.158:0/4229700588 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6fa80bf720 0x7f6fa8066180 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6f90009760 tx=0x7f6f90009060).stop 2023-10-18T17:24:10.247 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.239+0000 7f6fad7b9700 1 -- 172.21.15.158:0/4229700588 shutdown_connections 2023-10-18T17:24:10.247 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.239+0000 7f6fad7b9700 1 --2- 172.21.15.158:0/4229700588 >> v2:172.21.15.183:3300/0 conn(0x7f6fa8066670 0x7f6fa8151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.247 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.239+0000 7f6fad7b9700 1 --2- 172.21.15.158:0/4229700588 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6fa80bf720 0x7f6fa8066180 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.248 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.239+0000 7f6fad7b9700 1 -- 172.21.15.158:0/4229700588 >> 172.21.15.158:0/4229700588 conn(0x7f6fa805ddc0 msgr2=0x7f6fa805e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:10.248 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.239+0000 7f6fad7b9700 1 -- 172.21.15.158:0/4229700588 shutdown_connections 2023-10-18T17:24:10.248 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.239+0000 7f6fad7b9700 1 -- 172.21.15.158:0/4229700588 wait complete. 2023-10-18T17:24:10.248 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.239+0000 7f6fad7b9700 1 Processor -- start 2023-10-18T17:24:10.248 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.239+0000 7f6fad7b9700 1 -- start start 2023-10-18T17:24:10.250 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.239+0000 7f6fad7b9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fa8066670 0x7f6fa8143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:10.250 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.239+0000 7f6fad7b9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6fa80bf340 0x7f6fa81531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:10.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.239+0000 7f6fad7b9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6fa80bf720 0x7f6fa81536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:10.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.239+0000 7f6fad7b9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa8155200 con 0x7f6fa8066670 2023-10-18T17:24:10.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.239+0000 7f6fad7b9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa8153bd0 con 0x7f6fa80bf340 2023-10-18T17:24:10.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.239+0000 7f6fad7b9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa81627c0 con 0x7f6fa80bf720 2023-10-18T17:24:10.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.243+0000 7f6f9f7fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6fa80bf340 0x7f6fa81531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:10.252 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.243+0000 7f6facfb8700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6fa80bf720 0x7f6fa81536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:10.252 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.243+0000 7f6f9f7fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6fa80bf340 0x7f6fa81531f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:43622/0 (socket says 172.21.15.158:43622) 2023-10-18T17:24:10.252 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.243+0000 7f6fa7fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fa8066670 0x7f6fa8143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:10.252 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.243+0000 7f6f9f7fe700 1 -- 172.21.15.158:0/1050008146 learned_addr learned my addr 172.21.15.158:0/1050008146 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:10.252 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.243+0000 7f6f9f7fe700 1 -- 172.21.15.158:0/1050008146 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6fa80bf720 msgr2=0x7f6fa81536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:10.253 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.243+0000 7f6f9f7fe700 1 --2- 172.21.15.158:0/1050008146 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6fa80bf720 0x7f6fa81536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.253 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.243+0000 7f6f9f7fe700 1 -- 172.21.15.158:0/1050008146 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fa8066670 msgr2=0x7f6fa8143c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:10.253 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.243+0000 7f6f9f7fe700 1 --2- 172.21.15.158:0/1050008146 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fa8066670 0x7f6fa8143c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.253 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.243+0000 7f6f9f7fe700 1 -- 172.21.15.158:0/1050008146 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f900092a0 con 0x7f6fa80bf340 2023-10-18T17:24:10.253 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.243+0000 7f6f9f7fe700 1 --2- 172.21.15.158:0/1050008146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6fa80bf340 0x7f6fa81531f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f6fa8067400 tx=0x7f6f90017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:10.253 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.243+0000 7f6fa4ff9700 1 -- 172.21.15.158:0/1050008146 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9000beb0 con 0x7f6fa80bf340 2023-10-18T17:24:10.254 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.243+0000 7f6fa4ff9700 1 -- 172.21.15.158:0/1050008146 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9000b8e0 con 0x7f6fa80bf340 2023-10-18T17:24:10.254 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.243+0000 7f6fa4ff9700 1 -- 172.21.15.158:0/1050008146 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9001b660 con 0x7f6fa80bf340 2023-10-18T17:24:10.254 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.243+0000 7f6fad7b9700 1 -- 172.21.15.158:0/1050008146 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa8162a80 con 0x7f6fa80bf340 2023-10-18T17:24:10.254 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.243+0000 7f6fad7b9700 1 -- 172.21.15.158:0/1050008146 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa8163040 con 0x7f6fa80bf340 2023-10-18T17:24:10.255 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.247+0000 7f6fad7b9700 1 -- 172.21.15.158:0/1050008146 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa80bd600 con 0x7f6fa80bf340 2023-10-18T17:24:10.255 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.247+0000 7f6fa4ff9700 1 -- 172.21.15.158:0/1050008146 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6f9001ba10 con 0x7f6fa80bf340 2023-10-18T17:24:10.256 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.247+0000 7f6fa4ff9700 1 --2- 172.21.15.158:0/1050008146 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6f8805a540 0x7f6f8805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:10.256 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.247+0000 7f6fa4ff9700 1 -- 172.21.15.158:0/1050008146 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6f90075750 con 0x7f6fa80bf340 2023-10-18T17:24:10.256 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.247+0000 7f6fa7fff700 1 --2- 172.21.15.158:0/1050008146 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6f8805a540 0x7f6f8805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:10.256 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.251+0000 7f6fa7fff700 1 --2- 172.21.15.158:0/1050008146 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6f8805a540 0x7f6f8805ca00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f6f980011e0 tx=0x7f6f98007bb0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:10.264 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.259+0000 7f6fa4ff9700 1 -- 172.21.15.158:0/1050008146 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f6fa80bd600 con 0x7f6fa80bf340 2023-10-18T17:24:10.429 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.423+0000 7f6fad7b9700 1 -- 172.21.15.158:0/1050008146 --> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6fa80bd600 con 0x7f6f8805a540 2023-10-18T17:24:10.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.443+0000 7f6fa4ff9700 1 -- 172.21.15.158:0/1050008146 <== mgr.4100 v2:172.21.15.183:6832/33555 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336271 (secure 0 0 0) 0x7f6fa80bd600 con 0x7f6f8805a540 2023-10-18T17:24:10.457 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:10.459 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.451+0000 7f6fad7b9700 1 -- 172.21.15.158:0/1050008146 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6f8805a540 msgr2=0x7f6f8805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:10.459 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.451+0000 7f6fad7b9700 1 --2- 172.21.15.158:0/1050008146 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6f8805a540 0x7f6f8805ca00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f6f980011e0 tx=0x7f6f98007bb0).stop 2023-10-18T17:24:10.460 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.451+0000 7f6fad7b9700 1 -- 172.21.15.158:0/1050008146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6fa80bf340 msgr2=0x7f6fa81531f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:10.460 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.451+0000 7f6fad7b9700 1 --2- 172.21.15.158:0/1050008146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6fa80bf340 0x7f6fa81531f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f6fa8067400 tx=0x7f6f90017000).stop 2023-10-18T17:24:10.460 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.451+0000 7f6fad7b9700 1 -- 172.21.15.158:0/1050008146 shutdown_connections 2023-10-18T17:24:10.460 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.451+0000 7f6fad7b9700 1 --2- 172.21.15.158:0/1050008146 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6f8805a540 0x7f6f8805ca00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.460 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.451+0000 7f6fad7b9700 1 --2- 172.21.15.158:0/1050008146 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6fa80bf720 0x7f6fa81536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.461 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.451+0000 7f6fad7b9700 1 --2- 172.21.15.158:0/1050008146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6fa80bf340 0x7f6fa81531f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.461 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.451+0000 7f6fad7b9700 1 --2- 172.21.15.158:0/1050008146 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6fa8066670 0x7f6fa8143c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.461 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.451+0000 7f6fad7b9700 1 -- 172.21.15.158:0/1050008146 >> 172.21.15.158:0/1050008146 conn(0x7f6fa805ddc0 msgr2=0x7f6fa80c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:10.461 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.451+0000 7f6fad7b9700 1 -- 172.21.15.158:0/1050008146 shutdown_connections 2023-10-18T17:24:10.461 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.451+0000 7f6fad7b9700 1 -- 172.21.15.158:0/1050008146 wait complete. 2023-10-18T17:24:10.462 INFO:teuthology.orchestra.run.smithi158.stderr:dumped all 2023-10-18T17:24:10.480 INFO:teuthology.orchestra.run.smithi158.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-18T17:24:09.488964+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378408,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596312,"statfs":{"total":773094113280,"available":770658623488,"internally_reserved":0,"allocated":1679360,"data_stored":616617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.239274+0000","last_change":"2023-10-18T17:24:04.239274+0000","last_active":"2023-10-18T17:24:04.239274+0000","last_peered":"2023-10-18T17:24:04.239274+0000","last_clean":"2023-10-18T17:24:04.239274+0000","last_became_active":"2023-10-18T17:24:04.238910+0000","last_became_peered":"2023-10-18T17:24:04.238910+0000","last_unstale":"2023-10-18T17:24:04.239274+0000","last_undegraded":"2023-10-18T17:24:04.239274+0000","last_fullsized":"2023-10-18T17:24:04.239274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.226011+0000","last_change":"2023-10-18T17:24:03.748169+0000","last_active":"2023-10-18T17:24:04.226011+0000","last_peered":"2023-10-18T17:24:04.226011+0000","last_clean":"2023-10-18T17:24:04.226011+0000","last_became_active":"2023-10-18T17:24:03.747891+0000","last_became_peered":"2023-10-18T17:24:03.747891+0000","last_unstale":"2023-10-18T17:24:04.226011+0000","last_undegraded":"2023-10-18T17:24:04.226011+0000","last_fullsized":"2023-10-18T17:24:04.226011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.260959+0000","last_change":"2023-10-18T17:24:04.259514+0000","last_active":"2023-10-18T17:24:04.260959+0000","last_peered":"2023-10-18T17:24:04.260959+0000","last_clean":"2023-10-18T17:24:04.260959+0000","last_became_active":"2023-10-18T17:24:04.253467+0000","last_became_peered":"2023-10-18T17:24:04.253467+0000","last_unstale":"2023-10-18T17:24:04.260959+0000","last_undegraded":"2023-10-18T17:24:04.260959+0000","last_fullsized":"2023-10-18T17:24:04.260959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.754449+0000","last_change":"2023-10-18T17:24:03.746790+0000","last_active":"2023-10-18T17:24:03.754449+0000","last_peered":"2023-10-18T17:24:03.754449+0000","last_clean":"2023-10-18T17:24:03.754449+0000","last_became_active":"2023-10-18T17:24:03.746453+0000","last_became_peered":"2023-10-18T17:24:03.746453+0000","last_unstale":"2023-10-18T17:24:03.754449+0000","last_undegraded":"2023-10-18T17:24:03.754449+0000","last_fullsized":"2023-10-18T17:24:03.754449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.750666+0000","last_change":"2023-10-18T17:24:03.741477+0000","last_active":"2023-10-18T17:24:03.750666+0000","last_peered":"2023-10-18T17:24:03.750666+0000","last_clean":"2023-10-18T17:24:03.750666+0000","last_became_active":"2023-10-18T17:24:03.741171+0000","last_became_peered":"2023-10-18T17:24:03.741171+0000","last_unstale":"2023-10-18T17:24:03.750666+0000","last_undegraded":"2023-10-18T17:24:03.750666+0000","last_fullsized":"2023-10-18T17:24:03.750666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.267322+0000","last_change":"2023-10-18T17:24:04.267322+0000","last_active":"2023-10-18T17:24:04.267322+0000","last_peered":"2023-10-18T17:24:04.267322+0000","last_clean":"2023-10-18T17:24:04.267322+0000","last_became_active":"2023-10-18T17:24:04.266792+0000","last_became_peered":"2023-10-18T17:24:04.266792+0000","last_unstale":"2023-10-18T17:24:04.267322+0000","last_undegraded":"2023-10-18T17:24:04.267322+0000","last_fullsized":"2023-10-18T17:24:04.267322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.244754+0000","last_change":"2023-10-18T17:24:03.740595+0000","last_active":"2023-10-18T17:24:04.244754+0000","last_peered":"2023-10-18T17:24:04.244754+0000","last_clean":"2023-10-18T17:24:04.244754+0000","last_became_active":"2023-10-18T17:24:03.738983+0000","last_became_peered":"2023-10-18T17:24:03.738983+0000","last_unstale":"2023-10-18T17:24:04.244754+0000","last_undegraded":"2023-10-18T17:24:04.244754+0000","last_fullsized":"2023-10-18T17:24:04.244754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.252476+0000","last_change":"2023-10-18T17:24:04.252476+0000","last_active":"2023-10-18T17:24:04.252476+0000","last_peered":"2023-10-18T17:24:04.252476+0000","last_clean":"2023-10-18T17:24:04.252476+0000","last_became_active":"2023-10-18T17:24:04.252105+0000","last_became_peered":"2023-10-18T17:24:04.252105+0000","last_unstale":"2023-10-18T17:24:04.252476+0000","last_undegraded":"2023-10-18T17:24:04.252476+0000","last_fullsized":"2023-10-18T17:24:04.252476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.749951+0000","last_change":"2023-10-18T17:24:03.743161+0000","last_active":"2023-10-18T17:24:03.749951+0000","last_peered":"2023-10-18T17:24:03.749951+0000","last_clean":"2023-10-18T17:24:03.749951+0000","last_became_active":"2023-10-18T17:24:03.742829+0000","last_became_peered":"2023-10-18T17:24:03.742829+0000","last_unstale":"2023-10-18T17:24:03.749951+0000","last_undegraded":"2023-10-18T17:24:03.749951+0000","last_fullsized":"2023-10-18T17:24:03.749951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.241446+0000","last_change":"2023-10-18T17:24:04.236924+0000","last_active":"2023-10-18T17:24:04.241446+0000","last_peered":"2023-10-18T17:24:04.241446+0000","last_clean":"2023-10-18T17:24:04.241446+0000","last_became_active":"2023-10-18T17:24:04.236665+0000","last_became_peered":"2023-10-18T17:24:04.236665+0000","last_unstale":"2023-10-18T17:24:04.241446+0000","last_undegraded":"2023-10-18T17:24:04.241446+0000","last_fullsized":"2023-10-18T17:24:04.241446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.753419+0000","last_change":"2023-10-18T17:24:03.751587+0000","last_active":"2023-10-18T17:24:03.753419+0000","last_peered":"2023-10-18T17:24:03.753419+0000","last_clean":"2023-10-18T17:24:03.753419+0000","last_became_active":"2023-10-18T17:24:03.750569+0000","last_became_peered":"2023-10-18T17:24:03.750569+0000","last_unstale":"2023-10-18T17:24:03.753419+0000","last_undegraded":"2023-10-18T17:24:03.753419+0000","last_fullsized":"2023-10-18T17:24:03.753419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.256918+0000","last_change":"2023-10-18T17:24:04.256918+0000","last_active":"2023-10-18T17:24:04.256918+0000","last_peered":"2023-10-18T17:24:04.256918+0000","last_clean":"2023-10-18T17:24:04.256918+0000","last_became_active":"2023-10-18T17:24:04.256613+0000","last_became_peered":"2023-10-18T17:24:04.256613+0000","last_unstale":"2023-10-18T17:24:04.256918+0000","last_undegraded":"2023-10-18T17:24:04.256918+0000","last_fullsized":"2023-10-18T17:24:04.256918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.234112+0000","last_change":"2023-10-18T17:24:03.746467+0000","last_active":"2023-10-18T17:24:04.234112+0000","last_peered":"2023-10-18T17:24:04.234112+0000","last_clean":"2023-10-18T17:24:04.234112+0000","last_became_active":"2023-10-18T17:24:03.746097+0000","last_became_peered":"2023-10-18T17:24:03.746097+0000","last_unstale":"2023-10-18T17:24:04.234112+0000","last_undegraded":"2023-10-18T17:24:04.234112+0000","last_fullsized":"2023-10-18T17:24:04.234112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250040+0000","last_change":"2023-10-18T17:24:04.250040+0000","last_active":"2023-10-18T17:24:04.250040+0000","last_peered":"2023-10-18T17:24:04.250040+0000","last_clean":"2023-10-18T17:24:04.250040+0000","last_became_active":"2023-10-18T17:24:04.249714+0000","last_became_peered":"2023-10-18T17:24:04.249714+0000","last_unstale":"2023-10-18T17:24:04.250040+0000","last_undegraded":"2023-10-18T17:24:04.250040+0000","last_fullsized":"2023-10-18T17:24:04.250040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.754411+0000","last_change":"2023-10-18T17:24:03.747229+0000","last_active":"2023-10-18T17:24:03.754411+0000","last_peered":"2023-10-18T17:24:03.754411+0000","last_clean":"2023-10-18T17:24:03.754411+0000","last_became_active":"2023-10-18T17:24:03.746616+0000","last_became_peered":"2023-10-18T17:24:03.746616+0000","last_unstale":"2023-10-18T17:24:03.754411+0000","last_undegraded":"2023-10-18T17:24:03.754411+0000","last_fullsized":"2023-10-18T17:24:03.754411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.247394+0000","last_change":"2023-10-18T17:24:04.245726+0000","last_active":"2023-10-18T17:24:04.247394+0000","last_peered":"2023-10-18T17:24:04.247394+0000","last_clean":"2023-10-18T17:24:04.247394+0000","last_became_active":"2023-10-18T17:24:04.245359+0000","last_became_peered":"2023-10-18T17:24:04.245359+0000","last_unstale":"2023-10-18T17:24:04.247394+0000","last_undegraded":"2023-10-18T17:24:04.247394+0000","last_fullsized":"2023-10-18T17:24:04.247394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.760250+0000","last_change":"2023-10-18T17:24:03.750446+0000","last_active":"2023-10-18T17:24:03.760250+0000","last_peered":"2023-10-18T17:24:03.760250+0000","last_clean":"2023-10-18T17:24:03.760250+0000","last_became_active":"2023-10-18T17:24:03.750168+0000","last_became_peered":"2023-10-18T17:24:03.750168+0000","last_unstale":"2023-10-18T17:24:03.760250+0000","last_undegraded":"2023-10-18T17:24:03.760250+0000","last_fullsized":"2023-10-18T17:24:03.760250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.248487+0000","last_change":"2023-10-18T17:24:04.248487+0000","last_active":"2023-10-18T17:24:04.248487+0000","last_peered":"2023-10-18T17:24:04.248487+0000","last_clean":"2023-10-18T17:24:04.248487+0000","last_became_active":"2023-10-18T17:24:04.248084+0000","last_became_peered":"2023-10-18T17:24:04.248084+0000","last_unstale":"2023-10-18T17:24:04.248487+0000","last_undegraded":"2023-10-18T17:24:04.248487+0000","last_fullsized":"2023-10-18T17:24:04.248487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.764201+0000","last_change":"2023-10-18T17:24:03.762411+0000","last_active":"2023-10-18T17:24:03.764201+0000","last_peered":"2023-10-18T17:24:03.764201+0000","last_clean":"2023-10-18T17:24:03.764201+0000","last_became_active":"2023-10-18T17:24:03.762048+0000","last_became_peered":"2023-10-18T17:24:03.762048+0000","last_unstale":"2023-10-18T17:24:03.764201+0000","last_undegraded":"2023-10-18T17:24:03.764201+0000","last_fullsized":"2023-10-18T17:24:03.764201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258720+0000","last_change":"2023-10-18T17:24:04.255411+0000","last_active":"2023-10-18T17:24:04.258720+0000","last_peered":"2023-10-18T17:24:04.258720+0000","last_clean":"2023-10-18T17:24:04.258720+0000","last_became_active":"2023-10-18T17:24:04.253124+0000","last_became_peered":"2023-10-18T17:24:04.253124+0000","last_unstale":"2023-10-18T17:24:04.258720+0000","last_undegraded":"2023-10-18T17:24:04.258720+0000","last_fullsized":"2023-10-18T17:24:04.258720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.759892+0000","last_change":"2023-10-18T17:24:03.753682+0000","last_active":"2023-10-18T17:24:03.759892+0000","last_peered":"2023-10-18T17:24:03.759892+0000","last_clean":"2023-10-18T17:24:03.759892+0000","last_became_active":"2023-10-18T17:24:03.750732+0000","last_became_peered":"2023-10-18T17:24:03.750732+0000","last_unstale":"2023-10-18T17:24:03.759892+0000","last_undegraded":"2023-10-18T17:24:03.759892+0000","last_fullsized":"2023-10-18T17:24:03.759892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.247389+0000","last_change":"2023-10-18T17:24:04.247389+0000","last_active":"2023-10-18T17:24:04.247389+0000","last_peered":"2023-10-18T17:24:04.247389+0000","last_clean":"2023-10-18T17:24:04.247389+0000","last_became_active":"2023-10-18T17:24:04.247045+0000","last_became_peered":"2023-10-18T17:24:04.247045+0000","last_unstale":"2023-10-18T17:24:04.247389+0000","last_undegraded":"2023-10-18T17:24:04.247389+0000","last_fullsized":"2023-10-18T17:24:04.247389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.746515+0000","last_change":"2023-10-18T17:24:03.742205+0000","last_active":"2023-10-18T17:24:03.746515+0000","last_peered":"2023-10-18T17:24:03.746515+0000","last_clean":"2023-10-18T17:24:03.746515+0000","last_became_active":"2023-10-18T17:24:03.741881+0000","last_became_peered":"2023-10-18T17:24:03.741881+0000","last_unstale":"2023-10-18T17:24:03.746515+0000","last_undegraded":"2023-10-18T17:24:03.746515+0000","last_fullsized":"2023-10-18T17:24:03.746515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.251859+0000","last_change":"2023-10-18T17:24:04.251859+0000","last_active":"2023-10-18T17:24:04.251859+0000","last_peered":"2023-10-18T17:24:04.251859+0000","last_clean":"2023-10-18T17:24:04.251859+0000","last_became_active":"2023-10-18T17:24:04.251431+0000","last_became_peered":"2023-10-18T17:24:04.251431+0000","last_unstale":"2023-10-18T17:24:04.251859+0000","last_undegraded":"2023-10-18T17:24:04.251859+0000","last_fullsized":"2023-10-18T17:24:04.251859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.225479+0000","last_change":"2023-10-18T17:24:03.761606+0000","last_active":"2023-10-18T17:24:04.225479+0000","last_peered":"2023-10-18T17:24:04.225479+0000","last_clean":"2023-10-18T17:24:04.225479+0000","last_became_active":"2023-10-18T17:24:03.759066+0000","last_became_peered":"2023-10-18T17:24:03.759066+0000","last_unstale":"2023-10-18T17:24:04.225479+0000","last_undegraded":"2023-10-18T17:24:04.225479+0000","last_fullsized":"2023-10-18T17:24:04.225479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.242517+0000","last_change":"2023-10-18T17:24:04.242517+0000","last_active":"2023-10-18T17:24:04.242517+0000","last_peered":"2023-10-18T17:24:04.242517+0000","last_clean":"2023-10-18T17:24:04.242517+0000","last_became_active":"2023-10-18T17:24:04.242198+0000","last_became_peered":"2023-10-18T17:24:04.242198+0000","last_unstale":"2023-10-18T17:24:04.242517+0000","last_undegraded":"2023-10-18T17:24:04.242517+0000","last_fullsized":"2023-10-18T17:24:04.242517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.760284+0000","last_change":"2023-10-18T17:24:03.751375+0000","last_active":"2023-10-18T17:24:03.760284+0000","last_peered":"2023-10-18T17:24:03.760284+0000","last_clean":"2023-10-18T17:24:03.760284+0000","last_became_active":"2023-10-18T17:24:03.751112+0000","last_became_peered":"2023-10-18T17:24:03.751112+0000","last_unstale":"2023-10-18T17:24:03.760284+0000","last_undegraded":"2023-10-18T17:24:03.760284+0000","last_fullsized":"2023-10-18T17:24:03.760284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253973+0000","last_change":"2023-10-18T17:24:04.253973+0000","last_active":"2023-10-18T17:24:04.253973+0000","last_peered":"2023-10-18T17:24:04.253973+0000","last_clean":"2023-10-18T17:24:04.253973+0000","last_became_active":"2023-10-18T17:24:04.253669+0000","last_became_peered":"2023-10-18T17:24:04.253669+0000","last_unstale":"2023-10-18T17:24:04.253973+0000","last_undegraded":"2023-10-18T17:24:04.253973+0000","last_fullsized":"2023-10-18T17:24:04.253973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.234227+0000","last_change":"2023-10-18T17:24:03.762548+0000","last_active":"2023-10-18T17:24:04.234227+0000","last_peered":"2023-10-18T17:24:04.234227+0000","last_clean":"2023-10-18T17:24:04.234227+0000","last_became_active":"2023-10-18T17:24:03.762215+0000","last_became_peered":"2023-10-18T17:24:03.762215+0000","last_unstale":"2023-10-18T17:24:04.234227+0000","last_undegraded":"2023-10-18T17:24:04.234227+0000","last_fullsized":"2023-10-18T17:24:04.234227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.255941+0000","last_change":"2023-10-18T17:24:04.244220+0000","last_active":"2023-10-18T17:24:04.255941+0000","last_peered":"2023-10-18T17:24:04.255941+0000","last_clean":"2023-10-18T17:24:04.255941+0000","last_became_active":"2023-10-18T17:24:04.243840+0000","last_became_peered":"2023-10-18T17:24:04.243840+0000","last_unstale":"2023-10-18T17:24:04.255941+0000","last_undegraded":"2023-10-18T17:24:04.255941+0000","last_fullsized":"2023-10-18T17:24:04.255941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.764164+0000","last_change":"2023-10-18T17:24:03.761832+0000","last_active":"2023-10-18T17:24:03.764164+0000","last_peered":"2023-10-18T17:24:03.764164+0000","last_clean":"2023-10-18T17:24:03.764164+0000","last_became_active":"2023-10-18T17:24:03.761474+0000","last_became_peered":"2023-10-18T17:24:03.761474+0000","last_unstale":"2023-10-18T17:24:03.764164+0000","last_undegraded":"2023-10-18T17:24:03.764164+0000","last_fullsized":"2023-10-18T17:24:03.764164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.242877+0000","last_change":"2023-10-18T17:24:04.242877+0000","last_active":"2023-10-18T17:24:04.242877+0000","last_peered":"2023-10-18T17:24:04.242877+0000","last_clean":"2023-10-18T17:24:04.242877+0000","last_became_active":"2023-10-18T17:24:04.242155+0000","last_became_peered":"2023-10-18T17:24:04.242155+0000","last_unstale":"2023-10-18T17:24:04.242877+0000","last_undegraded":"2023-10-18T17:24:04.242877+0000","last_fullsized":"2023-10-18T17:24:04.242877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.236784+0000","last_change":"2023-10-18T17:24:03.750350+0000","last_active":"2023-10-18T17:24:04.236784+0000","last_peered":"2023-10-18T17:24:04.236784+0000","last_clean":"2023-10-18T17:24:04.236784+0000","last_became_active":"2023-10-18T17:24:03.750080+0000","last_became_peered":"2023-10-18T17:24:03.750080+0000","last_unstale":"2023-10-18T17:24:04.236784+0000","last_undegraded":"2023-10-18T17:24:04.236784+0000","last_fullsized":"2023-10-18T17:24:04.236784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.257049+0000","last_change":"2023-10-18T17:24:04.246950+0000","last_active":"2023-10-18T17:24:04.257049+0000","last_peered":"2023-10-18T17:24:04.257049+0000","last_clean":"2023-10-18T17:24:04.257049+0000","last_became_active":"2023-10-18T17:24:04.246377+0000","last_became_peered":"2023-10-18T17:24:04.246377+0000","last_unstale":"2023-10-18T17:24:04.257049+0000","last_undegraded":"2023-10-18T17:24:04.257049+0000","last_fullsized":"2023-10-18T17:24:04.257049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.755614+0000","last_change":"2023-10-18T17:24:03.754668+0000","last_active":"2023-10-18T17:24:03.755614+0000","last_peered":"2023-10-18T17:24:03.755614+0000","last_clean":"2023-10-18T17:24:03.755614+0000","last_became_active":"2023-10-18T17:24:03.754167+0000","last_became_peered":"2023-10-18T17:24:03.754167+0000","last_unstale":"2023-10-18T17:24:03.755614+0000","last_undegraded":"2023-10-18T17:24:03.755614+0000","last_fullsized":"2023-10-18T17:24:03.755614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250784+0000","last_change":"2023-10-18T17:24:04.239937+0000","last_active":"2023-10-18T17:24:04.250784+0000","last_peered":"2023-10-18T17:24:04.250784+0000","last_clean":"2023-10-18T17:24:04.250784+0000","last_became_active":"2023-10-18T17:24:04.239632+0000","last_became_peered":"2023-10-18T17:24:04.239632+0000","last_unstale":"2023-10-18T17:24:04.250784+0000","last_undegraded":"2023-10-18T17:24:04.250784+0000","last_fullsized":"2023-10-18T17:24:04.250784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.235445+0000","last_change":"2023-10-18T17:24:03.752082+0000","last_active":"2023-10-18T17:24:04.235445+0000","last_peered":"2023-10-18T17:24:04.235445+0000","last_clean":"2023-10-18T17:24:04.235445+0000","last_became_active":"2023-10-18T17:24:03.751789+0000","last_became_peered":"2023-10-18T17:24:03.751789+0000","last_unstale":"2023-10-18T17:24:04.235445+0000","last_undegraded":"2023-10-18T17:24:04.235445+0000","last_fullsized":"2023-10-18T17:24:04.235445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.249928+0000","last_change":"2023-10-18T17:24:04.249928+0000","last_active":"2023-10-18T17:24:04.249928+0000","last_peered":"2023-10-18T17:24:04.249928+0000","last_clean":"2023-10-18T17:24:04.249928+0000","last_became_active":"2023-10-18T17:24:04.249624+0000","last_became_peered":"2023-10-18T17:24:04.249624+0000","last_unstale":"2023-10-18T17:24:04.249928+0000","last_undegraded":"2023-10-18T17:24:04.249928+0000","last_fullsized":"2023-10-18T17:24:04.249928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.760065+0000","last_change":"2023-10-18T17:24:03.750481+0000","last_active":"2023-10-18T17:24:03.760065+0000","last_peered":"2023-10-18T17:24:03.760065+0000","last_clean":"2023-10-18T17:24:03.760065+0000","last_became_active":"2023-10-18T17:24:03.748182+0000","last_became_peered":"2023-10-18T17:24:03.748182+0000","last_unstale":"2023-10-18T17:24:03.760065+0000","last_undegraded":"2023-10-18T17:24:03.760065+0000","last_fullsized":"2023-10-18T17:24:03.760065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.251380+0000","last_change":"2023-10-18T17:24:04.251380+0000","last_active":"2023-10-18T17:24:04.251380+0000","last_peered":"2023-10-18T17:24:04.251380+0000","last_clean":"2023-10-18T17:24:04.251380+0000","last_became_active":"2023-10-18T17:24:04.251078+0000","last_became_peered":"2023-10-18T17:24:04.251078+0000","last_unstale":"2023-10-18T17:24:04.251380+0000","last_undegraded":"2023-10-18T17:24:04.251380+0000","last_fullsized":"2023-10-18T17:24:04.251380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.750727+0000","last_change":"2023-10-18T17:24:03.742352+0000","last_active":"2023-10-18T17:24:03.750727+0000","last_peered":"2023-10-18T17:24:03.750727+0000","last_clean":"2023-10-18T17:24:03.750727+0000","last_became_active":"2023-10-18T17:24:03.742052+0000","last_became_peered":"2023-10-18T17:24:03.742052+0000","last_unstale":"2023-10-18T17:24:03.750727+0000","last_undegraded":"2023-10-18T17:24:03.750727+0000","last_fullsized":"2023-10-18T17:24:03.750727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.254657+0000","last_change":"2023-10-18T17:24:04.254657+0000","last_active":"2023-10-18T17:24:04.254657+0000","last_peered":"2023-10-18T17:24:04.254657+0000","last_clean":"2023-10-18T17:24:04.254657+0000","last_became_active":"2023-10-18T17:24:04.254373+0000","last_became_peered":"2023-10-18T17:24:04.254373+0000","last_unstale":"2023-10-18T17:24:04.254657+0000","last_undegraded":"2023-10-18T17:24:04.254657+0000","last_fullsized":"2023-10-18T17:24:04.254657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.754306+0000","last_change":"2023-10-18T17:24:03.746763+0000","last_active":"2023-10-18T17:24:03.754306+0000","last_peered":"2023-10-18T17:24:03.754306+0000","last_clean":"2023-10-18T17:24:03.754306+0000","last_became_active":"2023-10-18T17:24:03.746461+0000","last_became_peered":"2023-10-18T17:24:03.746461+0000","last_unstale":"2023-10-18T17:24:03.754306+0000","last_undegraded":"2023-10-18T17:24:03.754306+0000","last_fullsized":"2023-10-18T17:24:03.754306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258875+0000","last_change":"2023-10-18T17:24:04.258875+0000","last_active":"2023-10-18T17:24:04.258875+0000","last_peered":"2023-10-18T17:24:04.258875+0000","last_clean":"2023-10-18T17:24:04.258875+0000","last_became_active":"2023-10-18T17:24:04.258617+0000","last_became_peered":"2023-10-18T17:24:04.258617+0000","last_unstale":"2023-10-18T17:24:04.258875+0000","last_undegraded":"2023-10-18T17:24:04.258875+0000","last_fullsized":"2023-10-18T17:24:04.258875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.234335+0000","last_change":"2023-10-18T17:24:03.749937+0000","last_active":"2023-10-18T17:24:04.234335+0000","last_peered":"2023-10-18T17:24:04.234335+0000","last_clean":"2023-10-18T17:24:04.234335+0000","last_became_active":"2023-10-18T17:24:03.749625+0000","last_became_peered":"2023-10-18T17:24:03.749625+0000","last_unstale":"2023-10-18T17:24:04.234335+0000","last_undegraded":"2023-10-18T17:24:04.234335+0000","last_fullsized":"2023-10-18T17:24:04.234335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.244522+0000","last_change":"2023-10-18T17:24:04.237303+0000","last_active":"2023-10-18T17:24:04.244522+0000","last_peered":"2023-10-18T17:24:04.244522+0000","last_clean":"2023-10-18T17:24:04.244522+0000","last_became_active":"2023-10-18T17:24:04.237016+0000","last_became_peered":"2023-10-18T17:24:04.237016+0000","last_unstale":"2023-10-18T17:24:04.244522+0000","last_undegraded":"2023-10-18T17:24:04.244522+0000","last_fullsized":"2023-10-18T17:24:04.244522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.750089+0000","last_change":"2023-10-18T17:24:03.745317+0000","last_active":"2023-10-18T17:24:03.750089+0000","last_peered":"2023-10-18T17:24:03.750089+0000","last_clean":"2023-10-18T17:24:03.750089+0000","last_became_active":"2023-10-18T17:24:03.745016+0000","last_became_peered":"2023-10-18T17:24:03.745016+0000","last_unstale":"2023-10-18T17:24:03.750089+0000","last_undegraded":"2023-10-18T17:24:03.750089+0000","last_fullsized":"2023-10-18T17:24:03.750089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.262322+0000","last_change":"2023-10-18T17:24:04.262322+0000","last_active":"2023-10-18T17:24:04.262322+0000","last_peered":"2023-10-18T17:24:04.262322+0000","last_clean":"2023-10-18T17:24:04.262322+0000","last_became_active":"2023-10-18T17:24:04.262039+0000","last_became_peered":"2023-10-18T17:24:04.262039+0000","last_unstale":"2023-10-18T17:24:04.262322+0000","last_undegraded":"2023-10-18T17:24:04.262322+0000","last_fullsized":"2023-10-18T17:24:04.262322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.228078+0000","last_change":"2023-10-18T17:24:03.756377+0000","last_active":"2023-10-18T17:24:04.228078+0000","last_peered":"2023-10-18T17:24:04.228078+0000","last_clean":"2023-10-18T17:24:04.228078+0000","last_became_active":"2023-10-18T17:24:03.756048+0000","last_became_peered":"2023-10-18T17:24:03.756048+0000","last_unstale":"2023-10-18T17:24:04.228078+0000","last_undegraded":"2023-10-18T17:24:04.228078+0000","last_fullsized":"2023-10-18T17:24:04.228078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.256537+0000","last_change":"2023-10-18T17:24:04.248165+0000","last_active":"2023-10-18T17:24:04.256537+0000","last_peered":"2023-10-18T17:24:04.256537+0000","last_clean":"2023-10-18T17:24:04.256537+0000","last_became_active":"2023-10-18T17:24:04.247888+0000","last_became_peered":"2023-10-18T17:24:04.247888+0000","last_unstale":"2023-10-18T17:24:04.256537+0000","last_undegraded":"2023-10-18T17:24:04.256537+0000","last_fullsized":"2023-10-18T17:24:04.256537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.759986+0000","last_change":"2023-10-18T17:24:03.756703+0000","last_active":"2023-10-18T17:24:03.759986+0000","last_peered":"2023-10-18T17:24:03.759986+0000","last_clean":"2023-10-18T17:24:03.759986+0000","last_became_active":"2023-10-18T17:24:03.755543+0000","last_became_peered":"2023-10-18T17:24:03.755543+0000","last_unstale":"2023-10-18T17:24:03.759986+0000","last_undegraded":"2023-10-18T17:24:03.759986+0000","last_fullsized":"2023-10-18T17:24:03.759986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.248435+0000","last_change":"2023-10-18T17:24:04.248435+0000","last_active":"2023-10-18T17:24:04.248435+0000","last_peered":"2023-10-18T17:24:04.248435+0000","last_clean":"2023-10-18T17:24:04.248435+0000","last_became_active":"2023-10-18T17:24:04.248150+0000","last_became_peered":"2023-10-18T17:24:04.248150+0000","last_unstale":"2023-10-18T17:24:04.248435+0000","last_undegraded":"2023-10-18T17:24:04.248435+0000","last_fullsized":"2023-10-18T17:24:04.248435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.235444+0000","last_change":"2023-10-18T17:24:03.751813+0000","last_active":"2023-10-18T17:24:04.235444+0000","last_peered":"2023-10-18T17:24:04.235444+0000","last_clean":"2023-10-18T17:24:04.235444+0000","last_became_active":"2023-10-18T17:24:03.751468+0000","last_became_peered":"2023-10-18T17:24:03.751468+0000","last_unstale":"2023-10-18T17:24:04.235444+0000","last_undegraded":"2023-10-18T17:24:04.235444+0000","last_fullsized":"2023-10-18T17:24:04.235444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258693+0000","last_change":"2023-10-18T17:24:04.258693+0000","last_active":"2023-10-18T17:24:04.258693+0000","last_peered":"2023-10-18T17:24:04.258693+0000","last_clean":"2023-10-18T17:24:04.258693+0000","last_became_active":"2023-10-18T17:24:04.258420+0000","last_became_peered":"2023-10-18T17:24:04.258420+0000","last_unstale":"2023-10-18T17:24:04.258693+0000","last_undegraded":"2023-10-18T17:24:04.258693+0000","last_fullsized":"2023-10-18T17:24:04.258693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.750572+0000","last_change":"2023-10-18T17:24:03.741061+0000","last_active":"2023-10-18T17:24:03.750572+0000","last_peered":"2023-10-18T17:24:03.750572+0000","last_clean":"2023-10-18T17:24:03.750572+0000","last_became_active":"2023-10-18T17:24:03.740773+0000","last_became_peered":"2023-10-18T17:24:03.740773+0000","last_unstale":"2023-10-18T17:24:03.750572+0000","last_undegraded":"2023-10-18T17:24:03.750572+0000","last_fullsized":"2023-10-18T17:24:03.750572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.255651+0000","last_change":"2023-10-18T17:24:04.255651+0000","last_active":"2023-10-18T17:24:04.255651+0000","last_peered":"2023-10-18T17:24:04.255651+0000","last_clean":"2023-10-18T17:24:04.255651+0000","last_became_active":"2023-10-18T17:24:04.255377+0000","last_became_peered":"2023-10-18T17:24:04.255377+0000","last_unstale":"2023-10-18T17:24:04.255651+0000","last_undegraded":"2023-10-18T17:24:04.255651+0000","last_fullsized":"2023-10-18T17:24:04.255651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.764295+0000","last_change":"2023-10-18T17:24:03.762674+0000","last_active":"2023-10-18T17:24:03.764295+0000","last_peered":"2023-10-18T17:24:03.764295+0000","last_clean":"2023-10-18T17:24:03.764295+0000","last_became_active":"2023-10-18T17:24:03.762293+0000","last_became_peered":"2023-10-18T17:24:03.762293+0000","last_unstale":"2023-10-18T17:24:03.764295+0000","last_undegraded":"2023-10-18T17:24:03.764295+0000","last_fullsized":"2023-10-18T17:24:03.764295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.249093+0000","last_change":"2023-10-18T17:24:04.240811+0000","last_active":"2023-10-18T17:24:04.249093+0000","last_peered":"2023-10-18T17:24:04.249093+0000","last_clean":"2023-10-18T17:24:04.249093+0000","last_became_active":"2023-10-18T17:24:04.240514+0000","last_became_peered":"2023-10-18T17:24:04.240514+0000","last_unstale":"2023-10-18T17:24:04.249093+0000","last_undegraded":"2023-10-18T17:24:04.249093+0000","last_fullsized":"2023-10-18T17:24:04.249093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.749307+0000","last_change":"2023-10-18T17:24:03.744676+0000","last_active":"2023-10-18T17:24:03.749307+0000","last_peered":"2023-10-18T17:24:03.749307+0000","last_clean":"2023-10-18T17:24:03.749307+0000","last_became_active":"2023-10-18T17:24:03.744318+0000","last_became_peered":"2023-10-18T17:24:03.744318+0000","last_unstale":"2023-10-18T17:24:03.749307+0000","last_undegraded":"2023-10-18T17:24:03.749307+0000","last_fullsized":"2023-10-18T17:24:03.749307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.242434+0000","last_change":"2023-10-18T17:24:04.242434+0000","last_active":"2023-10-18T17:24:04.242434+0000","last_peered":"2023-10-18T17:24:04.242434+0000","last_clean":"2023-10-18T17:24:04.242434+0000","last_became_active":"2023-10-18T17:24:04.242125+0000","last_became_peered":"2023-10-18T17:24:04.242125+0000","last_unstale":"2023-10-18T17:24:04.242434+0000","last_undegraded":"2023-10-18T17:24:04.242434+0000","last_fullsized":"2023-10-18T17:24:04.242434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.740632+0000","last_change":"2023-10-18T17:23:58.684395+0000","last_active":"2023-10-18T17:24:03.740632+0000","last_peered":"2023-10-18T17:24:03.740632+0000","last_clean":"2023-10-18T17:24:03.740632+0000","last_became_active":"2023-10-18T17:23:58.683958+0000","last_became_peered":"2023-10-18T17:23:58.683958+0000","last_unstale":"2023-10-18T17:24:03.740632+0000","last_undegraded":"2023-10-18T17:24:03.740632+0000","last_fullsized":"2023-10-18T17:24:03.740632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.231926+0000","last_change":"2023-10-18T17:24:03.753111+0000","last_active":"2023-10-18T17:24:04.231926+0000","last_peered":"2023-10-18T17:24:04.231926+0000","last_clean":"2023-10-18T17:24:04.231926+0000","last_became_active":"2023-10-18T17:24:03.752548+0000","last_became_peered":"2023-10-18T17:24:03.752548+0000","last_unstale":"2023-10-18T17:24:04.231926+0000","last_undegraded":"2023-10-18T17:24:04.231926+0000","last_fullsized":"2023-10-18T17:24:04.231926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.244386+0000","last_change":"2023-10-18T17:24:04.244386+0000","last_active":"2023-10-18T17:24:04.244386+0000","last_peered":"2023-10-18T17:24:04.244386+0000","last_clean":"2023-10-18T17:24:04.244386+0000","last_became_active":"2023-10-18T17:24:04.244041+0000","last_became_peered":"2023-10-18T17:24:04.244041+0000","last_unstale":"2023-10-18T17:24:04.244386+0000","last_undegraded":"2023-10-18T17:24:04.244386+0000","last_fullsized":"2023-10-18T17:24:04.244386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.228377+0000","last_change":"2023-10-18T17:23:58.682697+0000","last_active":"2023-10-18T17:24:04.228377+0000","last_peered":"2023-10-18T17:24:04.228377+0000","last_clean":"2023-10-18T17:24:04.228377+0000","last_became_active":"2023-10-18T17:23:58.682294+0000","last_became_peered":"2023-10-18T17:23:58.682294+0000","last_unstale":"2023-10-18T17:24:04.228377+0000","last_undegraded":"2023-10-18T17:24:04.228377+0000","last_fullsized":"2023-10-18T17:24:04.228377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.759869+0000","last_change":"2023-10-18T17:24:03.749017+0000","last_active":"2023-10-18T17:24:03.759869+0000","last_peered":"2023-10-18T17:24:03.759869+0000","last_clean":"2023-10-18T17:24:03.759869+0000","last_became_active":"2023-10-18T17:24:03.748740+0000","last_became_peered":"2023-10-18T17:24:03.748740+0000","last_unstale":"2023-10-18T17:24:03.759869+0000","last_undegraded":"2023-10-18T17:24:03.759869+0000","last_fullsized":"2023-10-18T17:24:03.759869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.257504+0000","last_change":"2023-10-18T17:24:04.257504+0000","last_active":"2023-10-18T17:24:04.257504+0000","last_peered":"2023-10-18T17:24:04.257504+0000","last_clean":"2023-10-18T17:24:04.257504+0000","last_became_active":"2023-10-18T17:24:04.255752+0000","last_became_peered":"2023-10-18T17:24:04.255752+0000","last_unstale":"2023-10-18T17:24:04.257504+0000","last_undegraded":"2023-10-18T17:24:04.257504+0000","last_fullsized":"2023-10-18T17:24:04.257504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.735763+0000","last_change":"2023-10-18T17:23:58.853499+0000","last_active":"2023-10-18T17:24:03.735763+0000","last_peered":"2023-10-18T17:24:03.735763+0000","last_clean":"2023-10-18T17:24:03.735763+0000","last_became_active":"2023-10-18T17:23:58.852960+0000","last_became_peered":"2023-10-18T17:23:58.852960+0000","last_unstale":"2023-10-18T17:24:03.735763+0000","last_undegraded":"2023-10-18T17:24:03.735763+0000","last_fullsized":"2023-10-18T17:24:03.735763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.227303+0000","last_change":"2023-10-18T17:24:03.739032+0000","last_active":"2023-10-18T17:24:04.227303+0000","last_peered":"2023-10-18T17:24:04.227303+0000","last_clean":"2023-10-18T17:24:04.227303+0000","last_became_active":"2023-10-18T17:24:03.738439+0000","last_became_peered":"2023-10-18T17:24:03.738439+0000","last_unstale":"2023-10-18T17:24:04.227303+0000","last_undegraded":"2023-10-18T17:24:04.227303+0000","last_fullsized":"2023-10-18T17:24:04.227303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.246665+0000","last_change":"2023-10-18T17:24:04.245021+0000","last_active":"2023-10-18T17:24:04.246665+0000","last_peered":"2023-10-18T17:24:04.246665+0000","last_clean":"2023-10-18T17:24:04.246665+0000","last_became_active":"2023-10-18T17:24:04.244567+0000","last_became_peered":"2023-10-18T17:24:04.244567+0000","last_unstale":"2023-10-18T17:24:04.246665+0000","last_undegraded":"2023-10-18T17:24:04.246665+0000","last_fullsized":"2023-10-18T17:24:04.246665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.227863+0000","last_change":"2023-10-18T17:23:58.851971+0000","last_active":"2023-10-18T17:24:04.227863+0000","last_peered":"2023-10-18T17:24:04.227863+0000","last_clean":"2023-10-18T17:24:04.227863+0000","last_became_active":"2023-10-18T17:23:58.851505+0000","last_became_peered":"2023-10-18T17:23:58.851505+0000","last_unstale":"2023-10-18T17:24:04.227863+0000","last_undegraded":"2023-10-18T17:24:04.227863+0000","last_fullsized":"2023-10-18T17:24:04.227863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.762712+0000","last_change":"2023-10-18T17:24:03.761669+0000","last_active":"2023-10-18T17:24:03.762712+0000","last_peered":"2023-10-18T17:24:03.762712+0000","last_clean":"2023-10-18T17:24:03.762712+0000","last_became_active":"2023-10-18T17:24:03.761358+0000","last_became_peered":"2023-10-18T17:24:03.761358+0000","last_unstale":"2023-10-18T17:24:03.762712+0000","last_undegraded":"2023-10-18T17:24:03.762712+0000","last_fullsized":"2023-10-18T17:24:03.762712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.255925+0000","last_change":"2023-10-18T17:24:04.243705+0000","last_active":"2023-10-18T17:24:04.255925+0000","last_peered":"2023-10-18T17:24:04.255925+0000","last_clean":"2023-10-18T17:24:04.255925+0000","last_became_active":"2023-10-18T17:24:04.243438+0000","last_became_peered":"2023-10-18T17:24:04.243438+0000","last_unstale":"2023-10-18T17:24:04.255925+0000","last_undegraded":"2023-10-18T17:24:04.255925+0000","last_fullsized":"2023-10-18T17:24:04.255925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.756058+0000","last_change":"2023-10-18T17:24:03.754253+0000","last_active":"2023-10-18T17:24:03.756058+0000","last_peered":"2023-10-18T17:24:03.756058+0000","last_clean":"2023-10-18T17:24:03.756058+0000","last_became_active":"2023-10-18T17:24:03.753384+0000","last_became_peered":"2023-10-18T17:24:03.753384+0000","last_unstale":"2023-10-18T17:24:03.756058+0000","last_undegraded":"2023-10-18T17:24:03.756058+0000","last_fullsized":"2023-10-18T17:24:03.756058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.731236+0000","last_change":"2023-10-18T17:23:58.682309+0000","last_active":"2023-10-18T17:24:03.731236+0000","last_peered":"2023-10-18T17:24:03.731236+0000","last_clean":"2023-10-18T17:24:03.731236+0000","last_became_active":"2023-10-18T17:23:58.681978+0000","last_became_peered":"2023-10-18T17:23:58.681978+0000","last_unstale":"2023-10-18T17:24:03.731236+0000","last_undegraded":"2023-10-18T17:24:03.731236+0000","last_fullsized":"2023-10-18T17:24:03.731236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.255921+0000","last_change":"2023-10-18T17:24:04.244101+0000","last_active":"2023-10-18T17:24:04.255921+0000","last_peered":"2023-10-18T17:24:04.255921+0000","last_clean":"2023-10-18T17:24:04.255921+0000","last_became_active":"2023-10-18T17:24:04.243455+0000","last_became_peered":"2023-10-18T17:24:04.243455+0000","last_unstale":"2023-10-18T17:24:04.255921+0000","last_undegraded":"2023-10-18T17:24:04.255921+0000","last_fullsized":"2023-10-18T17:24:04.255921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.224950+0000","last_change":"2023-10-18T17:24:03.743003+0000","last_active":"2023-10-18T17:24:04.224950+0000","last_peered":"2023-10-18T17:24:04.224950+0000","last_clean":"2023-10-18T17:24:04.224950+0000","last_became_active":"2023-10-18T17:24:03.742629+0000","last_became_peered":"2023-10-18T17:24:03.742629+0000","last_unstale":"2023-10-18T17:24:04.224950+0000","last_undegraded":"2023-10-18T17:24:04.224950+0000","last_fullsized":"2023-10-18T17:24:04.224950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.236706+0000","last_change":"2023-10-18T17:23:58.678572+0000","last_active":"2023-10-18T17:24:04.236706+0000","last_peered":"2023-10-18T17:24:04.236706+0000","last_clean":"2023-10-18T17:24:04.236706+0000","last_became_active":"2023-10-18T17:23:58.677813+0000","last_became_peered":"2023-10-18T17:23:58.677813+0000","last_unstale":"2023-10-18T17:24:04.236706+0000","last_undegraded":"2023-10-18T17:24:04.236706+0000","last_fullsized":"2023-10-18T17:24:04.236706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250762+0000","last_change":"2023-10-18T17:24:04.239298+0000","last_active":"2023-10-18T17:24:04.250762+0000","last_peered":"2023-10-18T17:24:04.250762+0000","last_clean":"2023-10-18T17:24:04.250762+0000","last_became_active":"2023-10-18T17:24:04.239025+0000","last_became_peered":"2023-10-18T17:24:04.239025+0000","last_unstale":"2023-10-18T17:24:04.250762+0000","last_undegraded":"2023-10-18T17:24:04.250762+0000","last_fullsized":"2023-10-18T17:24:04.250762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230729+0000","last_change":"2023-10-18T17:24:03.750194+0000","last_active":"2023-10-18T17:24:04.230729+0000","last_peered":"2023-10-18T17:24:04.230729+0000","last_clean":"2023-10-18T17:24:04.230729+0000","last_became_active":"2023-10-18T17:24:03.749909+0000","last_became_peered":"2023-10-18T17:24:03.749909+0000","last_unstale":"2023-10-18T17:24:04.230729+0000","last_undegraded":"2023-10-18T17:24:04.230729+0000","last_fullsized":"2023-10-18T17:24:04.230729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.734261+0000","last_change":"2023-10-18T17:23:58.679941+0000","last_active":"2023-10-18T17:24:03.734261+0000","last_peered":"2023-10-18T17:24:03.734261+0000","last_clean":"2023-10-18T17:24:03.734261+0000","last_became_active":"2023-10-18T17:23:58.679210+0000","last_became_peered":"2023-10-18T17:23:58.679210+0000","last_unstale":"2023-10-18T17:24:03.734261+0000","last_undegraded":"2023-10-18T17:24:03.734261+0000","last_fullsized":"2023-10-18T17:24:03.734261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.256726+0000","last_change":"2023-10-18T17:24:04.252056+0000","last_active":"2023-10-18T17:24:04.256726+0000","last_peered":"2023-10-18T17:24:04.256726+0000","last_clean":"2023-10-18T17:24:04.256726+0000","last_became_active":"2023-10-18T17:24:04.251812+0000","last_became_peered":"2023-10-18T17:24:04.251812+0000","last_unstale":"2023-10-18T17:24:04.256726+0000","last_undegraded":"2023-10-18T17:24:04.256726+0000","last_fullsized":"2023-10-18T17:24:04.256726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.759888+0000","last_change":"2023-10-18T17:24:03.750606+0000","last_active":"2023-10-18T17:24:03.759888+0000","last_peered":"2023-10-18T17:24:03.759888+0000","last_clean":"2023-10-18T17:24:03.759888+0000","last_became_active":"2023-10-18T17:24:03.750308+0000","last_became_peered":"2023-10-18T17:24:03.750308+0000","last_unstale":"2023-10-18T17:24:03.759888+0000","last_undegraded":"2023-10-18T17:24:03.759888+0000","last_fullsized":"2023-10-18T17:24:03.759888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.727002+0000","last_change":"2023-10-18T17:23:58.683196+0000","last_active":"2023-10-18T17:24:03.727002+0000","last_peered":"2023-10-18T17:24:03.727002+0000","last_clean":"2023-10-18T17:24:03.727002+0000","last_became_active":"2023-10-18T17:23:58.682724+0000","last_became_peered":"2023-10-18T17:23:58.682724+0000","last_unstale":"2023-10-18T17:24:03.727002+0000","last_undegraded":"2023-10-18T17:24:03.727002+0000","last_fullsized":"2023-10-18T17:24:03.727002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.734425+0000","last_change":"2023-10-18T17:23:56.753692+0000","last_active":"2023-10-18T17:24:03.734425+0000","last_peered":"2023-10-18T17:24:03.734425+0000","last_clean":"2023-10-18T17:24:03.734425+0000","last_became_active":"2023-10-18T17:23:56.752884+0000","last_became_peered":"2023-10-18T17:23:56.752884+0000","last_unstale":"2023-10-18T17:24:03.734425+0000","last_undegraded":"2023-10-18T17:24:03.734425+0000","last_fullsized":"2023-10-18T17:24:03.734425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:55.617219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:55.617219+0000","last_clean_scrub_stamp":"2023-10-18T17:23:55.617219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.251396+0000","last_change":"2023-10-18T17:24:04.251396+0000","last_active":"2023-10-18T17:24:04.251396+0000","last_peered":"2023-10-18T17:24:04.251396+0000","last_clean":"2023-10-18T17:24:04.251396+0000","last_became_active":"2023-10-18T17:24:04.251099+0000","last_became_peered":"2023-10-18T17:24:04.251099+0000","last_unstale":"2023-10-18T17:24:04.251396+0000","last_undegraded":"2023-10-18T17:24:04.251396+0000","last_fullsized":"2023-10-18T17:24:04.251396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.759967+0000","last_change":"2023-10-18T17:24:03.749558+0000","last_active":"2023-10-18T17:24:03.759967+0000","last_peered":"2023-10-18T17:24:03.759967+0000","last_clean":"2023-10-18T17:24:03.759967+0000","last_became_active":"2023-10-18T17:24:03.749236+0000","last_became_peered":"2023-10-18T17:24:03.749236+0000","last_unstale":"2023-10-18T17:24:03.759967+0000","last_undegraded":"2023-10-18T17:24:03.759967+0000","last_fullsized":"2023-10-18T17:24:03.759967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.264438+0000","last_change":"2023-10-18T17:24:04.260098+0000","last_active":"2023-10-18T17:24:04.264438+0000","last_peered":"2023-10-18T17:24:04.264438+0000","last_clean":"2023-10-18T17:24:04.264438+0000","last_became_active":"2023-10-18T17:24:04.259824+0000","last_became_peered":"2023-10-18T17:24:04.259824+0000","last_unstale":"2023-10-18T17:24:04.264438+0000","last_undegraded":"2023-10-18T17:24:04.264438+0000","last_fullsized":"2023-10-18T17:24:04.264438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.748208+0000","last_change":"2023-10-18T17:24:03.744238+0000","last_active":"2023-10-18T17:24:03.748208+0000","last_peered":"2023-10-18T17:24:03.748208+0000","last_clean":"2023-10-18T17:24:03.748208+0000","last_became_active":"2023-10-18T17:24:03.743842+0000","last_became_peered":"2023-10-18T17:24:03.743842+0000","last_unstale":"2023-10-18T17:24:03.748208+0000","last_undegraded":"2023-10-18T17:24:03.748208+0000","last_fullsized":"2023-10-18T17:24:03.748208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.243386+0000","last_change":"2023-10-18T17:24:04.243386+0000","last_active":"2023-10-18T17:24:04.243386+0000","last_peered":"2023-10-18T17:24:04.243386+0000","last_clean":"2023-10-18T17:24:04.243386+0000","last_became_active":"2023-10-18T17:24:04.242822+0000","last_became_peered":"2023-10-18T17:24:04.242822+0000","last_unstale":"2023-10-18T17:24:04.243386+0000","last_undegraded":"2023-10-18T17:24:04.243386+0000","last_fullsized":"2023-10-18T17:24:04.243386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.752927+0000","last_change":"2023-10-18T17:24:03.749376+0000","last_active":"2023-10-18T17:24:03.752927+0000","last_peered":"2023-10-18T17:24:03.752927+0000","last_clean":"2023-10-18T17:24:03.752927+0000","last_became_active":"2023-10-18T17:24:03.749063+0000","last_became_peered":"2023-10-18T17:24:03.749063+0000","last_unstale":"2023-10-18T17:24:03.752927+0000","last_undegraded":"2023-10-18T17:24:03.752927+0000","last_fullsized":"2023-10-18T17:24:03.752927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.248670+0000","last_change":"2023-10-18T17:24:04.248670+0000","last_active":"2023-10-18T17:24:04.248670+0000","last_peered":"2023-10-18T17:24:04.248670+0000","last_clean":"2023-10-18T17:24:04.248670+0000","last_became_active":"2023-10-18T17:24:04.248116+0000","last_became_peered":"2023-10-18T17:24:04.248116+0000","last_unstale":"2023-10-18T17:24:04.248670+0000","last_undegraded":"2023-10-18T17:24:04.248670+0000","last_fullsized":"2023-10-18T17:24:04.248670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.761289+0000","last_change":"2023-10-18T17:24:03.756276+0000","last_active":"2023-10-18T17:24:03.761289+0000","last_peered":"2023-10-18T17:24:03.761289+0000","last_clean":"2023-10-18T17:24:03.761289+0000","last_became_active":"2023-10-18T17:24:03.755989+0000","last_became_peered":"2023-10-18T17:24:03.755989+0000","last_unstale":"2023-10-18T17:24:03.761289+0000","last_undegraded":"2023-10-18T17:24:03.761289+0000","last_fullsized":"2023-10-18T17:24:03.761289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.259017+0000","last_change":"2023-10-18T17:24:04.259017+0000","last_active":"2023-10-18T17:24:04.259017+0000","last_peered":"2023-10-18T17:24:04.259017+0000","last_clean":"2023-10-18T17:24:04.259017+0000","last_became_active":"2023-10-18T17:24:04.258654+0000","last_became_peered":"2023-10-18T17:24:04.258654+0000","last_unstale":"2023-10-18T17:24:04.259017+0000","last_undegraded":"2023-10-18T17:24:04.259017+0000","last_fullsized":"2023-10-18T17:24:04.259017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.764189+0000","last_change":"2023-10-18T17:24:03.761885+0000","last_active":"2023-10-18T17:24:03.764189+0000","last_peered":"2023-10-18T17:24:03.764189+0000","last_clean":"2023-10-18T17:24:03.764189+0000","last_became_active":"2023-10-18T17:24:03.761516+0000","last_became_peered":"2023-10-18T17:24:03.761516+0000","last_unstale":"2023-10-18T17:24:03.764189+0000","last_undegraded":"2023-10-18T17:24:03.764189+0000","last_fullsized":"2023-10-18T17:24:03.764189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.246649+0000","last_change":"2023-10-18T17:24:04.244813+0000","last_active":"2023-10-18T17:24:04.246649+0000","last_peered":"2023-10-18T17:24:04.246649+0000","last_clean":"2023-10-18T17:24:04.246649+0000","last_became_active":"2023-10-18T17:24:04.244199+0000","last_became_peered":"2023-10-18T17:24:04.244199+0000","last_unstale":"2023-10-18T17:24:04.246649+0000","last_undegraded":"2023-10-18T17:24:04.246649+0000","last_fullsized":"2023-10-18T17:24:04.246649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.752632+0000","last_change":"2023-10-18T17:24:03.751418+0000","last_active":"2023-10-18T17:24:03.752632+0000","last_peered":"2023-10-18T17:24:03.752632+0000","last_clean":"2023-10-18T17:24:03.752632+0000","last_became_active":"2023-10-18T17:24:03.751122+0000","last_became_peered":"2023-10-18T17:24:03.751122+0000","last_unstale":"2023-10-18T17:24:03.752632+0000","last_undegraded":"2023-10-18T17:24:03.752632+0000","last_fullsized":"2023-10-18T17:24:03.752632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250253+0000","last_change":"2023-10-18T17:24:04.250253+0000","last_active":"2023-10-18T17:24:04.250253+0000","last_peered":"2023-10-18T17:24:04.250253+0000","last_clean":"2023-10-18T17:24:04.250253+0000","last_became_active":"2023-10-18T17:24:04.249929+0000","last_became_peered":"2023-10-18T17:24:04.249929+0000","last_unstale":"2023-10-18T17:24:04.250253+0000","last_undegraded":"2023-10-18T17:24:04.250253+0000","last_fullsized":"2023-10-18T17:24:04.250253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.751768+0000","last_change":"2023-10-18T17:24:03.747106+0000","last_active":"2023-10-18T17:24:03.751768+0000","last_peered":"2023-10-18T17:24:03.751768+0000","last_clean":"2023-10-18T17:24:03.751768+0000","last_became_active":"2023-10-18T17:24:03.746799+0000","last_became_peered":"2023-10-18T17:24:03.746799+0000","last_unstale":"2023-10-18T17:24:03.751768+0000","last_undegraded":"2023-10-18T17:24:03.751768+0000","last_fullsized":"2023-10-18T17:24:03.751768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.243248+0000","last_change":"2023-10-18T17:24:04.243248+0000","last_active":"2023-10-18T17:24:04.243248+0000","last_peered":"2023-10-18T17:24:04.243248+0000","last_clean":"2023-10-18T17:24:04.243248+0000","last_became_active":"2023-10-18T17:24:04.242922+0000","last_became_peered":"2023-10-18T17:24:04.242922+0000","last_unstale":"2023-10-18T17:24:04.243248+0000","last_undegraded":"2023-10-18T17:24:04.243248+0000","last_fullsized":"2023-10-18T17:24:04.243248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.753996+0000","last_change":"2023-10-18T17:24:03.749039+0000","last_active":"2023-10-18T17:24:03.753996+0000","last_peered":"2023-10-18T17:24:03.753996+0000","last_clean":"2023-10-18T17:24:03.753996+0000","last_became_active":"2023-10-18T17:24:03.748569+0000","last_became_peered":"2023-10-18T17:24:03.748569+0000","last_unstale":"2023-10-18T17:24:03.753996+0000","last_undegraded":"2023-10-18T17:24:03.753996+0000","last_fullsized":"2023-10-18T17:24:03.753996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.241433+0000","last_change":"2023-10-18T17:24:04.241433+0000","last_active":"2023-10-18T17:24:04.241433+0000","last_peered":"2023-10-18T17:24:04.241433+0000","last_clean":"2023-10-18T17:24:04.241433+0000","last_became_active":"2023-10-18T17:24:04.241106+0000","last_became_peered":"2023-10-18T17:24:04.241106+0000","last_unstale":"2023-10-18T17:24:04.241433+0000","last_undegraded":"2023-10-18T17:24:04.241433+0000","last_fullsized":"2023-10-18T17:24:04.241433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.755596+0000","last_change":"2023-10-18T17:24:03.754340+0000","last_active":"2023-10-18T17:24:03.755596+0000","last_peered":"2023-10-18T17:24:03.755596+0000","last_clean":"2023-10-18T17:24:03.755596+0000","last_became_active":"2023-10-18T17:24:03.753704+0000","last_became_peered":"2023-10-18T17:24:03.753704+0000","last_unstale":"2023-10-18T17:24:03.755596+0000","last_undegraded":"2023-10-18T17:24:03.755596+0000","last_fullsized":"2023-10-18T17:24:03.755596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253968+0000","last_change":"2023-10-18T17:24:04.253968+0000","last_active":"2023-10-18T17:24:04.253968+0000","last_peered":"2023-10-18T17:24:04.253968+0000","last_clean":"2023-10-18T17:24:04.253968+0000","last_became_active":"2023-10-18T17:24:04.253657+0000","last_became_peered":"2023-10-18T17:24:04.253657+0000","last_unstale":"2023-10-18T17:24:04.253968+0000","last_undegraded":"2023-10-18T17:24:04.253968+0000","last_fullsized":"2023-10-18T17:24:04.253968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.751701+0000","last_change":"2023-10-18T17:24:03.747407+0000","last_active":"2023-10-18T17:24:03.751701+0000","last_peered":"2023-10-18T17:24:03.751701+0000","last_clean":"2023-10-18T17:24:03.751701+0000","last_became_active":"2023-10-18T17:24:03.746910+0000","last_became_peered":"2023-10-18T17:24:03.746910+0000","last_unstale":"2023-10-18T17:24:03.751701+0000","last_undegraded":"2023-10-18T17:24:03.751701+0000","last_fullsized":"2023-10-18T17:24:03.751701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.256873+0000","last_change":"2023-10-18T17:24:04.253275+0000","last_active":"2023-10-18T17:24:04.256873+0000","last_peered":"2023-10-18T17:24:04.256873+0000","last_clean":"2023-10-18T17:24:04.256873+0000","last_became_active":"2023-10-18T17:24:04.252982+0000","last_became_peered":"2023-10-18T17:24:04.252982+0000","last_unstale":"2023-10-18T17:24:04.256873+0000","last_undegraded":"2023-10-18T17:24:04.256873+0000","last_fullsized":"2023-10-18T17:24:04.256873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230811+0000","last_change":"2023-10-18T17:24:03.741950+0000","last_active":"2023-10-18T17:24:04.230811+0000","last_peered":"2023-10-18T17:24:04.230811+0000","last_clean":"2023-10-18T17:24:04.230811+0000","last_became_active":"2023-10-18T17:24:03.740801+0000","last_became_peered":"2023-10-18T17:24:03.740801+0000","last_unstale":"2023-10-18T17:24:04.230811+0000","last_undegraded":"2023-10-18T17:24:04.230811+0000","last_fullsized":"2023-10-18T17:24:04.230811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.243107+0000","last_change":"2023-10-18T17:24:04.243107+0000","last_active":"2023-10-18T17:24:04.243107+0000","last_peered":"2023-10-18T17:24:04.243107+0000","last_clean":"2023-10-18T17:24:04.243107+0000","last_became_active":"2023-10-18T17:24:04.242584+0000","last_became_peered":"2023-10-18T17:24:04.242584+0000","last_unstale":"2023-10-18T17:24:04.243107+0000","last_undegraded":"2023-10-18T17:24:04.243107+0000","last_fullsized":"2023-10-18T17:24:04.243107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.751781+0000","last_change":"2023-10-18T17:24:03.747950+0000","last_active":"2023-10-18T17:24:03.751781+0000","last_peered":"2023-10-18T17:24:03.751781+0000","last_clean":"2023-10-18T17:24:03.751781+0000","last_became_active":"2023-10-18T17:24:03.747647+0000","last_became_peered":"2023-10-18T17:24:03.747647+0000","last_unstale":"2023-10-18T17:24:03.751781+0000","last_undegraded":"2023-10-18T17:24:03.751781+0000","last_fullsized":"2023-10-18T17:24:03.751781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258930+0000","last_change":"2023-10-18T17:24:04.258930+0000","last_active":"2023-10-18T17:24:04.258930+0000","last_peered":"2023-10-18T17:24:04.258930+0000","last_clean":"2023-10-18T17:24:04.258930+0000","last_became_active":"2023-10-18T17:24:04.258630+0000","last_became_peered":"2023-10-18T17:24:04.258630+0000","last_unstale":"2023-10-18T17:24:04.258930+0000","last_undegraded":"2023-10-18T17:24:04.258930+0000","last_fullsized":"2023-10-18T17:24:04.258930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230691+0000","last_change":"2023-10-18T17:24:03.755043+0000","last_active":"2023-10-18T17:24:04.230691+0000","last_peered":"2023-10-18T17:24:04.230691+0000","last_clean":"2023-10-18T17:24:04.230691+0000","last_became_active":"2023-10-18T17:24:03.754677+0000","last_became_peered":"2023-10-18T17:24:03.754677+0000","last_unstale":"2023-10-18T17:24:04.230691+0000","last_undegraded":"2023-10-18T17:24:04.230691+0000","last_fullsized":"2023-10-18T17:24:04.230691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.249183+0000","last_change":"2023-10-18T17:24:04.249183+0000","last_active":"2023-10-18T17:24:04.249183+0000","last_peered":"2023-10-18T17:24:04.249183+0000","last_clean":"2023-10-18T17:24:04.249183+0000","last_became_active":"2023-10-18T17:24:04.248236+0000","last_became_peered":"2023-10-18T17:24:04.248236+0000","last_unstale":"2023-10-18T17:24:04.249183+0000","last_undegraded":"2023-10-18T17:24:04.249183+0000","last_fullsized":"2023-10-18T17:24:04.249183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.763804+0000","last_change":"2023-10-18T17:24:03.761178+0000","last_active":"2023-10-18T17:24:03.763804+0000","last_peered":"2023-10-18T17:24:03.763804+0000","last_clean":"2023-10-18T17:24:03.763804+0000","last_became_active":"2023-10-18T17:24:03.760202+0000","last_became_peered":"2023-10-18T17:24:03.760202+0000","last_unstale":"2023-10-18T17:24:03.763804+0000","last_undegraded":"2023-10-18T17:24:03.763804+0000","last_fullsized":"2023-10-18T17:24:03.763804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.252873+0000","last_change":"2023-10-18T17:24:04.248750+0000","last_active":"2023-10-18T17:24:04.252873+0000","last_peered":"2023-10-18T17:24:04.252873+0000","last_clean":"2023-10-18T17:24:04.252873+0000","last_became_active":"2023-10-18T17:24:04.248498+0000","last_became_peered":"2023-10-18T17:24:04.248498+0000","last_unstale":"2023-10-18T17:24:04.252873+0000","last_undegraded":"2023-10-18T17:24:04.252873+0000","last_fullsized":"2023-10-18T17:24:04.252873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.751798+0000","last_change":"2023-10-18T17:24:03.748064+0000","last_active":"2023-10-18T17:24:03.751798+0000","last_peered":"2023-10-18T17:24:03.751798+0000","last_clean":"2023-10-18T17:24:03.751798+0000","last_became_active":"2023-10-18T17:24:03.747784+0000","last_became_peered":"2023-10-18T17:24:03.747784+0000","last_unstale":"2023-10-18T17:24:03.751798+0000","last_undegraded":"2023-10-18T17:24:03.751798+0000","last_fullsized":"2023-10-18T17:24:03.751798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.260398+0000","last_change":"2023-10-18T17:24:04.257096+0000","last_active":"2023-10-18T17:24:04.260398+0000","last_peered":"2023-10-18T17:24:04.260398+0000","last_clean":"2023-10-18T17:24:04.260398+0000","last_became_active":"2023-10-18T17:24:04.256815+0000","last_became_peered":"2023-10-18T17:24:04.256815+0000","last_unstale":"2023-10-18T17:24:04.260398+0000","last_undegraded":"2023-10-18T17:24:04.260398+0000","last_fullsized":"2023-10-18T17:24:04.260398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.753506+0000","last_change":"2023-10-18T17:24:03.751468+0000","last_active":"2023-10-18T17:24:03.753506+0000","last_peered":"2023-10-18T17:24:03.753506+0000","last_clean":"2023-10-18T17:24:03.753506+0000","last_became_active":"2023-10-18T17:24:03.751166+0000","last_became_peered":"2023-10-18T17:24:03.751166+0000","last_unstale":"2023-10-18T17:24:03.753506+0000","last_undegraded":"2023-10-18T17:24:03.753506+0000","last_fullsized":"2023-10-18T17:24:03.753506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.242079+0000","last_change":"2023-10-18T17:24:04.242079+0000","last_active":"2023-10-18T17:24:04.242079+0000","last_peered":"2023-10-18T17:24:04.242079+0000","last_clean":"2023-10-18T17:24:04.242079+0000","last_became_active":"2023-10-18T17:24:04.241342+0000","last_became_peered":"2023-10-18T17:24:04.241342+0000","last_unstale":"2023-10-18T17:24:04.242079+0000","last_undegraded":"2023-10-18T17:24:04.242079+0000","last_fullsized":"2023-10-18T17:24:04.242079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.753450+0000","last_change":"2023-10-18T17:24:03.751419+0000","last_active":"2023-10-18T17:24:03.753450+0000","last_peered":"2023-10-18T17:24:03.753450+0000","last_clean":"2023-10-18T17:24:03.753450+0000","last_became_active":"2023-10-18T17:24:03.751118+0000","last_became_peered":"2023-10-18T17:24:03.751118+0000","last_unstale":"2023-10-18T17:24:03.753450+0000","last_undegraded":"2023-10-18T17:24:03.753450+0000","last_fullsized":"2023-10-18T17:24:03.753450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250969+0000","last_change":"2023-10-18T17:24:04.250969+0000","last_active":"2023-10-18T17:24:04.250969+0000","last_peered":"2023-10-18T17:24:04.250969+0000","last_clean":"2023-10-18T17:24:04.250969+0000","last_became_active":"2023-10-18T17:24:04.250659+0000","last_became_peered":"2023-10-18T17:24:04.250659+0000","last_unstale":"2023-10-18T17:24:04.250969+0000","last_undegraded":"2023-10-18T17:24:04.250969+0000","last_fullsized":"2023-10-18T17:24:04.250969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.755254+0000","last_change":"2023-10-18T17:24:03.752559+0000","last_active":"2023-10-18T17:24:03.755254+0000","last_peered":"2023-10-18T17:24:03.755254+0000","last_clean":"2023-10-18T17:24:03.755254+0000","last_became_active":"2023-10-18T17:24:03.752277+0000","last_became_peered":"2023-10-18T17:24:03.752277+0000","last_unstale":"2023-10-18T17:24:03.755254+0000","last_undegraded":"2023-10-18T17:24:03.755254+0000","last_fullsized":"2023-10-18T17:24:03.755254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.248464+0000","last_change":"2023-10-18T17:24:04.248464+0000","last_active":"2023-10-18T17:24:04.248464+0000","last_peered":"2023-10-18T17:24:04.248464+0000","last_clean":"2023-10-18T17:24:04.248464+0000","last_became_active":"2023-10-18T17:24:04.248166+0000","last_became_peered":"2023-10-18T17:24:04.248166+0000","last_unstale":"2023-10-18T17:24:04.248464+0000","last_undegraded":"2023-10-18T17:24:04.248464+0000","last_fullsized":"2023-10-18T17:24:04.248464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.263341+0000","last_change":"2023-10-18T17:24:04.261758+0000","last_active":"2023-10-18T17:24:04.263341+0000","last_peered":"2023-10-18T17:24:04.263341+0000","last_clean":"2023-10-18T17:24:04.263341+0000","last_became_active":"2023-10-18T17:24:04.259803+0000","last_became_peered":"2023-10-18T17:24:04.259803+0000","last_unstale":"2023-10-18T17:24:04.263341+0000","last_undegraded":"2023-10-18T17:24:04.263341+0000","last_fullsized":"2023-10-18T17:24:04.263341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.763445+0000","last_change":"2023-10-18T17:24:03.760642+0000","last_active":"2023-10-18T17:24:03.763445+0000","last_peered":"2023-10-18T17:24:03.763445+0000","last_clean":"2023-10-18T17:24:03.763445+0000","last_became_active":"2023-10-18T17:24:03.759676+0000","last_became_peered":"2023-10-18T17:24:03.759676+0000","last_unstale":"2023-10-18T17:24:03.763445+0000","last_undegraded":"2023-10-18T17:24:03.763445+0000","last_fullsized":"2023-10-18T17:24:03.763445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.239822+0000","last_change":"2023-10-18T17:24:04.239822+0000","last_active":"2023-10-18T17:24:04.239822+0000","last_peered":"2023-10-18T17:24:04.239822+0000","last_clean":"2023-10-18T17:24:04.239822+0000","last_became_active":"2023-10-18T17:24:04.239546+0000","last_became_peered":"2023-10-18T17:24:04.239546+0000","last_unstale":"2023-10-18T17:24:04.239822+0000","last_undegraded":"2023-10-18T17:24:04.239822+0000","last_fullsized":"2023-10-18T17:24:04.239822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.755219+0000","last_change":"2023-10-18T17:24:03.753621+0000","last_active":"2023-10-18T17:24:03.755219+0000","last_peered":"2023-10-18T17:24:03.755219+0000","last_clean":"2023-10-18T17:24:03.755219+0000","last_became_active":"2023-10-18T17:24:03.753297+0000","last_became_peered":"2023-10-18T17:24:03.753297+0000","last_unstale":"2023-10-18T17:24:03.755219+0000","last_undegraded":"2023-10-18T17:24:03.755219+0000","last_fullsized":"2023-10-18T17:24:03.755219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.249371+0000","last_change":"2023-10-18T17:24:04.249371+0000","last_active":"2023-10-18T17:24:04.249371+0000","last_peered":"2023-10-18T17:24:04.249371+0000","last_clean":"2023-10-18T17:24:04.249371+0000","last_became_active":"2023-10-18T17:24:04.248843+0000","last_became_peered":"2023-10-18T17:24:04.248843+0000","last_unstale":"2023-10-18T17:24:04.249371+0000","last_undegraded":"2023-10-18T17:24:04.249371+0000","last_fullsized":"2023-10-18T17:24:04.249371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.754443+0000","last_change":"2023-10-18T17:24:03.749421+0000","last_active":"2023-10-18T17:24:03.754443+0000","last_peered":"2023-10-18T17:24:03.754443+0000","last_clean":"2023-10-18T17:24:03.754443+0000","last_became_active":"2023-10-18T17:24:03.749120+0000","last_became_peered":"2023-10-18T17:24:03.749120+0000","last_unstale":"2023-10-18T17:24:03.754443+0000","last_undegraded":"2023-10-18T17:24:03.754443+0000","last_fullsized":"2023-10-18T17:24:03.754443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.239958+0000","last_change":"2023-10-18T17:24:04.239958+0000","last_active":"2023-10-18T17:24:04.239958+0000","last_peered":"2023-10-18T17:24:04.239958+0000","last_clean":"2023-10-18T17:24:04.239958+0000","last_became_active":"2023-10-18T17:24:04.239673+0000","last_became_peered":"2023-10-18T17:24:04.239673+0000","last_unstale":"2023-10-18T17:24:04.239958+0000","last_undegraded":"2023-10-18T17:24:04.239958+0000","last_fullsized":"2023-10-18T17:24:04.239958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.751495+0000","last_change":"2023-10-18T17:24:03.745601+0000","last_active":"2023-10-18T17:24:03.751495+0000","last_peered":"2023-10-18T17:24:03.751495+0000","last_clean":"2023-10-18T17:24:03.751495+0000","last_became_active":"2023-10-18T17:24:03.745287+0000","last_became_peered":"2023-10-18T17:24:03.745287+0000","last_unstale":"2023-10-18T17:24:03.751495+0000","last_undegraded":"2023-10-18T17:24:03.751495+0000","last_fullsized":"2023-10-18T17:24:03.751495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.261032+0000","last_change":"2023-10-18T17:24:04.259706+0000","last_active":"2023-10-18T17:24:04.261032+0000","last_peered":"2023-10-18T17:24:04.261032+0000","last_clean":"2023-10-18T17:24:04.261032+0000","last_became_active":"2023-10-18T17:24:04.259232+0000","last_became_peered":"2023-10-18T17:24:04.259232+0000","last_unstale":"2023-10-18T17:24:04.261032+0000","last_undegraded":"2023-10-18T17:24:04.261032+0000","last_fullsized":"2023-10-18T17:24:04.261032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.762063+0000","last_change":"2023-10-18T17:24:03.760958+0000","last_active":"2023-10-18T17:24:03.762063+0000","last_peered":"2023-10-18T17:24:03.762063+0000","last_clean":"2023-10-18T17:24:03.762063+0000","last_became_active":"2023-10-18T17:24:03.760640+0000","last_became_peered":"2023-10-18T17:24:03.760640+0000","last_unstale":"2023-10-18T17:24:03.762063+0000","last_undegraded":"2023-10-18T17:24:03.762063+0000","last_fullsized":"2023-10-18T17:24:03.762063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.243907+0000","last_change":"2023-10-18T17:24:04.243907+0000","last_active":"2023-10-18T17:24:04.243907+0000","last_peered":"2023-10-18T17:24:04.243907+0000","last_clean":"2023-10-18T17:24:04.243907+0000","last_became_active":"2023-10-18T17:24:04.243296+0000","last_became_peered":"2023-10-18T17:24:04.243296+0000","last_unstale":"2023-10-18T17:24:04.243907+0000","last_undegraded":"2023-10-18T17:24:04.243907+0000","last_fullsized":"2023-10-18T17:24:04.243907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230713+0000","last_change":"2023-10-18T17:24:03.745470+0000","last_active":"2023-10-18T17:24:04.230713+0000","last_peered":"2023-10-18T17:24:04.230713+0000","last_clean":"2023-10-18T17:24:04.230713+0000","last_became_active":"2023-10-18T17:24:03.744361+0000","last_became_peered":"2023-10-18T17:24:03.744361+0000","last_unstale":"2023-10-18T17:24:04.230713+0000","last_undegraded":"2023-10-18T17:24:04.230713+0000","last_fullsized":"2023-10-18T17:24:04.230713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.244429+0000","last_change":"2023-10-18T17:24:04.244429+0000","last_active":"2023-10-18T17:24:04.244429+0000","last_peered":"2023-10-18T17:24:04.244429+0000","last_clean":"2023-10-18T17:24:04.244429+0000","last_became_active":"2023-10-18T17:24:04.244106+0000","last_became_peered":"2023-10-18T17:24:04.244106+0000","last_unstale":"2023-10-18T17:24:04.244429+0000","last_undegraded":"2023-10-18T17:24:04.244429+0000","last_fullsized":"2023-10-18T17:24:04.244429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.228250+0000","last_change":"2023-10-18T17:24:03.748814+0000","last_active":"2023-10-18T17:24:04.228250+0000","last_peered":"2023-10-18T17:24:04.228250+0000","last_clean":"2023-10-18T17:24:04.228250+0000","last_became_active":"2023-10-18T17:24:03.748507+0000","last_became_peered":"2023-10-18T17:24:03.748507+0000","last_unstale":"2023-10-18T17:24:04.228250+0000","last_undegraded":"2023-10-18T17:24:04.228250+0000","last_fullsized":"2023-10-18T17:24:04.228250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.249830+0000","last_change":"2023-10-18T17:24:04.249830+0000","last_active":"2023-10-18T17:24:04.249830+0000","last_peered":"2023-10-18T17:24:04.249830+0000","last_clean":"2023-10-18T17:24:04.249830+0000","last_became_active":"2023-10-18T17:24:04.249500+0000","last_became_peered":"2023-10-18T17:24:04.249500+0000","last_unstale":"2023-10-18T17:24:04.249830+0000","last_undegraded":"2023-10-18T17:24:04.249830+0000","last_fullsized":"2023-10-18T17:24:04.249830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.753979+0000","last_change":"2023-10-18T17:24:03.748849+0000","last_active":"2023-10-18T17:24:03.753979+0000","last_peered":"2023-10-18T17:24:03.753979+0000","last_clean":"2023-10-18T17:24:03.753979+0000","last_became_active":"2023-10-18T17:24:03.748240+0000","last_became_peered":"2023-10-18T17:24:03.748240+0000","last_unstale":"2023-10-18T17:24:03.753979+0000","last_undegraded":"2023-10-18T17:24:03.753979+0000","last_fullsized":"2023-10-18T17:24:03.753979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297288,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074552,"statfs":{"total":96636764160,"available":96332341248,"internally_reserved":0,"allocated":196608,"data_stored":70373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297288,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074552,"statfs":{"total":96636764160,"available":96332341248,"internally_reserved":0,"allocated":196608,"data_stored":70373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297292,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074548,"statfs":{"total":96636764160,"available":96332337152,"internally_reserved":0,"allocated":200704,"data_stored":71334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297292,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074548,"statfs":{"total":96636764160,"available":96332337152,"internally_reserved":0,"allocated":200704,"data_stored":71334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297300,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074540,"statfs":{"total":96636764160,"available":96332328960,"internally_reserved":0,"allocated":208896,"data_stored":77552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T17:24:10.487 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T17:24:10.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.687+0000 7ff39c968700 1 Processor -- start 2023-10-18T17:24:10.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.687+0000 7ff39c968700 1 -- start start 2023-10-18T17:24:10.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.687+0000 7ff39c968700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff39814d730 0x7ff398062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:10.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.687+0000 7ff39c968700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3980c1610 con 0x7ff398066340 2023-10-18T17:24:10.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.687+0000 7ff39c968700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3980c2dd0 con 0x7ff398062270 2023-10-18T17:24:10.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.687+0000 7ff39c968700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff398153570 con 0x7ff39814d730 2023-10-18T17:24:10.696 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.687+0000 7ff39759e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff39814d730 0x7ff398062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:10.696 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.687+0000 7ff39659c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7ff398066340 0x7ff39814d020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:38588/0 (socket says 172.21.15.158:38588) 2023-10-18T17:24:10.697 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.687+0000 7ff39659c700 1 -- 172.21.15.158:0/3010012894 learned_addr learned my addr 172.21.15.158:0/3010012894 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:10.697 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.691+0000 7ff395d9b700 1 -- 172.21.15.158:0/3010012894 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170125860 0 0) 0x7ff3980c1610 con 0x7ff398066340 2023-10-18T17:24:10.697 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.691+0000 7ff395d9b700 1 -- 172.21.15.158:0/3010012894 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3800033f0 con 0x7ff398066340 2023-10-18T17:24:10.697 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.691+0000 7ff395d9b700 1 -- 172.21.15.158:0/3010012894 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928460880 0 0) 0x7ff3980c2dd0 con 0x7ff398062270 2023-10-18T17:24:10.697 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.691+0000 7ff39759e700 1 -- 172.21.15.158:0/3010012894 >> v1:172.21.15.183:6789/0 conn(0x7ff398062270 legacy=0x7ff3980c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:10.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.691+0000 7ff39759e700 1 -- 172.21.15.158:0/3010012894 >> v1:172.21.15.158:6789/0 conn(0x7ff398066340 legacy=0x7ff39814d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:10.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.691+0000 7ff39759e700 1 -- 172.21.15.158:0/3010012894 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff398153850 con 0x7ff39814d730 2023-10-18T17:24:10.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.691+0000 7ff39759e700 1 --2- 172.21.15.158:0/3010012894 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff39814d730 0x7ff398062650 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ff390009e60 tx=0x7ff390009780).ready entity=mon.0 client_cookie=e544f34f8e73c0ca server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:10.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.691+0000 7ff395d9b700 1 -- 172.21.15.158:0/3010012894 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39000e070 con 0x7ff39814d730 2023-10-18T17:24:10.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.691+0000 7ff395d9b700 1 -- 172.21.15.158:0/3010012894 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39000bbf0 con 0x7ff39814d730 2023-10-18T17:24:10.700 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.691+0000 7ff395d9b700 1 -- 172.21.15.158:0/3010012894 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390012410 con 0x7ff39814d730 2023-10-18T17:24:10.700 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.691+0000 7ff39c968700 1 -- 172.21.15.158:0/3010012894 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff39814d730 msgr2=0x7ff398062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:10.700 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.691+0000 7ff39c968700 1 --2- 172.21.15.158:0/3010012894 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff39814d730 0x7ff398062650 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ff390009e60 tx=0x7ff390009780).stop 2023-10-18T17:24:10.700 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.691+0000 7ff39c968700 1 -- 172.21.15.158:0/3010012894 shutdown_connections 2023-10-18T17:24:10.700 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.691+0000 7ff39c968700 1 --2- 172.21.15.158:0/3010012894 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff39814d730 0x7ff398062650 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.691+0000 7ff39c968700 1 -- 172.21.15.158:0/3010012894 >> 172.21.15.158:0/3010012894 conn(0x7ff39805ddc0 msgr2=0x7ff39805e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:10.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.691+0000 7ff39c968700 1 -- 172.21.15.158:0/3010012894 shutdown_connections 2023-10-18T17:24:10.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.691+0000 7ff39c968700 1 -- 172.21.15.158:0/3010012894 wait complete. 2023-10-18T17:24:10.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff39c968700 1 Processor -- start 2023-10-18T17:24:10.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff39c968700 1 -- start start 2023-10-18T17:24:10.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff39c968700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff398062270 0x7ff3980c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:10.703 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff39c968700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff398066340 0x7ff398163040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:10.703 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff39c968700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff39814d730 0x7ff3980c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:10.703 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff39c968700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39814f370 con 0x7ff39814d730 2023-10-18T17:24:10.703 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff39c968700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3980c5040 con 0x7ff398062270 2023-10-18T17:24:10.703 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff39c968700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3980c4a80 con 0x7ff398066340 2023-10-18T17:24:10.704 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff396d9d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff398062270 0x7ff3980c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:10.704 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff39759e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff39814d730 0x7ff3980c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:10.704 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff396d9d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff398062270 0x7ff3980c4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:43626/0 (socket says 172.21.15.158:43626) 2023-10-18T17:24:10.704 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff396d9d700 1 -- 172.21.15.158:0/2728197280 learned_addr learned my addr 172.21.15.158:0/2728197280 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:10.704 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff39659c700 1 --2- 172.21.15.158:0/2728197280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff398066340 0x7ff398163040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:10.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff396d9d700 1 -- 172.21.15.158:0/2728197280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff398066340 msgr2=0x7ff398163040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:10.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff396d9d700 1 --2- 172.21.15.158:0/2728197280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff398066340 0x7ff398163040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff396d9d700 1 -- 172.21.15.158:0/2728197280 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff39814d730 msgr2=0x7ff3980c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:10.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff396d9d700 1 --2- 172.21.15.158:0/2728197280 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff39814d730 0x7ff3980c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff396d9d700 1 -- 172.21.15.158:0/2728197280 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff390009a20 con 0x7ff398062270 2023-10-18T17:24:10.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff39759e700 1 --2- 172.21.15.158:0/2728197280 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff39814d730 0x7ff3980c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:10.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff396d9d700 1 --2- 172.21.15.158:0/2728197280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff398062270 0x7ff3980c4460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ff388001eb0 tx=0x7ff388007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:10.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff37effd700 1 -- 172.21.15.158:0/2728197280 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38800ce60 con 0x7ff398062270 2023-10-18T17:24:10.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff37effd700 1 -- 172.21.15.158:0/2728197280 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38800f470 con 0x7ff398062270 2023-10-18T17:24:10.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff39c968700 1 -- 172.21.15.158:0/2728197280 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3980c4d60 con 0x7ff398062270 2023-10-18T17:24:10.708 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.695+0000 7ff37effd700 1 -- 172.21.15.158:0/2728197280 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38800f810 con 0x7ff398062270 2023-10-18T17:24:10.708 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.699+0000 7ff39c968700 1 -- 172.21.15.158:0/2728197280 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3980c58c0 con 0x7ff398062270 2023-10-18T17:24:10.708 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.699+0000 7ff39c968700 1 -- 172.21.15.158:0/2728197280 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff39814a170 con 0x7ff398062270 2023-10-18T17:24:10.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.699+0000 7ff37effd700 1 -- 172.21.15.158:0/2728197280 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff38800fb80 con 0x7ff398062270 2023-10-18T17:24:10.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.703+0000 7ff37effd700 1 --2- 172.21.15.158:0/2728197280 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff38405a510 0x7ff38405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:10.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.703+0000 7ff37effd700 1 -- 172.21.15.158:0/2728197280 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff388073d50 con 0x7ff398062270 2023-10-18T17:24:10.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.703+0000 7ff39659c700 1 --2- 172.21.15.158:0/2728197280 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff38405a510 0x7ff38405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:10.710 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.703+0000 7ff39659c700 1 --2- 172.21.15.158:0/2728197280 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff38405a510 0x7ff38405c9d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff39814aeb0 tx=0x7ff38c009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:10.718 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.711+0000 7ff37effd700 1 -- 172.21.15.158:0/2728197280 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7ff388077030 con 0x7ff398062270 2023-10-18T17:24:10.875 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.867+0000 7ff39c968700 1 -- 172.21.15.158:0/2728197280 --> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff398046f00 con 0x7ff38405a510 2023-10-18T17:24:10.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.891+0000 7ff37effd700 1 -- 172.21.15.158:0/2728197280 <== mgr.4100 v2:172.21.15.183:6832/33555 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336271 (secure 0 0 0) 0x7ff398046f00 con 0x7ff38405a510 2023-10-18T17:24:10.902 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:10.906 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.899+0000 7ff39c968700 1 -- 172.21.15.158:0/2728197280 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff38405a510 msgr2=0x7ff38405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:10.907 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.899+0000 7ff39c968700 1 --2- 172.21.15.158:0/2728197280 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff38405a510 0x7ff38405c9d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff39814aeb0 tx=0x7ff38c009040).stop 2023-10-18T17:24:10.907 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.899+0000 7ff39c968700 1 -- 172.21.15.158:0/2728197280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff398062270 msgr2=0x7ff3980c4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:10.907 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.899+0000 7ff39c968700 1 --2- 172.21.15.158:0/2728197280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff398062270 0x7ff3980c4460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ff388001eb0 tx=0x7ff388007c70).stop 2023-10-18T17:24:10.907 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.899+0000 7ff39c968700 1 -- 172.21.15.158:0/2728197280 shutdown_connections 2023-10-18T17:24:10.907 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.899+0000 7ff39c968700 1 --2- 172.21.15.158:0/2728197280 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff38405a510 0x7ff38405c9d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.908 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.899+0000 7ff39c968700 1 --2- 172.21.15.158:0/2728197280 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff39814d730 0x7ff3980c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.908 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.899+0000 7ff39c968700 1 --2- 172.21.15.158:0/2728197280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff398066340 0x7ff398163040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.908 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.899+0000 7ff39c968700 1 --2- 172.21.15.158:0/2728197280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff398062270 0x7ff3980c4460 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:10.908 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.899+0000 7ff39c968700 1 -- 172.21.15.158:0/2728197280 >> 172.21.15.158:0/2728197280 conn(0x7ff39805ddc0 msgr2=0x7ff3980bfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:10.908 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.899+0000 7ff39c968700 1 -- 172.21.15.158:0/2728197280 shutdown_connections 2023-10-18T17:24:10.908 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:10.899+0000 7ff39c968700 1 -- 172.21.15.158:0/2728197280 wait complete. 2023-10-18T17:24:10.909 INFO:teuthology.orchestra.run.smithi158.stderr:dumped all 2023-10-18T17:24:10.927 INFO:teuthology.orchestra.run.smithi158.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-18T17:24:09.488964+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378408,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596312,"statfs":{"total":773094113280,"available":770658623488,"internally_reserved":0,"allocated":1679360,"data_stored":616617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.239274+0000","last_change":"2023-10-18T17:24:04.239274+0000","last_active":"2023-10-18T17:24:04.239274+0000","last_peered":"2023-10-18T17:24:04.239274+0000","last_clean":"2023-10-18T17:24:04.239274+0000","last_became_active":"2023-10-18T17:24:04.238910+0000","last_became_peered":"2023-10-18T17:24:04.238910+0000","last_unstale":"2023-10-18T17:24:04.239274+0000","last_undegraded":"2023-10-18T17:24:04.239274+0000","last_fullsized":"2023-10-18T17:24:04.239274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.226011+0000","last_change":"2023-10-18T17:24:03.748169+0000","last_active":"2023-10-18T17:24:04.226011+0000","last_peered":"2023-10-18T17:24:04.226011+0000","last_clean":"2023-10-18T17:24:04.226011+0000","last_became_active":"2023-10-18T17:24:03.747891+0000","last_became_peered":"2023-10-18T17:24:03.747891+0000","last_unstale":"2023-10-18T17:24:04.226011+0000","last_undegraded":"2023-10-18T17:24:04.226011+0000","last_fullsized":"2023-10-18T17:24:04.226011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.260959+0000","last_change":"2023-10-18T17:24:04.259514+0000","last_active":"2023-10-18T17:24:04.260959+0000","last_peered":"2023-10-18T17:24:04.260959+0000","last_clean":"2023-10-18T17:24:04.260959+0000","last_became_active":"2023-10-18T17:24:04.253467+0000","last_became_peered":"2023-10-18T17:24:04.253467+0000","last_unstale":"2023-10-18T17:24:04.260959+0000","last_undegraded":"2023-10-18T17:24:04.260959+0000","last_fullsized":"2023-10-18T17:24:04.260959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.754449+0000","last_change":"2023-10-18T17:24:03.746790+0000","last_active":"2023-10-18T17:24:03.754449+0000","last_peered":"2023-10-18T17:24:03.754449+0000","last_clean":"2023-10-18T17:24:03.754449+0000","last_became_active":"2023-10-18T17:24:03.746453+0000","last_became_peered":"2023-10-18T17:24:03.746453+0000","last_unstale":"2023-10-18T17:24:03.754449+0000","last_undegraded":"2023-10-18T17:24:03.754449+0000","last_fullsized":"2023-10-18T17:24:03.754449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.750666+0000","last_change":"2023-10-18T17:24:03.741477+0000","last_active":"2023-10-18T17:24:03.750666+0000","last_peered":"2023-10-18T17:24:03.750666+0000","last_clean":"2023-10-18T17:24:03.750666+0000","last_became_active":"2023-10-18T17:24:03.741171+0000","last_became_peered":"2023-10-18T17:24:03.741171+0000","last_unstale":"2023-10-18T17:24:03.750666+0000","last_undegraded":"2023-10-18T17:24:03.750666+0000","last_fullsized":"2023-10-18T17:24:03.750666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.267322+0000","last_change":"2023-10-18T17:24:04.267322+0000","last_active":"2023-10-18T17:24:04.267322+0000","last_peered":"2023-10-18T17:24:04.267322+0000","last_clean":"2023-10-18T17:24:04.267322+0000","last_became_active":"2023-10-18T17:24:04.266792+0000","last_became_peered":"2023-10-18T17:24:04.266792+0000","last_unstale":"2023-10-18T17:24:04.267322+0000","last_undegraded":"2023-10-18T17:24:04.267322+0000","last_fullsized":"2023-10-18T17:24:04.267322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.244754+0000","last_change":"2023-10-18T17:24:03.740595+0000","last_active":"2023-10-18T17:24:04.244754+0000","last_peered":"2023-10-18T17:24:04.244754+0000","last_clean":"2023-10-18T17:24:04.244754+0000","last_became_active":"2023-10-18T17:24:03.738983+0000","last_became_peered":"2023-10-18T17:24:03.738983+0000","last_unstale":"2023-10-18T17:24:04.244754+0000","last_undegraded":"2023-10-18T17:24:04.244754+0000","last_fullsized":"2023-10-18T17:24:04.244754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.252476+0000","last_change":"2023-10-18T17:24:04.252476+0000","last_active":"2023-10-18T17:24:04.252476+0000","last_peered":"2023-10-18T17:24:04.252476+0000","last_clean":"2023-10-18T17:24:04.252476+0000","last_became_active":"2023-10-18T17:24:04.252105+0000","last_became_peered":"2023-10-18T17:24:04.252105+0000","last_unstale":"2023-10-18T17:24:04.252476+0000","last_undegraded":"2023-10-18T17:24:04.252476+0000","last_fullsized":"2023-10-18T17:24:04.252476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.749951+0000","last_change":"2023-10-18T17:24:03.743161+0000","last_active":"2023-10-18T17:24:03.749951+0000","last_peered":"2023-10-18T17:24:03.749951+0000","last_clean":"2023-10-18T17:24:03.749951+0000","last_became_active":"2023-10-18T17:24:03.742829+0000","last_became_peered":"2023-10-18T17:24:03.742829+0000","last_unstale":"2023-10-18T17:24:03.749951+0000","last_undegraded":"2023-10-18T17:24:03.749951+0000","last_fullsized":"2023-10-18T17:24:03.749951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.241446+0000","last_change":"2023-10-18T17:24:04.236924+0000","last_active":"2023-10-18T17:24:04.241446+0000","last_peered":"2023-10-18T17:24:04.241446+0000","last_clean":"2023-10-18T17:24:04.241446+0000","last_became_active":"2023-10-18T17:24:04.236665+0000","last_became_peered":"2023-10-18T17:24:04.236665+0000","last_unstale":"2023-10-18T17:24:04.241446+0000","last_undegraded":"2023-10-18T17:24:04.241446+0000","last_fullsized":"2023-10-18T17:24:04.241446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.753419+0000","last_change":"2023-10-18T17:24:03.751587+0000","last_active":"2023-10-18T17:24:03.753419+0000","last_peered":"2023-10-18T17:24:03.753419+0000","last_clean":"2023-10-18T17:24:03.753419+0000","last_became_active":"2023-10-18T17:24:03.750569+0000","last_became_peered":"2023-10-18T17:24:03.750569+0000","last_unstale":"2023-10-18T17:24:03.753419+0000","last_undegraded":"2023-10-18T17:24:03.753419+0000","last_fullsized":"2023-10-18T17:24:03.753419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.256918+0000","last_change":"2023-10-18T17:24:04.256918+0000","last_active":"2023-10-18T17:24:04.256918+0000","last_peered":"2023-10-18T17:24:04.256918+0000","last_clean":"2023-10-18T17:24:04.256918+0000","last_became_active":"2023-10-18T17:24:04.256613+0000","last_became_peered":"2023-10-18T17:24:04.256613+0000","last_unstale":"2023-10-18T17:24:04.256918+0000","last_undegraded":"2023-10-18T17:24:04.256918+0000","last_fullsized":"2023-10-18T17:24:04.256918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.234112+0000","last_change":"2023-10-18T17:24:03.746467+0000","last_active":"2023-10-18T17:24:04.234112+0000","last_peered":"2023-10-18T17:24:04.234112+0000","last_clean":"2023-10-18T17:24:04.234112+0000","last_became_active":"2023-10-18T17:24:03.746097+0000","last_became_peered":"2023-10-18T17:24:03.746097+0000","last_unstale":"2023-10-18T17:24:04.234112+0000","last_undegraded":"2023-10-18T17:24:04.234112+0000","last_fullsized":"2023-10-18T17:24:04.234112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250040+0000","last_change":"2023-10-18T17:24:04.250040+0000","last_active":"2023-10-18T17:24:04.250040+0000","last_peered":"2023-10-18T17:24:04.250040+0000","last_clean":"2023-10-18T17:24:04.250040+0000","last_became_active":"2023-10-18T17:24:04.249714+0000","last_became_peered":"2023-10-18T17:24:04.249714+0000","last_unstale":"2023-10-18T17:24:04.250040+0000","last_undegraded":"2023-10-18T17:24:04.250040+0000","last_fullsized":"2023-10-18T17:24:04.250040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.754411+0000","last_change":"2023-10-18T17:24:03.747229+0000","last_active":"2023-10-18T17:24:03.754411+0000","last_peered":"2023-10-18T17:24:03.754411+0000","last_clean":"2023-10-18T17:24:03.754411+0000","last_became_active":"2023-10-18T17:24:03.746616+0000","last_became_peered":"2023-10-18T17:24:03.746616+0000","last_unstale":"2023-10-18T17:24:03.754411+0000","last_undegraded":"2023-10-18T17:24:03.754411+0000","last_fullsized":"2023-10-18T17:24:03.754411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.247394+0000","last_change":"2023-10-18T17:24:04.245726+0000","last_active":"2023-10-18T17:24:04.247394+0000","last_peered":"2023-10-18T17:24:04.247394+0000","last_clean":"2023-10-18T17:24:04.247394+0000","last_became_active":"2023-10-18T17:24:04.245359+0000","last_became_peered":"2023-10-18T17:24:04.245359+0000","last_unstale":"2023-10-18T17:24:04.247394+0000","last_undegraded":"2023-10-18T17:24:04.247394+0000","last_fullsized":"2023-10-18T17:24:04.247394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.760250+0000","last_change":"2023-10-18T17:24:03.750446+0000","last_active":"2023-10-18T17:24:03.760250+0000","last_peered":"2023-10-18T17:24:03.760250+0000","last_clean":"2023-10-18T17:24:03.760250+0000","last_became_active":"2023-10-18T17:24:03.750168+0000","last_became_peered":"2023-10-18T17:24:03.750168+0000","last_unstale":"2023-10-18T17:24:03.760250+0000","last_undegraded":"2023-10-18T17:24:03.760250+0000","last_fullsized":"2023-10-18T17:24:03.760250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.248487+0000","last_change":"2023-10-18T17:24:04.248487+0000","last_active":"2023-10-18T17:24:04.248487+0000","last_peered":"2023-10-18T17:24:04.248487+0000","last_clean":"2023-10-18T17:24:04.248487+0000","last_became_active":"2023-10-18T17:24:04.248084+0000","last_became_peered":"2023-10-18T17:24:04.248084+0000","last_unstale":"2023-10-18T17:24:04.248487+0000","last_undegraded":"2023-10-18T17:24:04.248487+0000","last_fullsized":"2023-10-18T17:24:04.248487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.764201+0000","last_change":"2023-10-18T17:24:03.762411+0000","last_active":"2023-10-18T17:24:03.764201+0000","last_peered":"2023-10-18T17:24:03.764201+0000","last_clean":"2023-10-18T17:24:03.764201+0000","last_became_active":"2023-10-18T17:24:03.762048+0000","last_became_peered":"2023-10-18T17:24:03.762048+0000","last_unstale":"2023-10-18T17:24:03.764201+0000","last_undegraded":"2023-10-18T17:24:03.764201+0000","last_fullsized":"2023-10-18T17:24:03.764201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258720+0000","last_change":"2023-10-18T17:24:04.255411+0000","last_active":"2023-10-18T17:24:04.258720+0000","last_peered":"2023-10-18T17:24:04.258720+0000","last_clean":"2023-10-18T17:24:04.258720+0000","last_became_active":"2023-10-18T17:24:04.253124+0000","last_became_peered":"2023-10-18T17:24:04.253124+0000","last_unstale":"2023-10-18T17:24:04.258720+0000","last_undegraded":"2023-10-18T17:24:04.258720+0000","last_fullsized":"2023-10-18T17:24:04.258720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.759892+0000","last_change":"2023-10-18T17:24:03.753682+0000","last_active":"2023-10-18T17:24:03.759892+0000","last_peered":"2023-10-18T17:24:03.759892+0000","last_clean":"2023-10-18T17:24:03.759892+0000","last_became_active":"2023-10-18T17:24:03.750732+0000","last_became_peered":"2023-10-18T17:24:03.750732+0000","last_unstale":"2023-10-18T17:24:03.759892+0000","last_undegraded":"2023-10-18T17:24:03.759892+0000","last_fullsized":"2023-10-18T17:24:03.759892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.247389+0000","last_change":"2023-10-18T17:24:04.247389+0000","last_active":"2023-10-18T17:24:04.247389+0000","last_peered":"2023-10-18T17:24:04.247389+0000","last_clean":"2023-10-18T17:24:04.247389+0000","last_became_active":"2023-10-18T17:24:04.247045+0000","last_became_peered":"2023-10-18T17:24:04.247045+0000","last_unstale":"2023-10-18T17:24:04.247389+0000","last_undegraded":"2023-10-18T17:24:04.247389+0000","last_fullsized":"2023-10-18T17:24:04.247389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.746515+0000","last_change":"2023-10-18T17:24:03.742205+0000","last_active":"2023-10-18T17:24:03.746515+0000","last_peered":"2023-10-18T17:24:03.746515+0000","last_clean":"2023-10-18T17:24:03.746515+0000","last_became_active":"2023-10-18T17:24:03.741881+0000","last_became_peered":"2023-10-18T17:24:03.741881+0000","last_unstale":"2023-10-18T17:24:03.746515+0000","last_undegraded":"2023-10-18T17:24:03.746515+0000","last_fullsized":"2023-10-18T17:24:03.746515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.251859+0000","last_change":"2023-10-18T17:24:04.251859+0000","last_active":"2023-10-18T17:24:04.251859+0000","last_peered":"2023-10-18T17:24:04.251859+0000","last_clean":"2023-10-18T17:24:04.251859+0000","last_became_active":"2023-10-18T17:24:04.251431+0000","last_became_peered":"2023-10-18T17:24:04.251431+0000","last_unstale":"2023-10-18T17:24:04.251859+0000","last_undegraded":"2023-10-18T17:24:04.251859+0000","last_fullsized":"2023-10-18T17:24:04.251859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.225479+0000","last_change":"2023-10-18T17:24:03.761606+0000","last_active":"2023-10-18T17:24:04.225479+0000","last_peered":"2023-10-18T17:24:04.225479+0000","last_clean":"2023-10-18T17:24:04.225479+0000","last_became_active":"2023-10-18T17:24:03.759066+0000","last_became_peered":"2023-10-18T17:24:03.759066+0000","last_unstale":"2023-10-18T17:24:04.225479+0000","last_undegraded":"2023-10-18T17:24:04.225479+0000","last_fullsized":"2023-10-18T17:24:04.225479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.242517+0000","last_change":"2023-10-18T17:24:04.242517+0000","last_active":"2023-10-18T17:24:04.242517+0000","last_peered":"2023-10-18T17:24:04.242517+0000","last_clean":"2023-10-18T17:24:04.242517+0000","last_became_active":"2023-10-18T17:24:04.242198+0000","last_became_peered":"2023-10-18T17:24:04.242198+0000","last_unstale":"2023-10-18T17:24:04.242517+0000","last_undegraded":"2023-10-18T17:24:04.242517+0000","last_fullsized":"2023-10-18T17:24:04.242517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.760284+0000","last_change":"2023-10-18T17:24:03.751375+0000","last_active":"2023-10-18T17:24:03.760284+0000","last_peered":"2023-10-18T17:24:03.760284+0000","last_clean":"2023-10-18T17:24:03.760284+0000","last_became_active":"2023-10-18T17:24:03.751112+0000","last_became_peered":"2023-10-18T17:24:03.751112+0000","last_unstale":"2023-10-18T17:24:03.760284+0000","last_undegraded":"2023-10-18T17:24:03.760284+0000","last_fullsized":"2023-10-18T17:24:03.760284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253973+0000","last_change":"2023-10-18T17:24:04.253973+0000","last_active":"2023-10-18T17:24:04.253973+0000","last_peered":"2023-10-18T17:24:04.253973+0000","last_clean":"2023-10-18T17:24:04.253973+0000","last_became_active":"2023-10-18T17:24:04.253669+0000","last_became_peered":"2023-10-18T17:24:04.253669+0000","last_unstale":"2023-10-18T17:24:04.253973+0000","last_undegraded":"2023-10-18T17:24:04.253973+0000","last_fullsized":"2023-10-18T17:24:04.253973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.234227+0000","last_change":"2023-10-18T17:24:03.762548+0000","last_active":"2023-10-18T17:24:04.234227+0000","last_peered":"2023-10-18T17:24:04.234227+0000","last_clean":"2023-10-18T17:24:04.234227+0000","last_became_active":"2023-10-18T17:24:03.762215+0000","last_became_peered":"2023-10-18T17:24:03.762215+0000","last_unstale":"2023-10-18T17:24:04.234227+0000","last_undegraded":"2023-10-18T17:24:04.234227+0000","last_fullsized":"2023-10-18T17:24:04.234227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.255941+0000","last_change":"2023-10-18T17:24:04.244220+0000","last_active":"2023-10-18T17:24:04.255941+0000","last_peered":"2023-10-18T17:24:04.255941+0000","last_clean":"2023-10-18T17:24:04.255941+0000","last_became_active":"2023-10-18T17:24:04.243840+0000","last_became_peered":"2023-10-18T17:24:04.243840+0000","last_unstale":"2023-10-18T17:24:04.255941+0000","last_undegraded":"2023-10-18T17:24:04.255941+0000","last_fullsized":"2023-10-18T17:24:04.255941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.764164+0000","last_change":"2023-10-18T17:24:03.761832+0000","last_active":"2023-10-18T17:24:03.764164+0000","last_peered":"2023-10-18T17:24:03.764164+0000","last_clean":"2023-10-18T17:24:03.764164+0000","last_became_active":"2023-10-18T17:24:03.761474+0000","last_became_peered":"2023-10-18T17:24:03.761474+0000","last_unstale":"2023-10-18T17:24:03.764164+0000","last_undegraded":"2023-10-18T17:24:03.764164+0000","last_fullsized":"2023-10-18T17:24:03.764164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.242877+0000","last_change":"2023-10-18T17:24:04.242877+0000","last_active":"2023-10-18T17:24:04.242877+0000","last_peered":"2023-10-18T17:24:04.242877+0000","last_clean":"2023-10-18T17:24:04.242877+0000","last_became_active":"2023-10-18T17:24:04.242155+0000","last_became_peered":"2023-10-18T17:24:04.242155+0000","last_unstale":"2023-10-18T17:24:04.242877+0000","last_undegraded":"2023-10-18T17:24:04.242877+0000","last_fullsized":"2023-10-18T17:24:04.242877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.236784+0000","last_change":"2023-10-18T17:24:03.750350+0000","last_active":"2023-10-18T17:24:04.236784+0000","last_peered":"2023-10-18T17:24:04.236784+0000","last_clean":"2023-10-18T17:24:04.236784+0000","last_became_active":"2023-10-18T17:24:03.750080+0000","last_became_peered":"2023-10-18T17:24:03.750080+0000","last_unstale":"2023-10-18T17:24:04.236784+0000","last_undegraded":"2023-10-18T17:24:04.236784+0000","last_fullsized":"2023-10-18T17:24:04.236784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.257049+0000","last_change":"2023-10-18T17:24:04.246950+0000","last_active":"2023-10-18T17:24:04.257049+0000","last_peered":"2023-10-18T17:24:04.257049+0000","last_clean":"2023-10-18T17:24:04.257049+0000","last_became_active":"2023-10-18T17:24:04.246377+0000","last_became_peered":"2023-10-18T17:24:04.246377+0000","last_unstale":"2023-10-18T17:24:04.257049+0000","last_undegraded":"2023-10-18T17:24:04.257049+0000","last_fullsized":"2023-10-18T17:24:04.257049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.755614+0000","last_change":"2023-10-18T17:24:03.754668+0000","last_active":"2023-10-18T17:24:03.755614+0000","last_peered":"2023-10-18T17:24:03.755614+0000","last_clean":"2023-10-18T17:24:03.755614+0000","last_became_active":"2023-10-18T17:24:03.754167+0000","last_became_peered":"2023-10-18T17:24:03.754167+0000","last_unstale":"2023-10-18T17:24:03.755614+0000","last_undegraded":"2023-10-18T17:24:03.755614+0000","last_fullsized":"2023-10-18T17:24:03.755614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250784+0000","last_change":"2023-10-18T17:24:04.239937+0000","last_active":"2023-10-18T17:24:04.250784+0000","last_peered":"2023-10-18T17:24:04.250784+0000","last_clean":"2023-10-18T17:24:04.250784+0000","last_became_active":"2023-10-18T17:24:04.239632+0000","last_became_peered":"2023-10-18T17:24:04.239632+0000","last_unstale":"2023-10-18T17:24:04.250784+0000","last_undegraded":"2023-10-18T17:24:04.250784+0000","last_fullsized":"2023-10-18T17:24:04.250784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.235445+0000","last_change":"2023-10-18T17:24:03.752082+0000","last_active":"2023-10-18T17:24:04.235445+0000","last_peered":"2023-10-18T17:24:04.235445+0000","last_clean":"2023-10-18T17:24:04.235445+0000","last_became_active":"2023-10-18T17:24:03.751789+0000","last_became_peered":"2023-10-18T17:24:03.751789+0000","last_unstale":"2023-10-18T17:24:04.235445+0000","last_undegraded":"2023-10-18T17:24:04.235445+0000","last_fullsized":"2023-10-18T17:24:04.235445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.249928+0000","last_change":"2023-10-18T17:24:04.249928+0000","last_active":"2023-10-18T17:24:04.249928+0000","last_peered":"2023-10-18T17:24:04.249928+0000","last_clean":"2023-10-18T17:24:04.249928+0000","last_became_active":"2023-10-18T17:24:04.249624+0000","last_became_peered":"2023-10-18T17:24:04.249624+0000","last_unstale":"2023-10-18T17:24:04.249928+0000","last_undegraded":"2023-10-18T17:24:04.249928+0000","last_fullsized":"2023-10-18T17:24:04.249928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.760065+0000","last_change":"2023-10-18T17:24:03.750481+0000","last_active":"2023-10-18T17:24:03.760065+0000","last_peered":"2023-10-18T17:24:03.760065+0000","last_clean":"2023-10-18T17:24:03.760065+0000","last_became_active":"2023-10-18T17:24:03.748182+0000","last_became_peered":"2023-10-18T17:24:03.748182+0000","last_unstale":"2023-10-18T17:24:03.760065+0000","last_undegraded":"2023-10-18T17:24:03.760065+0000","last_fullsized":"2023-10-18T17:24:03.760065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.251380+0000","last_change":"2023-10-18T17:24:04.251380+0000","last_active":"2023-10-18T17:24:04.251380+0000","last_peered":"2023-10-18T17:24:04.251380+0000","last_clean":"2023-10-18T17:24:04.251380+0000","last_became_active":"2023-10-18T17:24:04.251078+0000","last_became_peered":"2023-10-18T17:24:04.251078+0000","last_unstale":"2023-10-18T17:24:04.251380+0000","last_undegraded":"2023-10-18T17:24:04.251380+0000","last_fullsized":"2023-10-18T17:24:04.251380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.750727+0000","last_change":"2023-10-18T17:24:03.742352+0000","last_active":"2023-10-18T17:24:03.750727+0000","last_peered":"2023-10-18T17:24:03.750727+0000","last_clean":"2023-10-18T17:24:03.750727+0000","last_became_active":"2023-10-18T17:24:03.742052+0000","last_became_peered":"2023-10-18T17:24:03.742052+0000","last_unstale":"2023-10-18T17:24:03.750727+0000","last_undegraded":"2023-10-18T17:24:03.750727+0000","last_fullsized":"2023-10-18T17:24:03.750727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.254657+0000","last_change":"2023-10-18T17:24:04.254657+0000","last_active":"2023-10-18T17:24:04.254657+0000","last_peered":"2023-10-18T17:24:04.254657+0000","last_clean":"2023-10-18T17:24:04.254657+0000","last_became_active":"2023-10-18T17:24:04.254373+0000","last_became_peered":"2023-10-18T17:24:04.254373+0000","last_unstale":"2023-10-18T17:24:04.254657+0000","last_undegraded":"2023-10-18T17:24:04.254657+0000","last_fullsized":"2023-10-18T17:24:04.254657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.754306+0000","last_change":"2023-10-18T17:24:03.746763+0000","last_active":"2023-10-18T17:24:03.754306+0000","last_peered":"2023-10-18T17:24:03.754306+0000","last_clean":"2023-10-18T17:24:03.754306+0000","last_became_active":"2023-10-18T17:24:03.746461+0000","last_became_peered":"2023-10-18T17:24:03.746461+0000","last_unstale":"2023-10-18T17:24:03.754306+0000","last_undegraded":"2023-10-18T17:24:03.754306+0000","last_fullsized":"2023-10-18T17:24:03.754306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258875+0000","last_change":"2023-10-18T17:24:04.258875+0000","last_active":"2023-10-18T17:24:04.258875+0000","last_peered":"2023-10-18T17:24:04.258875+0000","last_clean":"2023-10-18T17:24:04.258875+0000","last_became_active":"2023-10-18T17:24:04.258617+0000","last_became_peered":"2023-10-18T17:24:04.258617+0000","last_unstale":"2023-10-18T17:24:04.258875+0000","last_undegraded":"2023-10-18T17:24:04.258875+0000","last_fullsized":"2023-10-18T17:24:04.258875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.234335+0000","last_change":"2023-10-18T17:24:03.749937+0000","last_active":"2023-10-18T17:24:04.234335+0000","last_peered":"2023-10-18T17:24:04.234335+0000","last_clean":"2023-10-18T17:24:04.234335+0000","last_became_active":"2023-10-18T17:24:03.749625+0000","last_became_peered":"2023-10-18T17:24:03.749625+0000","last_unstale":"2023-10-18T17:24:04.234335+0000","last_undegraded":"2023-10-18T17:24:04.234335+0000","last_fullsized":"2023-10-18T17:24:04.234335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.244522+0000","last_change":"2023-10-18T17:24:04.237303+0000","last_active":"2023-10-18T17:24:04.244522+0000","last_peered":"2023-10-18T17:24:04.244522+0000","last_clean":"2023-10-18T17:24:04.244522+0000","last_became_active":"2023-10-18T17:24:04.237016+0000","last_became_peered":"2023-10-18T17:24:04.237016+0000","last_unstale":"2023-10-18T17:24:04.244522+0000","last_undegraded":"2023-10-18T17:24:04.244522+0000","last_fullsized":"2023-10-18T17:24:04.244522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.750089+0000","last_change":"2023-10-18T17:24:03.745317+0000","last_active":"2023-10-18T17:24:03.750089+0000","last_peered":"2023-10-18T17:24:03.750089+0000","last_clean":"2023-10-18T17:24:03.750089+0000","last_became_active":"2023-10-18T17:24:03.745016+0000","last_became_peered":"2023-10-18T17:24:03.745016+0000","last_unstale":"2023-10-18T17:24:03.750089+0000","last_undegraded":"2023-10-18T17:24:03.750089+0000","last_fullsized":"2023-10-18T17:24:03.750089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.262322+0000","last_change":"2023-10-18T17:24:04.262322+0000","last_active":"2023-10-18T17:24:04.262322+0000","last_peered":"2023-10-18T17:24:04.262322+0000","last_clean":"2023-10-18T17:24:04.262322+0000","last_became_active":"2023-10-18T17:24:04.262039+0000","last_became_peered":"2023-10-18T17:24:04.262039+0000","last_unstale":"2023-10-18T17:24:04.262322+0000","last_undegraded":"2023-10-18T17:24:04.262322+0000","last_fullsized":"2023-10-18T17:24:04.262322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.228078+0000","last_change":"2023-10-18T17:24:03.756377+0000","last_active":"2023-10-18T17:24:04.228078+0000","last_peered":"2023-10-18T17:24:04.228078+0000","last_clean":"2023-10-18T17:24:04.228078+0000","last_became_active":"2023-10-18T17:24:03.756048+0000","last_became_peered":"2023-10-18T17:24:03.756048+0000","last_unstale":"2023-10-18T17:24:04.228078+0000","last_undegraded":"2023-10-18T17:24:04.228078+0000","last_fullsized":"2023-10-18T17:24:04.228078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.256537+0000","last_change":"2023-10-18T17:24:04.248165+0000","last_active":"2023-10-18T17:24:04.256537+0000","last_peered":"2023-10-18T17:24:04.256537+0000","last_clean":"2023-10-18T17:24:04.256537+0000","last_became_active":"2023-10-18T17:24:04.247888+0000","last_became_peered":"2023-10-18T17:24:04.247888+0000","last_unstale":"2023-10-18T17:24:04.256537+0000","last_undegraded":"2023-10-18T17:24:04.256537+0000","last_fullsized":"2023-10-18T17:24:04.256537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.759986+0000","last_change":"2023-10-18T17:24:03.756703+0000","last_active":"2023-10-18T17:24:03.759986+0000","last_peered":"2023-10-18T17:24:03.759986+0000","last_clean":"2023-10-18T17:24:03.759986+0000","last_became_active":"2023-10-18T17:24:03.755543+0000","last_became_peered":"2023-10-18T17:24:03.755543+0000","last_unstale":"2023-10-18T17:24:03.759986+0000","last_undegraded":"2023-10-18T17:24:03.759986+0000","last_fullsized":"2023-10-18T17:24:03.759986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.248435+0000","last_change":"2023-10-18T17:24:04.248435+0000","last_active":"2023-10-18T17:24:04.248435+0000","last_peered":"2023-10-18T17:24:04.248435+0000","last_clean":"2023-10-18T17:24:04.248435+0000","last_became_active":"2023-10-18T17:24:04.248150+0000","last_became_peered":"2023-10-18T17:24:04.248150+0000","last_unstale":"2023-10-18T17:24:04.248435+0000","last_undegraded":"2023-10-18T17:24:04.248435+0000","last_fullsized":"2023-10-18T17:24:04.248435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.235444+0000","last_change":"2023-10-18T17:24:03.751813+0000","last_active":"2023-10-18T17:24:04.235444+0000","last_peered":"2023-10-18T17:24:04.235444+0000","last_clean":"2023-10-18T17:24:04.235444+0000","last_became_active":"2023-10-18T17:24:03.751468+0000","last_became_peered":"2023-10-18T17:24:03.751468+0000","last_unstale":"2023-10-18T17:24:04.235444+0000","last_undegraded":"2023-10-18T17:24:04.235444+0000","last_fullsized":"2023-10-18T17:24:04.235444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258693+0000","last_change":"2023-10-18T17:24:04.258693+0000","last_active":"2023-10-18T17:24:04.258693+0000","last_peered":"2023-10-18T17:24:04.258693+0000","last_clean":"2023-10-18T17:24:04.258693+0000","last_became_active":"2023-10-18T17:24:04.258420+0000","last_became_peered":"2023-10-18T17:24:04.258420+0000","last_unstale":"2023-10-18T17:24:04.258693+0000","last_undegraded":"2023-10-18T17:24:04.258693+0000","last_fullsized":"2023-10-18T17:24:04.258693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.750572+0000","last_change":"2023-10-18T17:24:03.741061+0000","last_active":"2023-10-18T17:24:03.750572+0000","last_peered":"2023-10-18T17:24:03.750572+0000","last_clean":"2023-10-18T17:24:03.750572+0000","last_became_active":"2023-10-18T17:24:03.740773+0000","last_became_peered":"2023-10-18T17:24:03.740773+0000","last_unstale":"2023-10-18T17:24:03.750572+0000","last_undegraded":"2023-10-18T17:24:03.750572+0000","last_fullsized":"2023-10-18T17:24:03.750572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.255651+0000","last_change":"2023-10-18T17:24:04.255651+0000","last_active":"2023-10-18T17:24:04.255651+0000","last_peered":"2023-10-18T17:24:04.255651+0000","last_clean":"2023-10-18T17:24:04.255651+0000","last_became_active":"2023-10-18T17:24:04.255377+0000","last_became_peered":"2023-10-18T17:24:04.255377+0000","last_unstale":"2023-10-18T17:24:04.255651+0000","last_undegraded":"2023-10-18T17:24:04.255651+0000","last_fullsized":"2023-10-18T17:24:04.255651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.764295+0000","last_change":"2023-10-18T17:24:03.762674+0000","last_active":"2023-10-18T17:24:03.764295+0000","last_peered":"2023-10-18T17:24:03.764295+0000","last_clean":"2023-10-18T17:24:03.764295+0000","last_became_active":"2023-10-18T17:24:03.762293+0000","last_became_peered":"2023-10-18T17:24:03.762293+0000","last_unstale":"2023-10-18T17:24:03.764295+0000","last_undegraded":"2023-10-18T17:24:03.764295+0000","last_fullsized":"2023-10-18T17:24:03.764295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.249093+0000","last_change":"2023-10-18T17:24:04.240811+0000","last_active":"2023-10-18T17:24:04.249093+0000","last_peered":"2023-10-18T17:24:04.249093+0000","last_clean":"2023-10-18T17:24:04.249093+0000","last_became_active":"2023-10-18T17:24:04.240514+0000","last_became_peered":"2023-10-18T17:24:04.240514+0000","last_unstale":"2023-10-18T17:24:04.249093+0000","last_undegraded":"2023-10-18T17:24:04.249093+0000","last_fullsized":"2023-10-18T17:24:04.249093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.749307+0000","last_change":"2023-10-18T17:24:03.744676+0000","last_active":"2023-10-18T17:24:03.749307+0000","last_peered":"2023-10-18T17:24:03.749307+0000","last_clean":"2023-10-18T17:24:03.749307+0000","last_became_active":"2023-10-18T17:24:03.744318+0000","last_became_peered":"2023-10-18T17:24:03.744318+0000","last_unstale":"2023-10-18T17:24:03.749307+0000","last_undegraded":"2023-10-18T17:24:03.749307+0000","last_fullsized":"2023-10-18T17:24:03.749307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.242434+0000","last_change":"2023-10-18T17:24:04.242434+0000","last_active":"2023-10-18T17:24:04.242434+0000","last_peered":"2023-10-18T17:24:04.242434+0000","last_clean":"2023-10-18T17:24:04.242434+0000","last_became_active":"2023-10-18T17:24:04.242125+0000","last_became_peered":"2023-10-18T17:24:04.242125+0000","last_unstale":"2023-10-18T17:24:04.242434+0000","last_undegraded":"2023-10-18T17:24:04.242434+0000","last_fullsized":"2023-10-18T17:24:04.242434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.740632+0000","last_change":"2023-10-18T17:23:58.684395+0000","last_active":"2023-10-18T17:24:03.740632+0000","last_peered":"2023-10-18T17:24:03.740632+0000","last_clean":"2023-10-18T17:24:03.740632+0000","last_became_active":"2023-10-18T17:23:58.683958+0000","last_became_peered":"2023-10-18T17:23:58.683958+0000","last_unstale":"2023-10-18T17:24:03.740632+0000","last_undegraded":"2023-10-18T17:24:03.740632+0000","last_fullsized":"2023-10-18T17:24:03.740632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.231926+0000","last_change":"2023-10-18T17:24:03.753111+0000","last_active":"2023-10-18T17:24:04.231926+0000","last_peered":"2023-10-18T17:24:04.231926+0000","last_clean":"2023-10-18T17:24:04.231926+0000","last_became_active":"2023-10-18T17:24:03.752548+0000","last_became_peered":"2023-10-18T17:24:03.752548+0000","last_unstale":"2023-10-18T17:24:04.231926+0000","last_undegraded":"2023-10-18T17:24:04.231926+0000","last_fullsized":"2023-10-18T17:24:04.231926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.244386+0000","last_change":"2023-10-18T17:24:04.244386+0000","last_active":"2023-10-18T17:24:04.244386+0000","last_peered":"2023-10-18T17:24:04.244386+0000","last_clean":"2023-10-18T17:24:04.244386+0000","last_became_active":"2023-10-18T17:24:04.244041+0000","last_became_peered":"2023-10-18T17:24:04.244041+0000","last_unstale":"2023-10-18T17:24:04.244386+0000","last_undegraded":"2023-10-18T17:24:04.244386+0000","last_fullsized":"2023-10-18T17:24:04.244386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.228377+0000","last_change":"2023-10-18T17:23:58.682697+0000","last_active":"2023-10-18T17:24:04.228377+0000","last_peered":"2023-10-18T17:24:04.228377+0000","last_clean":"2023-10-18T17:24:04.228377+0000","last_became_active":"2023-10-18T17:23:58.682294+0000","last_became_peered":"2023-10-18T17:23:58.682294+0000","last_unstale":"2023-10-18T17:24:04.228377+0000","last_undegraded":"2023-10-18T17:24:04.228377+0000","last_fullsized":"2023-10-18T17:24:04.228377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.759869+0000","last_change":"2023-10-18T17:24:03.749017+0000","last_active":"2023-10-18T17:24:03.759869+0000","last_peered":"2023-10-18T17:24:03.759869+0000","last_clean":"2023-10-18T17:24:03.759869+0000","last_became_active":"2023-10-18T17:24:03.748740+0000","last_became_peered":"2023-10-18T17:24:03.748740+0000","last_unstale":"2023-10-18T17:24:03.759869+0000","last_undegraded":"2023-10-18T17:24:03.759869+0000","last_fullsized":"2023-10-18T17:24:03.759869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.257504+0000","last_change":"2023-10-18T17:24:04.257504+0000","last_active":"2023-10-18T17:24:04.257504+0000","last_peered":"2023-10-18T17:24:04.257504+0000","last_clean":"2023-10-18T17:24:04.257504+0000","last_became_active":"2023-10-18T17:24:04.255752+0000","last_became_peered":"2023-10-18T17:24:04.255752+0000","last_unstale":"2023-10-18T17:24:04.257504+0000","last_undegraded":"2023-10-18T17:24:04.257504+0000","last_fullsized":"2023-10-18T17:24:04.257504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.735763+0000","last_change":"2023-10-18T17:23:58.853499+0000","last_active":"2023-10-18T17:24:03.735763+0000","last_peered":"2023-10-18T17:24:03.735763+0000","last_clean":"2023-10-18T17:24:03.735763+0000","last_became_active":"2023-10-18T17:23:58.852960+0000","last_became_peered":"2023-10-18T17:23:58.852960+0000","last_unstale":"2023-10-18T17:24:03.735763+0000","last_undegraded":"2023-10-18T17:24:03.735763+0000","last_fullsized":"2023-10-18T17:24:03.735763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.227303+0000","last_change":"2023-10-18T17:24:03.739032+0000","last_active":"2023-10-18T17:24:04.227303+0000","last_peered":"2023-10-18T17:24:04.227303+0000","last_clean":"2023-10-18T17:24:04.227303+0000","last_became_active":"2023-10-18T17:24:03.738439+0000","last_became_peered":"2023-10-18T17:24:03.738439+0000","last_unstale":"2023-10-18T17:24:04.227303+0000","last_undegraded":"2023-10-18T17:24:04.227303+0000","last_fullsized":"2023-10-18T17:24:04.227303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.246665+0000","last_change":"2023-10-18T17:24:04.245021+0000","last_active":"2023-10-18T17:24:04.246665+0000","last_peered":"2023-10-18T17:24:04.246665+0000","last_clean":"2023-10-18T17:24:04.246665+0000","last_became_active":"2023-10-18T17:24:04.244567+0000","last_became_peered":"2023-10-18T17:24:04.244567+0000","last_unstale":"2023-10-18T17:24:04.246665+0000","last_undegraded":"2023-10-18T17:24:04.246665+0000","last_fullsized":"2023-10-18T17:24:04.246665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.227863+0000","last_change":"2023-10-18T17:23:58.851971+0000","last_active":"2023-10-18T17:24:04.227863+0000","last_peered":"2023-10-18T17:24:04.227863+0000","last_clean":"2023-10-18T17:24:04.227863+0000","last_became_active":"2023-10-18T17:23:58.851505+0000","last_became_peered":"2023-10-18T17:23:58.851505+0000","last_unstale":"2023-10-18T17:24:04.227863+0000","last_undegraded":"2023-10-18T17:24:04.227863+0000","last_fullsized":"2023-10-18T17:24:04.227863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.762712+0000","last_change":"2023-10-18T17:24:03.761669+0000","last_active":"2023-10-18T17:24:03.762712+0000","last_peered":"2023-10-18T17:24:03.762712+0000","last_clean":"2023-10-18T17:24:03.762712+0000","last_became_active":"2023-10-18T17:24:03.761358+0000","last_became_peered":"2023-10-18T17:24:03.761358+0000","last_unstale":"2023-10-18T17:24:03.762712+0000","last_undegraded":"2023-10-18T17:24:03.762712+0000","last_fullsized":"2023-10-18T17:24:03.762712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.255925+0000","last_change":"2023-10-18T17:24:04.243705+0000","last_active":"2023-10-18T17:24:04.255925+0000","last_peered":"2023-10-18T17:24:04.255925+0000","last_clean":"2023-10-18T17:24:04.255925+0000","last_became_active":"2023-10-18T17:24:04.243438+0000","last_became_peered":"2023-10-18T17:24:04.243438+0000","last_unstale":"2023-10-18T17:24:04.255925+0000","last_undegraded":"2023-10-18T17:24:04.255925+0000","last_fullsized":"2023-10-18T17:24:04.255925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.756058+0000","last_change":"2023-10-18T17:24:03.754253+0000","last_active":"2023-10-18T17:24:03.756058+0000","last_peered":"2023-10-18T17:24:03.756058+0000","last_clean":"2023-10-18T17:24:03.756058+0000","last_became_active":"2023-10-18T17:24:03.753384+0000","last_became_peered":"2023-10-18T17:24:03.753384+0000","last_unstale":"2023-10-18T17:24:03.756058+0000","last_undegraded":"2023-10-18T17:24:03.756058+0000","last_fullsized":"2023-10-18T17:24:03.756058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.731236+0000","last_change":"2023-10-18T17:23:58.682309+0000","last_active":"2023-10-18T17:24:03.731236+0000","last_peered":"2023-10-18T17:24:03.731236+0000","last_clean":"2023-10-18T17:24:03.731236+0000","last_became_active":"2023-10-18T17:23:58.681978+0000","last_became_peered":"2023-10-18T17:23:58.681978+0000","last_unstale":"2023-10-18T17:24:03.731236+0000","last_undegraded":"2023-10-18T17:24:03.731236+0000","last_fullsized":"2023-10-18T17:24:03.731236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.255921+0000","last_change":"2023-10-18T17:24:04.244101+0000","last_active":"2023-10-18T17:24:04.255921+0000","last_peered":"2023-10-18T17:24:04.255921+0000","last_clean":"2023-10-18T17:24:04.255921+0000","last_became_active":"2023-10-18T17:24:04.243455+0000","last_became_peered":"2023-10-18T17:24:04.243455+0000","last_unstale":"2023-10-18T17:24:04.255921+0000","last_undegraded":"2023-10-18T17:24:04.255921+0000","last_fullsized":"2023-10-18T17:24:04.255921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.224950+0000","last_change":"2023-10-18T17:24:03.743003+0000","last_active":"2023-10-18T17:24:04.224950+0000","last_peered":"2023-10-18T17:24:04.224950+0000","last_clean":"2023-10-18T17:24:04.224950+0000","last_became_active":"2023-10-18T17:24:03.742629+0000","last_became_peered":"2023-10-18T17:24:03.742629+0000","last_unstale":"2023-10-18T17:24:04.224950+0000","last_undegraded":"2023-10-18T17:24:04.224950+0000","last_fullsized":"2023-10-18T17:24:04.224950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.236706+0000","last_change":"2023-10-18T17:23:58.678572+0000","last_active":"2023-10-18T17:24:04.236706+0000","last_peered":"2023-10-18T17:24:04.236706+0000","last_clean":"2023-10-18T17:24:04.236706+0000","last_became_active":"2023-10-18T17:23:58.677813+0000","last_became_peered":"2023-10-18T17:23:58.677813+0000","last_unstale":"2023-10-18T17:24:04.236706+0000","last_undegraded":"2023-10-18T17:24:04.236706+0000","last_fullsized":"2023-10-18T17:24:04.236706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250762+0000","last_change":"2023-10-18T17:24:04.239298+0000","last_active":"2023-10-18T17:24:04.250762+0000","last_peered":"2023-10-18T17:24:04.250762+0000","last_clean":"2023-10-18T17:24:04.250762+0000","last_became_active":"2023-10-18T17:24:04.239025+0000","last_became_peered":"2023-10-18T17:24:04.239025+0000","last_unstale":"2023-10-18T17:24:04.250762+0000","last_undegraded":"2023-10-18T17:24:04.250762+0000","last_fullsized":"2023-10-18T17:24:04.250762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230729+0000","last_change":"2023-10-18T17:24:03.750194+0000","last_active":"2023-10-18T17:24:04.230729+0000","last_peered":"2023-10-18T17:24:04.230729+0000","last_clean":"2023-10-18T17:24:04.230729+0000","last_became_active":"2023-10-18T17:24:03.749909+0000","last_became_peered":"2023-10-18T17:24:03.749909+0000","last_unstale":"2023-10-18T17:24:04.230729+0000","last_undegraded":"2023-10-18T17:24:04.230729+0000","last_fullsized":"2023-10-18T17:24:04.230729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.734261+0000","last_change":"2023-10-18T17:23:58.679941+0000","last_active":"2023-10-18T17:24:03.734261+0000","last_peered":"2023-10-18T17:24:03.734261+0000","last_clean":"2023-10-18T17:24:03.734261+0000","last_became_active":"2023-10-18T17:23:58.679210+0000","last_became_peered":"2023-10-18T17:23:58.679210+0000","last_unstale":"2023-10-18T17:24:03.734261+0000","last_undegraded":"2023-10-18T17:24:03.734261+0000","last_fullsized":"2023-10-18T17:24:03.734261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.256726+0000","last_change":"2023-10-18T17:24:04.252056+0000","last_active":"2023-10-18T17:24:04.256726+0000","last_peered":"2023-10-18T17:24:04.256726+0000","last_clean":"2023-10-18T17:24:04.256726+0000","last_became_active":"2023-10-18T17:24:04.251812+0000","last_became_peered":"2023-10-18T17:24:04.251812+0000","last_unstale":"2023-10-18T17:24:04.256726+0000","last_undegraded":"2023-10-18T17:24:04.256726+0000","last_fullsized":"2023-10-18T17:24:04.256726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.759888+0000","last_change":"2023-10-18T17:24:03.750606+0000","last_active":"2023-10-18T17:24:03.759888+0000","last_peered":"2023-10-18T17:24:03.759888+0000","last_clean":"2023-10-18T17:24:03.759888+0000","last_became_active":"2023-10-18T17:24:03.750308+0000","last_became_peered":"2023-10-18T17:24:03.750308+0000","last_unstale":"2023-10-18T17:24:03.759888+0000","last_undegraded":"2023-10-18T17:24:03.759888+0000","last_fullsized":"2023-10-18T17:24:03.759888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.727002+0000","last_change":"2023-10-18T17:23:58.683196+0000","last_active":"2023-10-18T17:24:03.727002+0000","last_peered":"2023-10-18T17:24:03.727002+0000","last_clean":"2023-10-18T17:24:03.727002+0000","last_became_active":"2023-10-18T17:23:58.682724+0000","last_became_peered":"2023-10-18T17:23:58.682724+0000","last_unstale":"2023-10-18T17:24:03.727002+0000","last_undegraded":"2023-10-18T17:24:03.727002+0000","last_fullsized":"2023-10-18T17:24:03.727002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.734425+0000","last_change":"2023-10-18T17:23:56.753692+0000","last_active":"2023-10-18T17:24:03.734425+0000","last_peered":"2023-10-18T17:24:03.734425+0000","last_clean":"2023-10-18T17:24:03.734425+0000","last_became_active":"2023-10-18T17:23:56.752884+0000","last_became_peered":"2023-10-18T17:23:56.752884+0000","last_unstale":"2023-10-18T17:24:03.734425+0000","last_undegraded":"2023-10-18T17:24:03.734425+0000","last_fullsized":"2023-10-18T17:24:03.734425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:55.617219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:55.617219+0000","last_clean_scrub_stamp":"2023-10-18T17:23:55.617219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.251396+0000","last_change":"2023-10-18T17:24:04.251396+0000","last_active":"2023-10-18T17:24:04.251396+0000","last_peered":"2023-10-18T17:24:04.251396+0000","last_clean":"2023-10-18T17:24:04.251396+0000","last_became_active":"2023-10-18T17:24:04.251099+0000","last_became_peered":"2023-10-18T17:24:04.251099+0000","last_unstale":"2023-10-18T17:24:04.251396+0000","last_undegraded":"2023-10-18T17:24:04.251396+0000","last_fullsized":"2023-10-18T17:24:04.251396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.759967+0000","last_change":"2023-10-18T17:24:03.749558+0000","last_active":"2023-10-18T17:24:03.759967+0000","last_peered":"2023-10-18T17:24:03.759967+0000","last_clean":"2023-10-18T17:24:03.759967+0000","last_became_active":"2023-10-18T17:24:03.749236+0000","last_became_peered":"2023-10-18T17:24:03.749236+0000","last_unstale":"2023-10-18T17:24:03.759967+0000","last_undegraded":"2023-10-18T17:24:03.759967+0000","last_fullsized":"2023-10-18T17:24:03.759967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.264438+0000","last_change":"2023-10-18T17:24:04.260098+0000","last_active":"2023-10-18T17:24:04.264438+0000","last_peered":"2023-10-18T17:24:04.264438+0000","last_clean":"2023-10-18T17:24:04.264438+0000","last_became_active":"2023-10-18T17:24:04.259824+0000","last_became_peered":"2023-10-18T17:24:04.259824+0000","last_unstale":"2023-10-18T17:24:04.264438+0000","last_undegraded":"2023-10-18T17:24:04.264438+0000","last_fullsized":"2023-10-18T17:24:04.264438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.748208+0000","last_change":"2023-10-18T17:24:03.744238+0000","last_active":"2023-10-18T17:24:03.748208+0000","last_peered":"2023-10-18T17:24:03.748208+0000","last_clean":"2023-10-18T17:24:03.748208+0000","last_became_active":"2023-10-18T17:24:03.743842+0000","last_became_peered":"2023-10-18T17:24:03.743842+0000","last_unstale":"2023-10-18T17:24:03.748208+0000","last_undegraded":"2023-10-18T17:24:03.748208+0000","last_fullsized":"2023-10-18T17:24:03.748208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.243386+0000","last_change":"2023-10-18T17:24:04.243386+0000","last_active":"2023-10-18T17:24:04.243386+0000","last_peered":"2023-10-18T17:24:04.243386+0000","last_clean":"2023-10-18T17:24:04.243386+0000","last_became_active":"2023-10-18T17:24:04.242822+0000","last_became_peered":"2023-10-18T17:24:04.242822+0000","last_unstale":"2023-10-18T17:24:04.243386+0000","last_undegraded":"2023-10-18T17:24:04.243386+0000","last_fullsized":"2023-10-18T17:24:04.243386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.752927+0000","last_change":"2023-10-18T17:24:03.749376+0000","last_active":"2023-10-18T17:24:03.752927+0000","last_peered":"2023-10-18T17:24:03.752927+0000","last_clean":"2023-10-18T17:24:03.752927+0000","last_became_active":"2023-10-18T17:24:03.749063+0000","last_became_peered":"2023-10-18T17:24:03.749063+0000","last_unstale":"2023-10-18T17:24:03.752927+0000","last_undegraded":"2023-10-18T17:24:03.752927+0000","last_fullsized":"2023-10-18T17:24:03.752927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.248670+0000","last_change":"2023-10-18T17:24:04.248670+0000","last_active":"2023-10-18T17:24:04.248670+0000","last_peered":"2023-10-18T17:24:04.248670+0000","last_clean":"2023-10-18T17:24:04.248670+0000","last_became_active":"2023-10-18T17:24:04.248116+0000","last_became_peered":"2023-10-18T17:24:04.248116+0000","last_unstale":"2023-10-18T17:24:04.248670+0000","last_undegraded":"2023-10-18T17:24:04.248670+0000","last_fullsized":"2023-10-18T17:24:04.248670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.761289+0000","last_change":"2023-10-18T17:24:03.756276+0000","last_active":"2023-10-18T17:24:03.761289+0000","last_peered":"2023-10-18T17:24:03.761289+0000","last_clean":"2023-10-18T17:24:03.761289+0000","last_became_active":"2023-10-18T17:24:03.755989+0000","last_became_peered":"2023-10-18T17:24:03.755989+0000","last_unstale":"2023-10-18T17:24:03.761289+0000","last_undegraded":"2023-10-18T17:24:03.761289+0000","last_fullsized":"2023-10-18T17:24:03.761289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.259017+0000","last_change":"2023-10-18T17:24:04.259017+0000","last_active":"2023-10-18T17:24:04.259017+0000","last_peered":"2023-10-18T17:24:04.259017+0000","last_clean":"2023-10-18T17:24:04.259017+0000","last_became_active":"2023-10-18T17:24:04.258654+0000","last_became_peered":"2023-10-18T17:24:04.258654+0000","last_unstale":"2023-10-18T17:24:04.259017+0000","last_undegraded":"2023-10-18T17:24:04.259017+0000","last_fullsized":"2023-10-18T17:24:04.259017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.764189+0000","last_change":"2023-10-18T17:24:03.761885+0000","last_active":"2023-10-18T17:24:03.764189+0000","last_peered":"2023-10-18T17:24:03.764189+0000","last_clean":"2023-10-18T17:24:03.764189+0000","last_became_active":"2023-10-18T17:24:03.761516+0000","last_became_peered":"2023-10-18T17:24:03.761516+0000","last_unstale":"2023-10-18T17:24:03.764189+0000","last_undegraded":"2023-10-18T17:24:03.764189+0000","last_fullsized":"2023-10-18T17:24:03.764189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.246649+0000","last_change":"2023-10-18T17:24:04.244813+0000","last_active":"2023-10-18T17:24:04.246649+0000","last_peered":"2023-10-18T17:24:04.246649+0000","last_clean":"2023-10-18T17:24:04.246649+0000","last_became_active":"2023-10-18T17:24:04.244199+0000","last_became_peered":"2023-10-18T17:24:04.244199+0000","last_unstale":"2023-10-18T17:24:04.246649+0000","last_undegraded":"2023-10-18T17:24:04.246649+0000","last_fullsized":"2023-10-18T17:24:04.246649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.752632+0000","last_change":"2023-10-18T17:24:03.751418+0000","last_active":"2023-10-18T17:24:03.752632+0000","last_peered":"2023-10-18T17:24:03.752632+0000","last_clean":"2023-10-18T17:24:03.752632+0000","last_became_active":"2023-10-18T17:24:03.751122+0000","last_became_peered":"2023-10-18T17:24:03.751122+0000","last_unstale":"2023-10-18T17:24:03.752632+0000","last_undegraded":"2023-10-18T17:24:03.752632+0000","last_fullsized":"2023-10-18T17:24:03.752632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250253+0000","last_change":"2023-10-18T17:24:04.250253+0000","last_active":"2023-10-18T17:24:04.250253+0000","last_peered":"2023-10-18T17:24:04.250253+0000","last_clean":"2023-10-18T17:24:04.250253+0000","last_became_active":"2023-10-18T17:24:04.249929+0000","last_became_peered":"2023-10-18T17:24:04.249929+0000","last_unstale":"2023-10-18T17:24:04.250253+0000","last_undegraded":"2023-10-18T17:24:04.250253+0000","last_fullsized":"2023-10-18T17:24:04.250253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.751768+0000","last_change":"2023-10-18T17:24:03.747106+0000","last_active":"2023-10-18T17:24:03.751768+0000","last_peered":"2023-10-18T17:24:03.751768+0000","last_clean":"2023-10-18T17:24:03.751768+0000","last_became_active":"2023-10-18T17:24:03.746799+0000","last_became_peered":"2023-10-18T17:24:03.746799+0000","last_unstale":"2023-10-18T17:24:03.751768+0000","last_undegraded":"2023-10-18T17:24:03.751768+0000","last_fullsized":"2023-10-18T17:24:03.751768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.243248+0000","last_change":"2023-10-18T17:24:04.243248+0000","last_active":"2023-10-18T17:24:04.243248+0000","last_peered":"2023-10-18T17:24:04.243248+0000","last_clean":"2023-10-18T17:24:04.243248+0000","last_became_active":"2023-10-18T17:24:04.242922+0000","last_became_peered":"2023-10-18T17:24:04.242922+0000","last_unstale":"2023-10-18T17:24:04.243248+0000","last_undegraded":"2023-10-18T17:24:04.243248+0000","last_fullsized":"2023-10-18T17:24:04.243248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.753996+0000","last_change":"2023-10-18T17:24:03.749039+0000","last_active":"2023-10-18T17:24:03.753996+0000","last_peered":"2023-10-18T17:24:03.753996+0000","last_clean":"2023-10-18T17:24:03.753996+0000","last_became_active":"2023-10-18T17:24:03.748569+0000","last_became_peered":"2023-10-18T17:24:03.748569+0000","last_unstale":"2023-10-18T17:24:03.753996+0000","last_undegraded":"2023-10-18T17:24:03.753996+0000","last_fullsized":"2023-10-18T17:24:03.753996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.241433+0000","last_change":"2023-10-18T17:24:04.241433+0000","last_active":"2023-10-18T17:24:04.241433+0000","last_peered":"2023-10-18T17:24:04.241433+0000","last_clean":"2023-10-18T17:24:04.241433+0000","last_became_active":"2023-10-18T17:24:04.241106+0000","last_became_peered":"2023-10-18T17:24:04.241106+0000","last_unstale":"2023-10-18T17:24:04.241433+0000","last_undegraded":"2023-10-18T17:24:04.241433+0000","last_fullsized":"2023-10-18T17:24:04.241433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.755596+0000","last_change":"2023-10-18T17:24:03.754340+0000","last_active":"2023-10-18T17:24:03.755596+0000","last_peered":"2023-10-18T17:24:03.755596+0000","last_clean":"2023-10-18T17:24:03.755596+0000","last_became_active":"2023-10-18T17:24:03.753704+0000","last_became_peered":"2023-10-18T17:24:03.753704+0000","last_unstale":"2023-10-18T17:24:03.755596+0000","last_undegraded":"2023-10-18T17:24:03.755596+0000","last_fullsized":"2023-10-18T17:24:03.755596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253968+0000","last_change":"2023-10-18T17:24:04.253968+0000","last_active":"2023-10-18T17:24:04.253968+0000","last_peered":"2023-10-18T17:24:04.253968+0000","last_clean":"2023-10-18T17:24:04.253968+0000","last_became_active":"2023-10-18T17:24:04.253657+0000","last_became_peered":"2023-10-18T17:24:04.253657+0000","last_unstale":"2023-10-18T17:24:04.253968+0000","last_undegraded":"2023-10-18T17:24:04.253968+0000","last_fullsized":"2023-10-18T17:24:04.253968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.751701+0000","last_change":"2023-10-18T17:24:03.747407+0000","last_active":"2023-10-18T17:24:03.751701+0000","last_peered":"2023-10-18T17:24:03.751701+0000","last_clean":"2023-10-18T17:24:03.751701+0000","last_became_active":"2023-10-18T17:24:03.746910+0000","last_became_peered":"2023-10-18T17:24:03.746910+0000","last_unstale":"2023-10-18T17:24:03.751701+0000","last_undegraded":"2023-10-18T17:24:03.751701+0000","last_fullsized":"2023-10-18T17:24:03.751701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.256873+0000","last_change":"2023-10-18T17:24:04.253275+0000","last_active":"2023-10-18T17:24:04.256873+0000","last_peered":"2023-10-18T17:24:04.256873+0000","last_clean":"2023-10-18T17:24:04.256873+0000","last_became_active":"2023-10-18T17:24:04.252982+0000","last_became_peered":"2023-10-18T17:24:04.252982+0000","last_unstale":"2023-10-18T17:24:04.256873+0000","last_undegraded":"2023-10-18T17:24:04.256873+0000","last_fullsized":"2023-10-18T17:24:04.256873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230811+0000","last_change":"2023-10-18T17:24:03.741950+0000","last_active":"2023-10-18T17:24:04.230811+0000","last_peered":"2023-10-18T17:24:04.230811+0000","last_clean":"2023-10-18T17:24:04.230811+0000","last_became_active":"2023-10-18T17:24:03.740801+0000","last_became_peered":"2023-10-18T17:24:03.740801+0000","last_unstale":"2023-10-18T17:24:04.230811+0000","last_undegraded":"2023-10-18T17:24:04.230811+0000","last_fullsized":"2023-10-18T17:24:04.230811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.243107+0000","last_change":"2023-10-18T17:24:04.243107+0000","last_active":"2023-10-18T17:24:04.243107+0000","last_peered":"2023-10-18T17:24:04.243107+0000","last_clean":"2023-10-18T17:24:04.243107+0000","last_became_active":"2023-10-18T17:24:04.242584+0000","last_became_peered":"2023-10-18T17:24:04.242584+0000","last_unstale":"2023-10-18T17:24:04.243107+0000","last_undegraded":"2023-10-18T17:24:04.243107+0000","last_fullsized":"2023-10-18T17:24:04.243107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.751781+0000","last_change":"2023-10-18T17:24:03.747950+0000","last_active":"2023-10-18T17:24:03.751781+0000","last_peered":"2023-10-18T17:24:03.751781+0000","last_clean":"2023-10-18T17:24:03.751781+0000","last_became_active":"2023-10-18T17:24:03.747647+0000","last_became_peered":"2023-10-18T17:24:03.747647+0000","last_unstale":"2023-10-18T17:24:03.751781+0000","last_undegraded":"2023-10-18T17:24:03.751781+0000","last_fullsized":"2023-10-18T17:24:03.751781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258930+0000","last_change":"2023-10-18T17:24:04.258930+0000","last_active":"2023-10-18T17:24:04.258930+0000","last_peered":"2023-10-18T17:24:04.258930+0000","last_clean":"2023-10-18T17:24:04.258930+0000","last_became_active":"2023-10-18T17:24:04.258630+0000","last_became_peered":"2023-10-18T17:24:04.258630+0000","last_unstale":"2023-10-18T17:24:04.258930+0000","last_undegraded":"2023-10-18T17:24:04.258930+0000","last_fullsized":"2023-10-18T17:24:04.258930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230691+0000","last_change":"2023-10-18T17:24:03.755043+0000","last_active":"2023-10-18T17:24:04.230691+0000","last_peered":"2023-10-18T17:24:04.230691+0000","last_clean":"2023-10-18T17:24:04.230691+0000","last_became_active":"2023-10-18T17:24:03.754677+0000","last_became_peered":"2023-10-18T17:24:03.754677+0000","last_unstale":"2023-10-18T17:24:04.230691+0000","last_undegraded":"2023-10-18T17:24:04.230691+0000","last_fullsized":"2023-10-18T17:24:04.230691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.249183+0000","last_change":"2023-10-18T17:24:04.249183+0000","last_active":"2023-10-18T17:24:04.249183+0000","last_peered":"2023-10-18T17:24:04.249183+0000","last_clean":"2023-10-18T17:24:04.249183+0000","last_became_active":"2023-10-18T17:24:04.248236+0000","last_became_peered":"2023-10-18T17:24:04.248236+0000","last_unstale":"2023-10-18T17:24:04.249183+0000","last_undegraded":"2023-10-18T17:24:04.249183+0000","last_fullsized":"2023-10-18T17:24:04.249183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.763804+0000","last_change":"2023-10-18T17:24:03.761178+0000","last_active":"2023-10-18T17:24:03.763804+0000","last_peered":"2023-10-18T17:24:03.763804+0000","last_clean":"2023-10-18T17:24:03.763804+0000","last_became_active":"2023-10-18T17:24:03.760202+0000","last_became_peered":"2023-10-18T17:24:03.760202+0000","last_unstale":"2023-10-18T17:24:03.763804+0000","last_undegraded":"2023-10-18T17:24:03.763804+0000","last_fullsized":"2023-10-18T17:24:03.763804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.252873+0000","last_change":"2023-10-18T17:24:04.248750+0000","last_active":"2023-10-18T17:24:04.252873+0000","last_peered":"2023-10-18T17:24:04.252873+0000","last_clean":"2023-10-18T17:24:04.252873+0000","last_became_active":"2023-10-18T17:24:04.248498+0000","last_became_peered":"2023-10-18T17:24:04.248498+0000","last_unstale":"2023-10-18T17:24:04.252873+0000","last_undegraded":"2023-10-18T17:24:04.252873+0000","last_fullsized":"2023-10-18T17:24:04.252873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.751798+0000","last_change":"2023-10-18T17:24:03.748064+0000","last_active":"2023-10-18T17:24:03.751798+0000","last_peered":"2023-10-18T17:24:03.751798+0000","last_clean":"2023-10-18T17:24:03.751798+0000","last_became_active":"2023-10-18T17:24:03.747784+0000","last_became_peered":"2023-10-18T17:24:03.747784+0000","last_unstale":"2023-10-18T17:24:03.751798+0000","last_undegraded":"2023-10-18T17:24:03.751798+0000","last_fullsized":"2023-10-18T17:24:03.751798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.260398+0000","last_change":"2023-10-18T17:24:04.257096+0000","last_active":"2023-10-18T17:24:04.260398+0000","last_peered":"2023-10-18T17:24:04.260398+0000","last_clean":"2023-10-18T17:24:04.260398+0000","last_became_active":"2023-10-18T17:24:04.256815+0000","last_became_peered":"2023-10-18T17:24:04.256815+0000","last_unstale":"2023-10-18T17:24:04.260398+0000","last_undegraded":"2023-10-18T17:24:04.260398+0000","last_fullsized":"2023-10-18T17:24:04.260398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.753506+0000","last_change":"2023-10-18T17:24:03.751468+0000","last_active":"2023-10-18T17:24:03.753506+0000","last_peered":"2023-10-18T17:24:03.753506+0000","last_clean":"2023-10-18T17:24:03.753506+0000","last_became_active":"2023-10-18T17:24:03.751166+0000","last_became_peered":"2023-10-18T17:24:03.751166+0000","last_unstale":"2023-10-18T17:24:03.753506+0000","last_undegraded":"2023-10-18T17:24:03.753506+0000","last_fullsized":"2023-10-18T17:24:03.753506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.242079+0000","last_change":"2023-10-18T17:24:04.242079+0000","last_active":"2023-10-18T17:24:04.242079+0000","last_peered":"2023-10-18T17:24:04.242079+0000","last_clean":"2023-10-18T17:24:04.242079+0000","last_became_active":"2023-10-18T17:24:04.241342+0000","last_became_peered":"2023-10-18T17:24:04.241342+0000","last_unstale":"2023-10-18T17:24:04.242079+0000","last_undegraded":"2023-10-18T17:24:04.242079+0000","last_fullsized":"2023-10-18T17:24:04.242079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.753450+0000","last_change":"2023-10-18T17:24:03.751419+0000","last_active":"2023-10-18T17:24:03.753450+0000","last_peered":"2023-10-18T17:24:03.753450+0000","last_clean":"2023-10-18T17:24:03.753450+0000","last_became_active":"2023-10-18T17:24:03.751118+0000","last_became_peered":"2023-10-18T17:24:03.751118+0000","last_unstale":"2023-10-18T17:24:03.753450+0000","last_undegraded":"2023-10-18T17:24:03.753450+0000","last_fullsized":"2023-10-18T17:24:03.753450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250969+0000","last_change":"2023-10-18T17:24:04.250969+0000","last_active":"2023-10-18T17:24:04.250969+0000","last_peered":"2023-10-18T17:24:04.250969+0000","last_clean":"2023-10-18T17:24:04.250969+0000","last_became_active":"2023-10-18T17:24:04.250659+0000","last_became_peered":"2023-10-18T17:24:04.250659+0000","last_unstale":"2023-10-18T17:24:04.250969+0000","last_undegraded":"2023-10-18T17:24:04.250969+0000","last_fullsized":"2023-10-18T17:24:04.250969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.755254+0000","last_change":"2023-10-18T17:24:03.752559+0000","last_active":"2023-10-18T17:24:03.755254+0000","last_peered":"2023-10-18T17:24:03.755254+0000","last_clean":"2023-10-18T17:24:03.755254+0000","last_became_active":"2023-10-18T17:24:03.752277+0000","last_became_peered":"2023-10-18T17:24:03.752277+0000","last_unstale":"2023-10-18T17:24:03.755254+0000","last_undegraded":"2023-10-18T17:24:03.755254+0000","last_fullsized":"2023-10-18T17:24:03.755254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.248464+0000","last_change":"2023-10-18T17:24:04.248464+0000","last_active":"2023-10-18T17:24:04.248464+0000","last_peered":"2023-10-18T17:24:04.248464+0000","last_clean":"2023-10-18T17:24:04.248464+0000","last_became_active":"2023-10-18T17:24:04.248166+0000","last_became_peered":"2023-10-18T17:24:04.248166+0000","last_unstale":"2023-10-18T17:24:04.248464+0000","last_undegraded":"2023-10-18T17:24:04.248464+0000","last_fullsized":"2023-10-18T17:24:04.248464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.263341+0000","last_change":"2023-10-18T17:24:04.261758+0000","last_active":"2023-10-18T17:24:04.263341+0000","last_peered":"2023-10-18T17:24:04.263341+0000","last_clean":"2023-10-18T17:24:04.263341+0000","last_became_active":"2023-10-18T17:24:04.259803+0000","last_became_peered":"2023-10-18T17:24:04.259803+0000","last_unstale":"2023-10-18T17:24:04.263341+0000","last_undegraded":"2023-10-18T17:24:04.263341+0000","last_fullsized":"2023-10-18T17:24:04.263341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.763445+0000","last_change":"2023-10-18T17:24:03.760642+0000","last_active":"2023-10-18T17:24:03.763445+0000","last_peered":"2023-10-18T17:24:03.763445+0000","last_clean":"2023-10-18T17:24:03.763445+0000","last_became_active":"2023-10-18T17:24:03.759676+0000","last_became_peered":"2023-10-18T17:24:03.759676+0000","last_unstale":"2023-10-18T17:24:03.763445+0000","last_undegraded":"2023-10-18T17:24:03.763445+0000","last_fullsized":"2023-10-18T17:24:03.763445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.239822+0000","last_change":"2023-10-18T17:24:04.239822+0000","last_active":"2023-10-18T17:24:04.239822+0000","last_peered":"2023-10-18T17:24:04.239822+0000","last_clean":"2023-10-18T17:24:04.239822+0000","last_became_active":"2023-10-18T17:24:04.239546+0000","last_became_peered":"2023-10-18T17:24:04.239546+0000","last_unstale":"2023-10-18T17:24:04.239822+0000","last_undegraded":"2023-10-18T17:24:04.239822+0000","last_fullsized":"2023-10-18T17:24:04.239822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.755219+0000","last_change":"2023-10-18T17:24:03.753621+0000","last_active":"2023-10-18T17:24:03.755219+0000","last_peered":"2023-10-18T17:24:03.755219+0000","last_clean":"2023-10-18T17:24:03.755219+0000","last_became_active":"2023-10-18T17:24:03.753297+0000","last_became_peered":"2023-10-18T17:24:03.753297+0000","last_unstale":"2023-10-18T17:24:03.755219+0000","last_undegraded":"2023-10-18T17:24:03.755219+0000","last_fullsized":"2023-10-18T17:24:03.755219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.249371+0000","last_change":"2023-10-18T17:24:04.249371+0000","last_active":"2023-10-18T17:24:04.249371+0000","last_peered":"2023-10-18T17:24:04.249371+0000","last_clean":"2023-10-18T17:24:04.249371+0000","last_became_active":"2023-10-18T17:24:04.248843+0000","last_became_peered":"2023-10-18T17:24:04.248843+0000","last_unstale":"2023-10-18T17:24:04.249371+0000","last_undegraded":"2023-10-18T17:24:04.249371+0000","last_fullsized":"2023-10-18T17:24:04.249371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.754443+0000","last_change":"2023-10-18T17:24:03.749421+0000","last_active":"2023-10-18T17:24:03.754443+0000","last_peered":"2023-10-18T17:24:03.754443+0000","last_clean":"2023-10-18T17:24:03.754443+0000","last_became_active":"2023-10-18T17:24:03.749120+0000","last_became_peered":"2023-10-18T17:24:03.749120+0000","last_unstale":"2023-10-18T17:24:03.754443+0000","last_undegraded":"2023-10-18T17:24:03.754443+0000","last_fullsized":"2023-10-18T17:24:03.754443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.239958+0000","last_change":"2023-10-18T17:24:04.239958+0000","last_active":"2023-10-18T17:24:04.239958+0000","last_peered":"2023-10-18T17:24:04.239958+0000","last_clean":"2023-10-18T17:24:04.239958+0000","last_became_active":"2023-10-18T17:24:04.239673+0000","last_became_peered":"2023-10-18T17:24:04.239673+0000","last_unstale":"2023-10-18T17:24:04.239958+0000","last_undegraded":"2023-10-18T17:24:04.239958+0000","last_fullsized":"2023-10-18T17:24:04.239958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.751495+0000","last_change":"2023-10-18T17:24:03.745601+0000","last_active":"2023-10-18T17:24:03.751495+0000","last_peered":"2023-10-18T17:24:03.751495+0000","last_clean":"2023-10-18T17:24:03.751495+0000","last_became_active":"2023-10-18T17:24:03.745287+0000","last_became_peered":"2023-10-18T17:24:03.745287+0000","last_unstale":"2023-10-18T17:24:03.751495+0000","last_undegraded":"2023-10-18T17:24:03.751495+0000","last_fullsized":"2023-10-18T17:24:03.751495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.261032+0000","last_change":"2023-10-18T17:24:04.259706+0000","last_active":"2023-10-18T17:24:04.261032+0000","last_peered":"2023-10-18T17:24:04.261032+0000","last_clean":"2023-10-18T17:24:04.261032+0000","last_became_active":"2023-10-18T17:24:04.259232+0000","last_became_peered":"2023-10-18T17:24:04.259232+0000","last_unstale":"2023-10-18T17:24:04.261032+0000","last_undegraded":"2023-10-18T17:24:04.261032+0000","last_fullsized":"2023-10-18T17:24:04.261032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.762063+0000","last_change":"2023-10-18T17:24:03.760958+0000","last_active":"2023-10-18T17:24:03.762063+0000","last_peered":"2023-10-18T17:24:03.762063+0000","last_clean":"2023-10-18T17:24:03.762063+0000","last_became_active":"2023-10-18T17:24:03.760640+0000","last_became_peered":"2023-10-18T17:24:03.760640+0000","last_unstale":"2023-10-18T17:24:03.762063+0000","last_undegraded":"2023-10-18T17:24:03.762063+0000","last_fullsized":"2023-10-18T17:24:03.762063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.243907+0000","last_change":"2023-10-18T17:24:04.243907+0000","last_active":"2023-10-18T17:24:04.243907+0000","last_peered":"2023-10-18T17:24:04.243907+0000","last_clean":"2023-10-18T17:24:04.243907+0000","last_became_active":"2023-10-18T17:24:04.243296+0000","last_became_peered":"2023-10-18T17:24:04.243296+0000","last_unstale":"2023-10-18T17:24:04.243907+0000","last_undegraded":"2023-10-18T17:24:04.243907+0000","last_fullsized":"2023-10-18T17:24:04.243907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230713+0000","last_change":"2023-10-18T17:24:03.745470+0000","last_active":"2023-10-18T17:24:04.230713+0000","last_peered":"2023-10-18T17:24:04.230713+0000","last_clean":"2023-10-18T17:24:04.230713+0000","last_became_active":"2023-10-18T17:24:03.744361+0000","last_became_peered":"2023-10-18T17:24:03.744361+0000","last_unstale":"2023-10-18T17:24:04.230713+0000","last_undegraded":"2023-10-18T17:24:04.230713+0000","last_fullsized":"2023-10-18T17:24:04.230713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.244429+0000","last_change":"2023-10-18T17:24:04.244429+0000","last_active":"2023-10-18T17:24:04.244429+0000","last_peered":"2023-10-18T17:24:04.244429+0000","last_clean":"2023-10-18T17:24:04.244429+0000","last_became_active":"2023-10-18T17:24:04.244106+0000","last_became_peered":"2023-10-18T17:24:04.244106+0000","last_unstale":"2023-10-18T17:24:04.244429+0000","last_undegraded":"2023-10-18T17:24:04.244429+0000","last_fullsized":"2023-10-18T17:24:04.244429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.228250+0000","last_change":"2023-10-18T17:24:03.748814+0000","last_active":"2023-10-18T17:24:04.228250+0000","last_peered":"2023-10-18T17:24:04.228250+0000","last_clean":"2023-10-18T17:24:04.228250+0000","last_became_active":"2023-10-18T17:24:03.748507+0000","last_became_peered":"2023-10-18T17:24:03.748507+0000","last_unstale":"2023-10-18T17:24:04.228250+0000","last_undegraded":"2023-10-18T17:24:04.228250+0000","last_fullsized":"2023-10-18T17:24:04.228250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.249830+0000","last_change":"2023-10-18T17:24:04.249830+0000","last_active":"2023-10-18T17:24:04.249830+0000","last_peered":"2023-10-18T17:24:04.249830+0000","last_clean":"2023-10-18T17:24:04.249830+0000","last_became_active":"2023-10-18T17:24:04.249500+0000","last_became_peered":"2023-10-18T17:24:04.249500+0000","last_unstale":"2023-10-18T17:24:04.249830+0000","last_undegraded":"2023-10-18T17:24:04.249830+0000","last_fullsized":"2023-10-18T17:24:04.249830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T17:24:03.753979+0000","last_change":"2023-10-18T17:24:03.748849+0000","last_active":"2023-10-18T17:24:03.753979+0000","last_peered":"2023-10-18T17:24:03.753979+0000","last_clean":"2023-10-18T17:24:03.753979+0000","last_became_active":"2023-10-18T17:24:03.748240+0000","last_became_peered":"2023-10-18T17:24:03.748240+0000","last_unstale":"2023-10-18T17:24:03.753979+0000","last_undegraded":"2023-10-18T17:24:03.753979+0000","last_fullsized":"2023-10-18T17:24:03.753979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297288,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074552,"statfs":{"total":96636764160,"available":96332341248,"internally_reserved":0,"allocated":196608,"data_stored":70373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297288,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074552,"statfs":{"total":96636764160,"available":96332341248,"internally_reserved":0,"allocated":196608,"data_stored":70373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297292,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074548,"statfs":{"total":96636764160,"available":96332337152,"internally_reserved":0,"allocated":200704,"data_stored":71334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297292,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074548,"statfs":{"total":96636764160,"available":96332337152,"internally_reserved":0,"allocated":200704,"data_stored":71334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297300,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074540,"statfs":{"total":96636764160,"available":96332328960,"internally_reserved":0,"allocated":208896,"data_stored":77552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T17:24:10.934 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-18T17:24:10.934 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-18T17:24:10.935 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-18T17:24:10.935 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-18T17:24:10.935 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-18T17:24:11.128 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.123+0000 7f65c27b9700 1 Processor -- start 2023-10-18T17:24:11.129 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.123+0000 7f65c27b9700 1 -- start start 2023-10-18T17:24:11.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.123+0000 7f65c27b9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f65bc0bf340 0x7f65bc0bf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:11.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.123+0000 7f65c27b9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f65bc13d890 0x7f65bc0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:11.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.123+0000 7f65c27b9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65bc068ea0 con 0x7f65bc0bcaf0 2023-10-18T17:24:11.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.123+0000 7f65c27b9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65bc154220 con 0x7f65bc13d890 2023-10-18T17:24:11.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.123+0000 7f65c27b9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65bc157970 con 0x7f65bc0bf340 2023-10-18T17:24:11.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.123+0000 7f65c1fb8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f65bc13d890 0x7f65bc0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:11.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.123+0000 7f65c17b7700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f65bc0bf340 0x7f65bc0bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:11.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.123+0000 7f65c1fb8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f65bc13d890 0x7f65bc0689b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56062/0 (socket says 172.21.15.158:56062) 2023-10-18T17:24:11.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.123+0000 7f65c0fb6700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f65bc0bcaf0 0x7f65bc13d180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:57002/0 (socket says 172.21.15.158:57002) 2023-10-18T17:24:11.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.123+0000 7f65c1fb8700 1 -- 172.21.15.158:0/1253169193 learned_addr learned my addr 172.21.15.158:0/1253169193 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:11.134 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.127+0000 7f65c1fb8700 1 -- 172.21.15.158:0/1253169193 >> v2:172.21.15.183:3300/0 conn(0x7f65bc0bf340 msgr2=0x7f65bc0bf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:11.134 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.127+0000 7f65c1fb8700 1 --2- 172.21.15.158:0/1253169193 >> v2:172.21.15.183:3300/0 conn(0x7f65bc0bf340 0x7f65bc0bf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.134 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.127+0000 7f65c1fb8700 1 -- 172.21.15.158:0/1253169193 >> v1:172.21.15.183:6789/0 conn(0x7f65bc0bcaf0 legacy=0x7f65bc13d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:11.134 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.127+0000 7f65c1fb8700 1 -- 172.21.15.158:0/1253169193 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc157bf0 con 0x7f65bc13d890 2023-10-18T17:24:11.134 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.127+0000 7f65c1fb8700 1 --2- 172.21.15.158:0/1253169193 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc13d890 0x7f65bc0689b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f65bc067380 tx=0x7f65b4009840).ready entity=mon.0 client_cookie=e5ab55d7107792de server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:11.135 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.127+0000 7f65b3fff700 1 -- 172.21.15.158:0/1253169193 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b400e070 con 0x7f65bc13d890 2023-10-18T17:24:11.135 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.127+0000 7f65b3fff700 1 -- 172.21.15.158:0/1253169193 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b400bab0 con 0x7f65bc13d890 2023-10-18T17:24:11.135 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.127+0000 7f65b3fff700 1 -- 172.21.15.158:0/1253169193 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b400be30 con 0x7f65bc13d890 2023-10-18T17:24:11.136 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.127+0000 7f65c27b9700 1 -- 172.21.15.158:0/1253169193 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc13d890 msgr2=0x7f65bc0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:11.136 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.127+0000 7f65c27b9700 1 --2- 172.21.15.158:0/1253169193 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc13d890 0x7f65bc0689b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f65bc067380 tx=0x7f65b4009840).stop 2023-10-18T17:24:11.136 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.127+0000 7f65c27b9700 1 -- 172.21.15.158:0/1253169193 shutdown_connections 2023-10-18T17:24:11.137 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.127+0000 7f65c27b9700 1 --2- 172.21.15.158:0/1253169193 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc13d890 0x7f65bc0689b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.137 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.127+0000 7f65c27b9700 1 --2- 172.21.15.158:0/1253169193 >> v2:172.21.15.183:3300/0 conn(0x7f65bc0bf340 0x7f65bc0bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.137 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.127+0000 7f65c27b9700 1 -- 172.21.15.158:0/1253169193 >> 172.21.15.158:0/1253169193 conn(0x7f65bc05ddc0 msgr2=0x7f65bc05e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:11.137 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.127+0000 7f65c27b9700 1 -- 172.21.15.158:0/1253169193 shutdown_connections 2023-10-18T17:24:11.137 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.127+0000 7f65c27b9700 1 -- 172.21.15.158:0/1253169193 wait complete. 2023-10-18T17:24:11.138 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.127+0000 7f65c27b9700 1 Processor -- start 2023-10-18T17:24:11.138 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c27b9700 1 -- start start 2023-10-18T17:24:11.139 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c27b9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65bc0bcaf0 0x7f65bc139ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:11.139 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c27b9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65bc0bf340 0x7f65bc139140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:11.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c27b9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc13d890 0x7f65bc167900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:11.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c27b9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc1534e0 con 0x7f65bc13d890 2023-10-18T17:24:11.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c27b9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc0b9b30 con 0x7f65bc0bcaf0 2023-10-18T17:24:11.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c27b9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc153050 con 0x7f65bc0bf340 2023-10-18T17:24:11.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c1fb8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc13d890 0x7f65bc167900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:11.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c1fb8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc13d890 0x7f65bc167900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56072/0 (socket says 172.21.15.158:56072) 2023-10-18T17:24:11.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c1fb8700 1 -- 172.21.15.158:0/661474028 learned_addr learned my addr 172.21.15.158:0/661474028 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:11.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c0fb6700 1 --2- 172.21.15.158:0/661474028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65bc0bf340 0x7f65bc139140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:11.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c17b7700 1 --2- 172.21.15.158:0/661474028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65bc0bcaf0 0x7f65bc139ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:11.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c1fb8700 1 -- 172.21.15.158:0/661474028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65bc0bf340 msgr2=0x7f65bc139140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:11.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c1fb8700 1 --2- 172.21.15.158:0/661474028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65bc0bf340 0x7f65bc139140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c1fb8700 1 -- 172.21.15.158:0/661474028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65bc0bcaf0 msgr2=0x7f65bc139ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:11.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c1fb8700 1 --2- 172.21.15.158:0/661474028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65bc0bcaf0 0x7f65bc139ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c1fb8700 1 -- 172.21.15.158:0/661474028 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b4009ae0 con 0x7f65bc13d890 2023-10-18T17:24:11.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c1fb8700 1 --2- 172.21.15.158:0/661474028 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc13d890 0x7f65bc167900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f65bc067400 tx=0x7f65bc065960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:11.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65b17fa700 1 -- 172.21.15.158:0/661474028 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b4013e60 con 0x7f65bc13d890 2023-10-18T17:24:11.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65b17fa700 1 -- 172.21.15.158:0/661474028 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b40092e0 con 0x7f65bc13d890 2023-10-18T17:24:11.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c27b9700 1 -- 172.21.15.158:0/661474028 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65bc0b9850 con 0x7f65bc13d890 2023-10-18T17:24:11.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65b17fa700 1 -- 172.21.15.158:0/661474028 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b401e6c0 con 0x7f65bc13d890 2023-10-18T17:24:11.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.131+0000 7f65c27b9700 1 -- 172.21.15.158:0/661474028 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65bc152a00 con 0x7f65bc13d890 2023-10-18T17:24:11.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.135+0000 7f65c27b9700 1 -- 172.21.15.158:0/661474028 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65bc046f00 con 0x7f65bc13d890 2023-10-18T17:24:11.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.135+0000 7f65b17fa700 1 -- 172.21.15.158:0/661474028 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f65b4003040 con 0x7f65bc13d890 2023-10-18T17:24:11.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.139+0000 7f65b17fa700 1 --2- 172.21.15.158:0/661474028 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f65a005a510 0x7f65a005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:11.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.139+0000 7f65b17fa700 1 -- 172.21.15.158:0/661474028 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f65b4075c00 con 0x7f65bc13d890 2023-10-18T17:24:11.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.139+0000 7f65c17b7700 1 --2- 172.21.15.158:0/661474028 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f65a005a510 0x7f65a005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:11.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.139+0000 7f65c17b7700 1 --2- 172.21.15.158:0/661474028 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f65a005a510 0x7f65a005c9d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f65b8009c30 tx=0x7f65b8009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:11.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.143+0000 7f65b17fa700 1 -- 172.21.15.158:0/661474028 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f65b407c080 con 0x7f65bc13d890 2023-10-18T17:24:11.346 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.339+0000 7f65c27b9700 1 -- 172.21.15.158:0/661474028 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f65bc153190 con 0x7f65bc13d890 2023-10-18T17:24:11.350 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.343+0000 7f65b17fa700 1 -- 172.21.15.158:0/661474028 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+142151 (secure 0 0 0) 0x7f65b4023030 con 0x7f65bc13d890 2023-10-18T17:24:11.353 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:11.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.351+0000 7f65c27b9700 1 -- 172.21.15.158:0/661474028 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f65a005a510 msgr2=0x7f65a005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:11.357 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.351+0000 7f65c27b9700 1 --2- 172.21.15.158:0/661474028 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f65a005a510 0x7f65a005c9d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f65b8009c30 tx=0x7f65b8009060).stop 2023-10-18T17:24:11.357 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.351+0000 7f65c27b9700 1 -- 172.21.15.158:0/661474028 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc13d890 msgr2=0x7f65bc167900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:11.357 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.351+0000 7f65c27b9700 1 --2- 172.21.15.158:0/661474028 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc13d890 0x7f65bc167900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f65bc067400 tx=0x7f65bc065960).stop 2023-10-18T17:24:11.358 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.351+0000 7f65c27b9700 1 -- 172.21.15.158:0/661474028 shutdown_connections 2023-10-18T17:24:11.358 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.351+0000 7f65c27b9700 1 --2- 172.21.15.158:0/661474028 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f65a005a510 0x7f65a005c9d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.358 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.351+0000 7f65c27b9700 1 --2- 172.21.15.158:0/661474028 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65bc13d890 0x7f65bc167900 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.358 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.351+0000 7f65c27b9700 1 --2- 172.21.15.158:0/661474028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65bc0bf340 0x7f65bc139140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.351+0000 7f65c27b9700 1 --2- 172.21.15.158:0/661474028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65bc0bcaf0 0x7f65bc139ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.351+0000 7f65c27b9700 1 -- 172.21.15.158:0/661474028 >> 172.21.15.158:0/661474028 conn(0x7f65bc05ddc0 msgr2=0x7f65bc13a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:11.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.351+0000 7f65c27b9700 1 -- 172.21.15.158:0/661474028 shutdown_connections 2023-10-18T17:24:11.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.351+0000 7f65c27b9700 1 -- 172.21.15.158:0/661474028 wait complete. 2023-10-18T17:24:11.377 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":4,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":33555},{"type":"v1","addr":"172.21.15.183:6833","nonce":33555}]},"active_addr":"172.21.15.183:6833/33555","active_change":"2023-10-18T17:23:49.467309+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4111,"name":"y","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":3262140646}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":1684223169}]}]} 2023-10-18T17:24:11.382 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-18T17:24:11.382 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-18T17:24:11.382 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T17:24:11.549 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.543+0000 7fb281b79700 1 Processor -- start 2023-10-18T17:24:11.550 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.543+0000 7fb281b79700 1 -- start start 2023-10-18T17:24:11.553 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.547+0000 7fb281b79700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb27c13d890 0x7fb27c0bf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:11.554 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.547+0000 7fb281b79700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27c157970 con 0x7fb27c0bcaf0 2023-10-18T17:24:11.554 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.547+0000 7fb281b79700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27c0bcf30 con 0x7fb27c0bf340 2023-10-18T17:24:11.554 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.547+0000 7fb281b79700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb27c154220 con 0x7fb27c13d890 2023-10-18T17:24:11.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.547+0000 7fb273fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb27c13d890 0x7fb27c0bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:11.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.547+0000 7fb280b77700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fb27c0bf340 0x7fb27c13d180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:57008/0 (socket says 172.21.15.158:57008) 2023-10-18T17:24:11.556 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.547+0000 7fb273fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb27c13d890 0x7fb27c0bf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:43652/0 (socket says 172.21.15.158:43652) 2023-10-18T17:24:11.556 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.547+0000 7fb280b77700 1 -- 172.21.15.158:0/1983970383 learned_addr learned my addr 172.21.15.158:0/1983970383 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:11.556 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.547+0000 7fb281378700 1 --1- 172.21.15.158:0/1983970383 >> v1:172.21.15.158:6789/0 conn(0x7fb27c0bcaf0 0x7fb27c154670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:38590/0 (socket says 172.21.15.158:38590) 2023-10-18T17:24:11.556 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.547+0000 7fb273fff700 1 -- 172.21.15.158:0/1983970383 >> v1:172.21.15.183:6789/0 conn(0x7fb27c0bf340 legacy=0x7fb27c13d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:11.557 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.547+0000 7fb273fff700 1 -- 172.21.15.158:0/1983970383 >> v1:172.21.15.158:6789/0 conn(0x7fb27c0bcaf0 legacy=0x7fb27c154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:11.557 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.547+0000 7fb273fff700 1 -- 172.21.15.158:0/1983970383 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c157bf0 con 0x7fb27c13d890 2023-10-18T17:24:11.557 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.547+0000 7fb273fff700 1 --2- 172.21.15.158:0/1983970383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb27c13d890 0x7fb27c0bf720 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fb26c009760 tx=0x7fb26c009060).ready entity=mon.1 client_cookie=fdf1b807990f20ef server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:11.557 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.547+0000 7fb2737fe700 1 -- 172.21.15.158:0/1983970383 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c00b610 con 0x7fb27c13d890 2023-10-18T17:24:11.557 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.547+0000 7fb2737fe700 1 -- 172.21.15.158:0/1983970383 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c00b770 con 0x7fb27c13d890 2023-10-18T17:24:11.558 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.547+0000 7fb2737fe700 1 -- 172.21.15.158:0/1983970383 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c00baf0 con 0x7fb27c13d890 2023-10-18T17:24:11.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.551+0000 7fb281b79700 1 -- 172.21.15.158:0/1983970383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb27c13d890 msgr2=0x7fb27c0bf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:11.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.551+0000 7fb281b79700 1 --2- 172.21.15.158:0/1983970383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb27c13d890 0x7fb27c0bf720 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fb26c009760 tx=0x7fb26c009060).stop 2023-10-18T17:24:11.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.551+0000 7fb281b79700 1 -- 172.21.15.158:0/1983970383 shutdown_connections 2023-10-18T17:24:11.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.551+0000 7fb281b79700 1 --2- 172.21.15.158:0/1983970383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb27c13d890 0x7fb27c0bf720 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.551+0000 7fb281b79700 1 -- 172.21.15.158:0/1983970383 >> 172.21.15.158:0/1983970383 conn(0x7fb27c05ddc0 msgr2=0x7fb27c05e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:11.560 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.551+0000 7fb281b79700 1 -- 172.21.15.158:0/1983970383 shutdown_connections 2023-10-18T17:24:11.560 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.551+0000 7fb281b79700 1 -- 172.21.15.158:0/1983970383 wait complete. 2023-10-18T17:24:11.560 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.551+0000 7fb281b79700 1 Processor -- start 2023-10-18T17:24:11.561 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.555+0000 7fb281b79700 1 -- start start 2023-10-18T17:24:11.561 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.555+0000 7fb281b79700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb27c0bcaf0 0x7fb27c0c0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:11.562 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.555+0000 7fb281b79700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb27c0bf340 0x7fb27c0c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:11.562 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.555+0000 7fb281b79700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb27c13d890 0x7fb27c0c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:11.562 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.555+0000 7fb281b79700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c157670 con 0x7fb27c0bf340 2023-10-18T17:24:11.562 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.555+0000 7fb281b79700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c0c10a0 con 0x7fb27c0bcaf0 2023-10-18T17:24:11.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.555+0000 7fb281b79700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c1517b0 con 0x7fb27c13d890 2023-10-18T17:24:11.564 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.555+0000 7fb273fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb27c0bf340 0x7fb27c0c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:11.564 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.555+0000 7fb280b77700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb27c0bcaf0 0x7fb27c0c0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:11.565 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.555+0000 7fb273fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb27c0bf340 0x7fb27c0c29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56074/0 (socket says 172.21.15.158:56074) 2023-10-18T17:24:11.565 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.555+0000 7fb273fff700 1 -- 172.21.15.158:0/4223830510 learned_addr learned my addr 172.21.15.158:0/4223830510 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:11.565 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.555+0000 7fb281378700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb27c13d890 0x7fb27c0c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:11.565 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.555+0000 7fb273fff700 1 -- 172.21.15.158:0/4223830510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb27c13d890 msgr2=0x7fb27c0c1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:11.565 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.555+0000 7fb273fff700 1 --2- 172.21.15.158:0/4223830510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb27c13d890 0x7fb27c0c1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.566 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.555+0000 7fb273fff700 1 -- 172.21.15.158:0/4223830510 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb27c0bcaf0 msgr2=0x7fb27c0c0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:11.566 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.555+0000 7fb273fff700 1 --2- 172.21.15.158:0/4223830510 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb27c0bcaf0 0x7fb27c0c0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.566 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.555+0000 7fb273fff700 1 -- 172.21.15.158:0/4223830510 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c0092a0 con 0x7fb27c0bf340 2023-10-18T17:24:11.566 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.555+0000 7fb280b77700 1 --2- 172.21.15.158:0/4223830510 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb27c0bcaf0 0x7fb27c0c0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:11.566 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.555+0000 7fb273fff700 1 --2- 172.21.15.158:0/4223830510 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb27c0bf340 0x7fb27c0c29b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fb27c157b20 tx=0x7fb26c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:11.567 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.559+0000 7fb270ff9700 1 -- 172.21.15.158:0/4223830510 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c00b8e0 con 0x7fb27c0bf340 2023-10-18T17:24:11.567 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.559+0000 7fb270ff9700 1 -- 172.21.15.158:0/4223830510 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c00ba40 con 0x7fb27c0bf340 2023-10-18T17:24:11.567 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.559+0000 7fb270ff9700 1 -- 172.21.15.158:0/4223830510 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c01b620 con 0x7fb27c0bf340 2023-10-18T17:24:11.567 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.559+0000 7fb281b79700 1 -- 172.21.15.158:0/4223830510 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27c0c0ae0 con 0x7fb27c0bf340 2023-10-18T17:24:11.568 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.559+0000 7fb281b79700 1 -- 172.21.15.158:0/4223830510 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27c151160 con 0x7fb27c0bf340 2023-10-18T17:24:11.568 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.559+0000 7fb281b79700 1 -- 172.21.15.158:0/4223830510 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27c046f00 con 0x7fb27c0bf340 2023-10-18T17:24:11.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.559+0000 7fb270ff9700 1 -- 172.21.15.158:0/4223830510 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb26c01ba10 con 0x7fb27c0bf340 2023-10-18T17:24:11.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.563+0000 7fb270ff9700 1 --2- 172.21.15.158:0/4223830510 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb26805a510 0x7fb26805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:11.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.563+0000 7fb270ff9700 1 -- 172.21.15.158:0/4223830510 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb26c076310 con 0x7fb27c0bf340 2023-10-18T17:24:11.570 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.563+0000 7fb280b77700 1 --2- 172.21.15.158:0/4223830510 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb26805a510 0x7fb26805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:11.570 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.563+0000 7fb280b77700 1 --2- 172.21.15.158:0/4223830510 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb26805a510 0x7fb26805c9d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb278007fd0 tx=0x7fb278007d30).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:11.577 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.571+0000 7fb270ff9700 1 -- 172.21.15.158:0/4223830510 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fb26c049a30 con 0x7fb27c0bf340 2023-10-18T17:24:11.746 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.739+0000 7fb281b79700 1 -- 172.21.15.158:0/4223830510 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb27c157ed0 con 0x7fb27c0bf340 2023-10-18T17:24:11.747 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.739+0000 7fb270ff9700 1 -- 172.21.15.158:0/4223830510 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fb26c01f090 con 0x7fb27c0bf340 2023-10-18T17:24:11.748 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:11.748 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":22,"fsid":"ca4bb219-38c8-4c5b-a49c-213b123db018","created":"2023-10-18T17:23:45.550173+0000","modified":"2023-10-18T17:24:05.219394+0000","last_up_change":"2023-10-18T17:23:55.617219+0000","last_in_change":"2023-10-18T17:23:47.727646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-18T17:23:54.686216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T17:23:56.743672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T17:24:02.200531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T17:24:03.168929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f621b1e-5ea4-4dc3-80e1-c415c7cc97d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6815","nonce":33195},{"type":"v1","addr":"172.21.15.158:6817","nonce":33195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":33195},{"type":"v1","addr":"172.21.15.158:6819","nonce":33195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":33195},{"type":"v1","addr":"172.21.15.158:6824","nonce":33195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":33195},{"type":"v1","addr":"172.21.15.158:6821","nonce":33195}]},"public_addr":"172.21.15.158:6817/33195","cluster_addr":"172.21.15.158:6819/33195","heartbeat_back_addr":"172.21.15.158:6824/33195","heartbeat_front_addr":"172.21.15.158:6821/33195","state":["exists","up"]},{"osd":1,"uuid":"769d7514-319f-4ac3-8cf3-6f88f4e7da2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6823","nonce":33196},{"type":"v1","addr":"172.21.15.158:6825","nonce":33196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":33196},{"type":"v1","addr":"172.21.15.158:6827","nonce":33196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":33196},{"type":"v1","addr":"172.21.15.158:6831","nonce":33196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":33196},{"type":"v1","addr":"172.21.15.158:6829","nonce":33196}]},"public_addr":"172.21.15.158:6825/33196","cluster_addr":"172.21.15.158:6827/33196","heartbeat_back_addr":"172.21.15.158:6831/33196","heartbeat_front_addr":"172.21.15.158:6829/33196","state":["exists","up"]},{"osd":2,"uuid":"b4459762-309d-454c-bd31-33b90192375f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":33193},{"type":"v1","addr":"172.21.15.158:6809","nonce":33193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":33193},{"type":"v1","addr":"172.21.15.158:6811","nonce":33193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":33193},{"type":"v1","addr":"172.21.15.158:6816","nonce":33193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":33193},{"type":"v1","addr":"172.21.15.158:6813","nonce":33193}]},"public_addr":"172.21.15.158:6809/33193","cluster_addr":"172.21.15.158:6811/33193","heartbeat_back_addr":"172.21.15.158:6816/33193","heartbeat_front_addr":"172.21.15.158:6813/33193","state":["exists","up"]},{"osd":3,"uuid":"7b78a411-1ae9-4051-ae9d-a03abc5a73ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":33194},{"type":"v1","addr":"172.21.15.158:6801","nonce":33194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":33194},{"type":"v1","addr":"172.21.15.158:6803","nonce":33194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":33194},{"type":"v1","addr":"172.21.15.158:6807","nonce":33194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":33194},{"type":"v1","addr":"172.21.15.158:6805","nonce":33194}]},"public_addr":"172.21.15.158:6801/33194","cluster_addr":"172.21.15.158:6803/33194","heartbeat_back_addr":"172.21.15.158:6807/33194","heartbeat_front_addr":"172.21.15.158:6805/33194","state":["exists","up"]},{"osd":4,"uuid":"58005b5f-2742-4ecb-8c3a-a2ae65c7fb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":33897},{"type":"v1","addr":"172.21.15.183:6801","nonce":33897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6803","nonce":33897},{"type":"v1","addr":"172.21.15.183:6805","nonce":33897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":33897},{"type":"v1","addr":"172.21.15.183:6812","nonce":33897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":33897},{"type":"v1","addr":"172.21.15.183:6808","nonce":33897}]},"public_addr":"172.21.15.183:6801/33897","cluster_addr":"172.21.15.183:6805/33897","heartbeat_back_addr":"172.21.15.183:6812/33897","heartbeat_front_addr":"172.21.15.183:6808/33897","state":["exists","up"]},{"osd":5,"uuid":"c0b217ed-1c09-4cde-b192-65624ab3a70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":33898},{"type":"v1","addr":"172.21.15.183:6804","nonce":33898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6807","nonce":33898},{"type":"v1","addr":"172.21.15.183:6809","nonce":33898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":33898},{"type":"v1","addr":"172.21.15.183:6815","nonce":33898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6811","nonce":33898},{"type":"v1","addr":"172.21.15.183:6813","nonce":33898}]},"public_addr":"172.21.15.183:6804/33898","cluster_addr":"172.21.15.183:6809/33898","heartbeat_back_addr":"172.21.15.183:6815/33898","heartbeat_front_addr":"172.21.15.183:6813/33898","state":["exists","up"]},{"osd":6,"uuid":"5f910aac-4091-408b-8b2b-19865b21395c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":33910},{"type":"v1","addr":"172.21.15.183:6825","nonce":33910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":33910},{"type":"v1","addr":"172.21.15.183:6827","nonce":33910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":33910},{"type":"v1","addr":"172.21.15.183:6831","nonce":33910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":33910},{"type":"v1","addr":"172.21.15.183:6829","nonce":33910}]},"public_addr":"172.21.15.183:6825/33910","cluster_addr":"172.21.15.183:6827/33910","heartbeat_back_addr":"172.21.15.183:6831/33910","heartbeat_front_addr":"172.21.15.183:6829/33910","state":["exists","up"]},{"osd":7,"uuid":"96d7b9aa-687e-42e3-a5cf-1533931ecce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":33903},{"type":"v1","addr":"172.21.15.183:6817","nonce":33903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":33903},{"type":"v1","addr":"172.21.15.183:6819","nonce":33903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":33903},{"type":"v1","addr":"172.21.15.183:6823","nonce":33903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":33903},{"type":"v1","addr":"172.21.15.183:6821","nonce":33903}]},"public_addr":"172.21.15.183:6817/33903","cluster_addr":"172.21.15.183:6819/33903","heartbeat_back_addr":"172.21.15.183:6823/33903","heartbeat_front_addr":"172.21.15.183:6821/33903","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.622366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.713036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.561097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.546583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.007074+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:52.994413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.176820+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:52.906075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T17:24:11.750 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.743+0000 7fb281b79700 1 -- 172.21.15.158:0/4223830510 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb26805a510 msgr2=0x7fb26805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:11.750 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.743+0000 7fb281b79700 1 --2- 172.21.15.158:0/4223830510 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb26805a510 0x7fb26805c9d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb278007fd0 tx=0x7fb278007d30).stop 2023-10-18T17:24:11.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.743+0000 7fb281b79700 1 -- 172.21.15.158:0/4223830510 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb27c0bf340 msgr2=0x7fb27c0c29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:11.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.743+0000 7fb281b79700 1 --2- 172.21.15.158:0/4223830510 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb27c0bf340 0x7fb27c0c29b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fb27c157b20 tx=0x7fb26c017000).stop 2023-10-18T17:24:11.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.743+0000 7fb281b79700 1 -- 172.21.15.158:0/4223830510 shutdown_connections 2023-10-18T17:24:11.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.743+0000 7fb281b79700 1 --2- 172.21.15.158:0/4223830510 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb26805a510 0x7fb26805c9d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.743+0000 7fb281b79700 1 --2- 172.21.15.158:0/4223830510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb27c13d890 0x7fb27c0c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.752 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.743+0000 7fb281b79700 1 --2- 172.21.15.158:0/4223830510 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb27c0bf340 0x7fb27c0c29b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.752 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.743+0000 7fb281b79700 1 --2- 172.21.15.158:0/4223830510 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb27c0bcaf0 0x7fb27c0c0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.752 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.743+0000 7fb281b79700 1 -- 172.21.15.158:0/4223830510 >> 172.21.15.158:0/4223830510 conn(0x7fb27c05ddc0 msgr2=0x7fb27c13bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:11.753 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.743+0000 7fb281b79700 1 -- 172.21.15.158:0/4223830510 shutdown_connections 2023-10-18T17:24:11.753 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.743+0000 7fb281b79700 1 -- 172.21.15.158:0/4223830510 wait complete. 2023-10-18T17:24:11.769 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-18T17:24:11.770 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T17:24:11.926 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.919+0000 7f0b7ec5b700 1 Processor -- start 2023-10-18T17:24:11.927 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.919+0000 7f0b7ec5b700 1 -- start start 2023-10-18T17:24:11.929 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b7ec5b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0b780bc2f0 0x7f0b78067e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:11.929 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b7ec5b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b78069d80 0x7f0b78068320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:11.929 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b7ec5b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b781551c0 con 0x7f0b780b55b0 2023-10-18T17:24:11.930 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b7ec5b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b781543a0 con 0x7f0b780bc2f0 2023-10-18T17:24:11.930 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b7ec5b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b78154640 con 0x7f0b78069d80 2023-10-18T17:24:11.930 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b6ffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0b780bc2f0 0x7f0b78067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:11.930 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b7d1f8700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b78069d80 0x7f0b78068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:11.931 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b6ffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0b780bc2f0 0x7f0b78067e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56084/0 (socket says 172.21.15.158:56084) 2023-10-18T17:24:11.931 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b6ffff700 1 -- 172.21.15.158:0/2787409746 learned_addr learned my addr 172.21.15.158:0/2787409746 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:11.931 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b7c9f7700 1 --1- 172.21.15.158:0/2787409746 >> v1:172.21.15.183:6789/0 conn(0x7f0b780b55b0 0x7f0b780bcab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:57018/0 (socket says 172.21.15.158:57018) 2023-10-18T17:24:11.932 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b7d1f8700 1 -- 172.21.15.158:0/2787409746 >> v2:172.21.15.158:3300/0 conn(0x7f0b780bc2f0 msgr2=0x7f0b78067e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:11.933 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b7d1f8700 1 --2- 172.21.15.158:0/2787409746 >> v2:172.21.15.158:3300/0 conn(0x7f0b780bc2f0 0x7f0b78067e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.933 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b7d1f8700 1 -- 172.21.15.158:0/2787409746 >> v1:172.21.15.183:6789/0 conn(0x7f0b780b55b0 legacy=0x7f0b780bcab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:11.933 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b7d1f8700 1 -- 172.21.15.158:0/2787409746 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b78154920 con 0x7f0b78069d80 2023-10-18T17:24:11.933 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b7d1f8700 1 --2- 172.21.15.158:0/2787409746 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b78069d80 0x7f0b78068320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f0b70009760 tx=0x7f0b70009060).ready entity=mon.2 client_cookie=814ed3b83722ab5e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:11.933 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b6f7fe700 1 -- 172.21.15.158:0/2787409746 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7000f510 con 0x7f0b78069d80 2023-10-18T17:24:11.934 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b6f7fe700 1 -- 172.21.15.158:0/2787409746 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7000f670 con 0x7f0b78069d80 2023-10-18T17:24:11.934 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b6f7fe700 1 -- 172.21.15.158:0/2787409746 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7000f9f0 con 0x7f0b78069d80 2023-10-18T17:24:11.934 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b7ec5b700 1 -- 172.21.15.158:0/2787409746 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b78069d80 msgr2=0x7f0b78068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:11.934 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.923+0000 7f0b7ec5b700 1 --2- 172.21.15.158:0/2787409746 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b78069d80 0x7f0b78068320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f0b70009760 tx=0x7f0b70009060).stop 2023-10-18T17:24:11.934 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.927+0000 7f0b7ec5b700 1 -- 172.21.15.158:0/2787409746 shutdown_connections 2023-10-18T17:24:11.935 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.927+0000 7f0b7ec5b700 1 --2- 172.21.15.158:0/2787409746 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b78069d80 0x7f0b78068320 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.935 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.927+0000 7f0b7ec5b700 1 --2- 172.21.15.158:0/2787409746 >> v2:172.21.15.158:3300/0 conn(0x7f0b780bc2f0 0x7f0b78067e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.935 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.927+0000 7f0b7ec5b700 1 -- 172.21.15.158:0/2787409746 >> 172.21.15.158:0/2787409746 conn(0x7f0b780620d0 msgr2=0x7f0b780624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:11.935 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.927+0000 7f0b7ec5b700 1 -- 172.21.15.158:0/2787409746 shutdown_connections 2023-10-18T17:24:11.935 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.927+0000 7f0b7ec5b700 1 -- 172.21.15.158:0/2787409746 wait complete. 2023-10-18T17:24:11.937 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.927+0000 7f0b7ec5b700 1 Processor -- start 2023-10-18T17:24:11.937 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.927+0000 7f0b7ec5b700 1 -- start start 2023-10-18T17:24:11.937 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b7ec5b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b78069d80 0x7f0b78155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:11.938 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b7ec5b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b780b55b0 0x7f0b78065940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:11.938 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b7ec5b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b780bc2f0 0x7f0b78167af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:11.938 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b7ec5b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b78157970 con 0x7f0b78069d80 2023-10-18T17:24:11.938 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b7ec5b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b780b5fa0 con 0x7f0b780bc2f0 2023-10-18T17:24:11.939 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b7ec5b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b780bb6c0 con 0x7f0b780b55b0 2023-10-18T17:24:11.939 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b7c9f7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b78069d80 0x7f0b78155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:11.939 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b7c9f7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b78069d80 0x7f0b78155690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56094/0 (socket says 172.21.15.158:56094) 2023-10-18T17:24:11.939 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b7d1f8700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b780bc2f0 0x7f0b78167af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:11.939 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b7c9f7700 1 -- 172.21.15.158:0/2514838986 learned_addr learned my addr 172.21.15.158:0/2514838986 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:11.940 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b6ffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b780b55b0 0x7f0b78065940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:11.940 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b7c9f7700 1 -- 172.21.15.158:0/2514838986 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b780b55b0 msgr2=0x7f0b78065940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:11.940 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b7c9f7700 1 --2- 172.21.15.158:0/2514838986 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b780b55b0 0x7f0b78065940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.940 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b7c9f7700 1 -- 172.21.15.158:0/2514838986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b780bc2f0 msgr2=0x7f0b78167af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:11.940 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b7c9f7700 1 --2- 172.21.15.158:0/2514838986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b780bc2f0 0x7f0b78167af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:11.941 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b7c9f7700 1 -- 172.21.15.158:0/2514838986 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b700092a0 con 0x7f0b78069d80 2023-10-18T17:24:11.941 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b7d1f8700 1 --2- 172.21.15.158:0/2514838986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b780bc2f0 0x7f0b78167af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:11.941 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b6ffff700 1 --2- 172.21.15.158:0/2514838986 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b780b55b0 0x7f0b78065940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:11.942 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b7c9f7700 1 --2- 172.21.15.158:0/2514838986 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b78069d80 0x7f0b78155690 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0b7400c7c0 tx=0x7f0b74001570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:11.943 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b6cff9700 1 -- 172.21.15.158:0/2514838986 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74005c70 con 0x7f0b78069d80 2023-10-18T17:24:11.943 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b6cff9700 1 -- 172.21.15.158:0/2514838986 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b74005dd0 con 0x7f0b78069d80 2023-10-18T17:24:11.943 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b7ec5b700 1 -- 172.21.15.158:0/2514838986 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b78157080 con 0x7f0b78069d80 2023-10-18T17:24:11.943 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b6cff9700 1 -- 172.21.15.158:0/2514838986 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b740072e0 con 0x7f0b78069d80 2023-10-18T17:24:11.943 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.931+0000 7f0b7ec5b700 1 -- 172.21.15.158:0/2514838986 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b78157600 con 0x7f0b78069d80 2023-10-18T17:24:11.944 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.935+0000 7f0b7ec5b700 1 -- 172.21.15.158:0/2514838986 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7806c190 con 0x7f0b78069d80 2023-10-18T17:24:11.944 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.935+0000 7f0b6cff9700 1 -- 172.21.15.158:0/2514838986 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0b74007710 con 0x7f0b78069d80 2023-10-18T17:24:11.944 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.935+0000 7f0b6cff9700 1 --2- 172.21.15.158:0/2514838986 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f0b6405a4e0 0x7f0b6405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:11.944 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.935+0000 7f0b6cff9700 1 -- 172.21.15.158:0/2514838986 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0b740741c0 con 0x7f0b78069d80 2023-10-18T17:24:11.945 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.935+0000 7f0b6ffff700 1 --2- 172.21.15.158:0/2514838986 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f0b6405a4e0 0x7f0b6405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:11.945 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.939+0000 7f0b6ffff700 1 --2- 172.21.15.158:0/2514838986 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f0b6405a4e0 0x7f0b6405c9a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f0b78161ea0 tx=0x7f0b680090f0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:11.949 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:11.943+0000 7f0b6cff9700 1 -- 172.21.15.158:0/2514838986 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f0b74047990 con 0x7f0b78069d80 2023-10-18T17:24:12.113 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.107+0000 7f0b7ec5b700 1 -- 172.21.15.158:0/2514838986 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b78066760 con 0x7f0b78069d80 2023-10-18T17:24:12.115 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.107+0000 7f0b6cff9700 1 -- 172.21.15.158:0/2514838986 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f0b7404afb0 con 0x7f0b78069d80 2023-10-18T17:24:12.116 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:12.116 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":22,"fsid":"ca4bb219-38c8-4c5b-a49c-213b123db018","created":"2023-10-18T17:23:45.550173+0000","modified":"2023-10-18T17:24:05.219394+0000","last_up_change":"2023-10-18T17:23:55.617219+0000","last_in_change":"2023-10-18T17:23:47.727646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-18T17:23:54.686216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T17:23:56.743672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T17:24:02.200531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T17:24:03.168929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1f621b1e-5ea4-4dc3-80e1-c415c7cc97d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6815","nonce":33195},{"type":"v1","addr":"172.21.15.158:6817","nonce":33195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":33195},{"type":"v1","addr":"172.21.15.158:6819","nonce":33195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":33195},{"type":"v1","addr":"172.21.15.158:6824","nonce":33195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":33195},{"type":"v1","addr":"172.21.15.158:6821","nonce":33195}]},"public_addr":"172.21.15.158:6817/33195","cluster_addr":"172.21.15.158:6819/33195","heartbeat_back_addr":"172.21.15.158:6824/33195","heartbeat_front_addr":"172.21.15.158:6821/33195","state":["exists","up"]},{"osd":1,"uuid":"769d7514-319f-4ac3-8cf3-6f88f4e7da2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6823","nonce":33196},{"type":"v1","addr":"172.21.15.158:6825","nonce":33196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":33196},{"type":"v1","addr":"172.21.15.158:6827","nonce":33196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":33196},{"type":"v1","addr":"172.21.15.158:6831","nonce":33196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":33196},{"type":"v1","addr":"172.21.15.158:6829","nonce":33196}]},"public_addr":"172.21.15.158:6825/33196","cluster_addr":"172.21.15.158:6827/33196","heartbeat_back_addr":"172.21.15.158:6831/33196","heartbeat_front_addr":"172.21.15.158:6829/33196","state":["exists","up"]},{"osd":2,"uuid":"b4459762-309d-454c-bd31-33b90192375f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":33193},{"type":"v1","addr":"172.21.15.158:6809","nonce":33193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":33193},{"type":"v1","addr":"172.21.15.158:6811","nonce":33193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":33193},{"type":"v1","addr":"172.21.15.158:6816","nonce":33193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":33193},{"type":"v1","addr":"172.21.15.158:6813","nonce":33193}]},"public_addr":"172.21.15.158:6809/33193","cluster_addr":"172.21.15.158:6811/33193","heartbeat_back_addr":"172.21.15.158:6816/33193","heartbeat_front_addr":"172.21.15.158:6813/33193","state":["exists","up"]},{"osd":3,"uuid":"7b78a411-1ae9-4051-ae9d-a03abc5a73ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":33194},{"type":"v1","addr":"172.21.15.158:6801","nonce":33194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":33194},{"type":"v1","addr":"172.21.15.158:6803","nonce":33194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":33194},{"type":"v1","addr":"172.21.15.158:6807","nonce":33194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":33194},{"type":"v1","addr":"172.21.15.158:6805","nonce":33194}]},"public_addr":"172.21.15.158:6801/33194","cluster_addr":"172.21.15.158:6803/33194","heartbeat_back_addr":"172.21.15.158:6807/33194","heartbeat_front_addr":"172.21.15.158:6805/33194","state":["exists","up"]},{"osd":4,"uuid":"58005b5f-2742-4ecb-8c3a-a2ae65c7fb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":33897},{"type":"v1","addr":"172.21.15.183:6801","nonce":33897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6803","nonce":33897},{"type":"v1","addr":"172.21.15.183:6805","nonce":33897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":33897},{"type":"v1","addr":"172.21.15.183:6812","nonce":33897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":33897},{"type":"v1","addr":"172.21.15.183:6808","nonce":33897}]},"public_addr":"172.21.15.183:6801/33897","cluster_addr":"172.21.15.183:6805/33897","heartbeat_back_addr":"172.21.15.183:6812/33897","heartbeat_front_addr":"172.21.15.183:6808/33897","state":["exists","up"]},{"osd":5,"uuid":"c0b217ed-1c09-4cde-b192-65624ab3a70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":33898},{"type":"v1","addr":"172.21.15.183:6804","nonce":33898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6807","nonce":33898},{"type":"v1","addr":"172.21.15.183:6809","nonce":33898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":33898},{"type":"v1","addr":"172.21.15.183:6815","nonce":33898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6811","nonce":33898},{"type":"v1","addr":"172.21.15.183:6813","nonce":33898}]},"public_addr":"172.21.15.183:6804/33898","cluster_addr":"172.21.15.183:6809/33898","heartbeat_back_addr":"172.21.15.183:6815/33898","heartbeat_front_addr":"172.21.15.183:6813/33898","state":["exists","up"]},{"osd":6,"uuid":"5f910aac-4091-408b-8b2b-19865b21395c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":33910},{"type":"v1","addr":"172.21.15.183:6825","nonce":33910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":33910},{"type":"v1","addr":"172.21.15.183:6827","nonce":33910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":33910},{"type":"v1","addr":"172.21.15.183:6831","nonce":33910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":33910},{"type":"v1","addr":"172.21.15.183:6829","nonce":33910}]},"public_addr":"172.21.15.183:6825/33910","cluster_addr":"172.21.15.183:6827/33910","heartbeat_back_addr":"172.21.15.183:6831/33910","heartbeat_front_addr":"172.21.15.183:6829/33910","state":["exists","up"]},{"osd":7,"uuid":"96d7b9aa-687e-42e3-a5cf-1533931ecce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":33903},{"type":"v1","addr":"172.21.15.183:6817","nonce":33903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":33903},{"type":"v1","addr":"172.21.15.183:6819","nonce":33903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":33903},{"type":"v1","addr":"172.21.15.183:6823","nonce":33903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":33903},{"type":"v1","addr":"172.21.15.183:6821","nonce":33903}]},"public_addr":"172.21.15.183:6817/33903","cluster_addr":"172.21.15.183:6819/33903","heartbeat_back_addr":"172.21.15.183:6823/33903","heartbeat_front_addr":"172.21.15.183:6821/33903","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.622366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.713036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.561097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.546583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.007074+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:52.994413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:53.176820+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T17:23:52.906075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T17:24:12.118 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.111+0000 7f0b7ec5b700 1 -- 172.21.15.158:0/2514838986 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f0b6405a4e0 msgr2=0x7f0b6405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.118 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.111+0000 7f0b7ec5b700 1 --2- 172.21.15.158:0/2514838986 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f0b6405a4e0 0x7f0b6405c9a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f0b78161ea0 tx=0x7f0b680090f0).stop 2023-10-18T17:24:12.118 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.111+0000 7f0b7ec5b700 1 -- 172.21.15.158:0/2514838986 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b78069d80 msgr2=0x7f0b78155690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.118 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.111+0000 7f0b7ec5b700 1 --2- 172.21.15.158:0/2514838986 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b78069d80 0x7f0b78155690 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0b7400c7c0 tx=0x7f0b74001570).stop 2023-10-18T17:24:12.119 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.111+0000 7f0b7ec5b700 1 -- 172.21.15.158:0/2514838986 shutdown_connections 2023-10-18T17:24:12.119 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.111+0000 7f0b7ec5b700 1 --2- 172.21.15.158:0/2514838986 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f0b6405a4e0 0x7f0b6405c9a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.120 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.111+0000 7f0b7ec5b700 1 --2- 172.21.15.158:0/2514838986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b780bc2f0 0x7f0b78167af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.120 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.111+0000 7f0b7ec5b700 1 --2- 172.21.15.158:0/2514838986 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b780b55b0 0x7f0b78065940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.120 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.111+0000 7f0b7ec5b700 1 --2- 172.21.15.158:0/2514838986 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b78069d80 0x7f0b78155690 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.120 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.111+0000 7f0b7ec5b700 1 -- 172.21.15.158:0/2514838986 >> 172.21.15.158:0/2514838986 conn(0x7f0b780620d0 msgr2=0x7f0b780624b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:12.121 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.111+0000 7f0b7ec5b700 1 -- 172.21.15.158:0/2514838986 shutdown_connections 2023-10-18T17:24:12.121 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.111+0000 7f0b7ec5b700 1 -- 172.21.15.158:0/2514838986 wait complete. 2023-10-18T17:24:12.140 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-18T17:24:12.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.295+0000 7f09c0db9700 1 Processor -- start 2023-10-18T17:24:12.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.295+0000 7f09c0db9700 1 -- start start 2023-10-18T17:24:12.305 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.299+0000 7f09c0db9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f09bc066340 0x7f09bc062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.305 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.299+0000 7f09c0db9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09bc0c1610 con 0x7f09bc062270 2023-10-18T17:24:12.305 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.299+0000 7f09c0db9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09bc0c2dd0 con 0x7f09bc14d020 2023-10-18T17:24:12.306 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.299+0000 7f09c0db9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09bc153570 con 0x7f09bc066340 2023-10-18T17:24:12.306 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.299+0000 7f09baffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f09bc066340 0x7f09bc062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.299+0000 7f09bb7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f09bc062270 0x7f09bc0c0f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:38606/0 (socket says 172.21.15.158:38606) 2023-10-18T17:24:12.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.299+0000 7f09bb7fe700 1 -- 172.21.15.158:0/1434519744 learned_addr learned my addr 172.21.15.158:0/1434519744 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:12.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.299+0000 7f09baffd700 1 -- 172.21.15.158:0/1434519744 >> v1:172.21.15.183:6789/0 conn(0x7f09bc14d020 legacy=0x7f09bc14d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.299+0000 7f09baffd700 1 -- 172.21.15.158:0/1434519744 >> v1:172.21.15.158:6789/0 conn(0x7f09bc062270 legacy=0x7f09bc0c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.308 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.299+0000 7f09baffd700 1 -- 172.21.15.158:0/1434519744 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc153850 con 0x7f09bc066340 2023-10-18T17:24:12.308 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.299+0000 7f09baffd700 1 --2- 172.21.15.158:0/1434519744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09bc066340 0x7f09bc062650 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f09b0009760 tx=0x7f09b0009060).ready entity=mon.1 client_cookie=91511a7781ff2da5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:12.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.299+0000 7f09ba7fc700 1 -- 172.21.15.158:0/1434519744 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b000b610 con 0x7f09bc066340 2023-10-18T17:24:12.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.299+0000 7f09ba7fc700 1 -- 172.21.15.158:0/1434519744 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b000b770 con 0x7f09bc066340 2023-10-18T17:24:12.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.299+0000 7f09ba7fc700 1 -- 172.21.15.158:0/1434519744 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b000baf0 con 0x7f09bc066340 2023-10-18T17:24:12.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.303+0000 7f09c0db9700 1 -- 172.21.15.158:0/1434519744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09bc066340 msgr2=0x7f09bc062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.303+0000 7f09c0db9700 1 --2- 172.21.15.158:0/1434519744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09bc066340 0x7f09bc062650 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f09b0009760 tx=0x7f09b0009060).stop 2023-10-18T17:24:12.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.303+0000 7f09c0db9700 1 -- 172.21.15.158:0/1434519744 shutdown_connections 2023-10-18T17:24:12.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.303+0000 7f09c0db9700 1 --2- 172.21.15.158:0/1434519744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09bc066340 0x7f09bc062650 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.303+0000 7f09c0db9700 1 -- 172.21.15.158:0/1434519744 >> 172.21.15.158:0/1434519744 conn(0x7f09bc05ddc0 msgr2=0x7f09bc05e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:12.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.303+0000 7f09c0db9700 1 -- 172.21.15.158:0/1434519744 shutdown_connections 2023-10-18T17:24:12.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.303+0000 7f09c0db9700 1 -- 172.21.15.158:0/1434519744 wait complete. 2023-10-18T17:24:12.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.303+0000 7f09c0db9700 1 Processor -- start 2023-10-18T17:24:12.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.303+0000 7f09c0db9700 1 -- start start 2023-10-18T17:24:12.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.303+0000 7f09c0db9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09bc062270 0x7f09bc0bde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.303+0000 7f09c0db9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09bc066340 0x7f09bc151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.303+0000 7f09c0db9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09bc14d020 0x7f09bc149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.303+0000 7f09c0db9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc150ee0 con 0x7f09bc062270 2023-10-18T17:24:12.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.303+0000 7f09c0db9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc151490 con 0x7f09bc066340 2023-10-18T17:24:12.315 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.303+0000 7f09c0db9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc165030 con 0x7f09bc14d020 2023-10-18T17:24:12.315 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.303+0000 7f09bb7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09bc062270 0x7f09bc0bde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.315 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.303+0000 7f09bb7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09bc062270 0x7f09bc0bde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56102/0 (socket says 172.21.15.158:56102) 2023-10-18T17:24:12.315 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.303+0000 7f09bb7fe700 1 -- 172.21.15.158:0/3277736920 learned_addr learned my addr 172.21.15.158:0/3277736920 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:12.315 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.307+0000 7f09baffd700 1 --2- 172.21.15.158:0/3277736920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09bc066340 0x7f09bc151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.316 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.307+0000 7f09bbfff700 1 --2- 172.21.15.158:0/3277736920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09bc14d020 0x7f09bc149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.316 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.307+0000 7f09bb7fe700 1 -- 172.21.15.158:0/3277736920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09bc14d020 msgr2=0x7f09bc149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.316 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.307+0000 7f09bb7fe700 1 --2- 172.21.15.158:0/3277736920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09bc14d020 0x7f09bc149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.316 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.307+0000 7f09bb7fe700 1 -- 172.21.15.158:0/3277736920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09bc066340 msgr2=0x7f09bc151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.317 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.307+0000 7f09bb7fe700 1 --2- 172.21.15.158:0/3277736920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09bc066340 0x7f09bc151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.317 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.307+0000 7f09bb7fe700 1 -- 172.21.15.158:0/3277736920 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b00092a0 con 0x7f09bc062270 2023-10-18T17:24:12.317 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.307+0000 7f09bb7fe700 1 --2- 172.21.15.158:0/3277736920 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09bc062270 0x7f09bc0bde60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f09ac007fd0 tx=0x7f09ac007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:12.317 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.307+0000 7f09a37fe700 1 -- 172.21.15.158:0/3277736920 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac0070d0 con 0x7f09bc062270 2023-10-18T17:24:12.317 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.307+0000 7f09a37fe700 1 -- 172.21.15.158:0/3277736920 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ac007230 con 0x7f09bc062270 2023-10-18T17:24:12.318 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.307+0000 7f09a37fe700 1 -- 172.21.15.158:0/3277736920 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac0075b0 con 0x7f09bc062270 2023-10-18T17:24:12.318 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.307+0000 7f09c0db9700 1 -- 172.21.15.158:0/3277736920 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09bc152820 con 0x7f09bc062270 2023-10-18T17:24:12.318 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.307+0000 7f09c0db9700 1 -- 172.21.15.158:0/3277736920 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09bc151120 con 0x7f09bc062270 2023-10-18T17:24:12.320 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.307+0000 7f09c0db9700 1 -- 172.21.15.158:0/3277736920 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09bc046f00 con 0x7f09bc062270 2023-10-18T17:24:12.320 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.311+0000 7f09a37fe700 1 -- 172.21.15.158:0/3277736920 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f09ac0059b0 con 0x7f09bc062270 2023-10-18T17:24:12.320 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.311+0000 7f09a37fe700 1 --2- 172.21.15.158:0/3277736920 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f09a805a510 0x7f09a805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.320 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.311+0000 7f09a37fe700 1 -- 172.21.15.158:0/3277736920 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f09ac073e30 con 0x7f09bc062270 2023-10-18T17:24:12.320 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.311+0000 7f09baffd700 1 --2- 172.21.15.158:0/3277736920 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f09a805a510 0x7f09a805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.321 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.311+0000 7f09a37fe700 1 --2- 172.21.15.158:0/3277736920 >> [v2:172.21.15.158:6815/33195,v1:172.21.15.158:6817/33195] conn(0x7f09a80638b0 0x7f09a8065d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.321 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.311+0000 7f09a37fe700 1 -- 172.21.15.158:0/3277736920 --> [v2:172.21.15.158:6815/33195,v1:172.21.15.158:6817/33195] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09a8066390 con 0x7f09a80638b0 2023-10-18T17:24:12.321 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.311+0000 7f09a37fe700 1 -- 172.21.15.158:0/3277736920 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09ac076390 con 0x7f09bc062270 2023-10-18T17:24:12.321 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.311+0000 7f09bbfff700 1 --2- 172.21.15.158:0/3277736920 >> [v2:172.21.15.158:6815/33195,v1:172.21.15.158:6817/33195] conn(0x7f09a80638b0 0x7f09a8065d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.321 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.311+0000 7f09baffd700 1 --2- 172.21.15.158:0/3277736920 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f09a805a510 0x7f09a805c9d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f09b0009760 tx=0x7f09b0017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:12.322 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.311+0000 7f09bbfff700 1 --2- 172.21.15.158:0/3277736920 >> [v2:172.21.15.158:6815/33195,v1:172.21.15.158:6817/33195] conn(0x7f09a80638b0 0x7f09a8065d10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:12.322 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.315+0000 7f09a37fe700 1 -- 172.21.15.158:0/3277736920 <== osd.0 v2:172.21.15.158:6815/33195 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f09a8066390 con 0x7f09a80638b0 2023-10-18T17:24:12.338 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.331+0000 7f09c0db9700 1 -- 172.21.15.158:0/3277736920 --> [v2:172.21.15.158:6815/33195,v1:172.21.15.158:6817/33195] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f09bc1515d0 con 0x7f09a80638b0 2023-10-18T17:24:12.339 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.331+0000 7f09a37fe700 1 -- 172.21.15.158:0/3277736920 <== osd.0 v2:172.21.15.158:6815/33195 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f09b4002c10 con 0x7f09a80638b0 2023-10-18T17:24:12.340 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.335+0000 7f09c0db9700 1 -- 172.21.15.158:0/3277736920 >> [v2:172.21.15.158:6815/33195,v1:172.21.15.158:6817/33195] conn(0x7f09a80638b0 msgr2=0x7f09a8065d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.340 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.335+0000 7f09c0db9700 1 --2- 172.21.15.158:0/3277736920 >> [v2:172.21.15.158:6815/33195,v1:172.21.15.158:6817/33195] conn(0x7f09a80638b0 0x7f09a8065d10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.341 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.335+0000 7f09c0db9700 1 -- 172.21.15.158:0/3277736920 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f09a805a510 msgr2=0x7f09a805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.341 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.335+0000 7f09c0db9700 1 --2- 172.21.15.158:0/3277736920 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f09a805a510 0x7f09a805c9d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f09b0009760 tx=0x7f09b0017000).stop 2023-10-18T17:24:12.342 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.335+0000 7f09c0db9700 1 -- 172.21.15.158:0/3277736920 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09bc062270 msgr2=0x7f09bc0bde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.342 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.335+0000 7f09c0db9700 1 --2- 172.21.15.158:0/3277736920 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09bc062270 0x7f09bc0bde60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f09ac007fd0 tx=0x7f09ac007df0).stop 2023-10-18T17:24:12.342 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.335+0000 7f09bbfff700 1 -- 172.21.15.158:0/3277736920 reap_dead start 2023-10-18T17:24:12.342 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.335+0000 7f09c0db9700 1 -- 172.21.15.158:0/3277736920 shutdown_connections 2023-10-18T17:24:12.342 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.335+0000 7f09c0db9700 1 -- 172.21.15.158:0/3277736920 >> 172.21.15.158:0/3277736920 conn(0x7f09bc05ddc0 msgr2=0x7f09bc0682b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:12.343 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.335+0000 7f09c0db9700 1 -- 172.21.15.158:0/3277736920 shutdown_connections 2023-10-18T17:24:12.343 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.335+0000 7f09c0db9700 1 -- 172.21.15.158:0/3277736920 wait complete. 2023-10-18T17:24:12.359 INFO:teuthology.orchestra.run.smithi158.stdout:60129542149 2023-10-18T17:24:12.359 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-18T17:24:12.524 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.515+0000 7f11c759e700 1 Processor -- start 2023-10-18T17:24:12.524 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.519+0000 7f11c759e700 1 -- start start 2023-10-18T17:24:12.527 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.519+0000 7f11c759e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11c8062270 0x7f11c8062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.528 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.519+0000 7f11c759e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f11c814d020 0x7f11c814d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.528 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.519+0000 7f11c759e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c80c1610 con 0x7f11c8066340 2023-10-18T17:24:12.528 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.519+0000 7f11c759e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c814d9c0 con 0x7f11c814d020 2023-10-18T17:24:12.528 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.519+0000 7f11c759e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c80c2dd0 con 0x7f11c8062270 2023-10-18T17:24:12.528 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.519+0000 7f11c659c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11c8062270 0x7f11c8062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.529 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.523+0000 7f11c659c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11c8062270 0x7f11c8062650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:60914/0 (socket says 172.21.15.158:60914) 2023-10-18T17:24:12.529 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.523+0000 7f11c659c700 1 -- 172.21.15.158:0/1550194225 learned_addr learned my addr 172.21.15.158:0/1550194225 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:12.529 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.519+0000 7f11c6d9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f11c814d020 0x7f11c814d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.529 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.523+0000 7f11c5d9b700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f11c8066340 0x7f11c80c0f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:38620/0 (socket says 172.21.15.158:38620) 2023-10-18T17:24:12.531 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.523+0000 7f11c659c700 1 -- 172.21.15.158:0/1550194225 >> v2:172.21.15.158:3300/0 conn(0x7f11c814d020 msgr2=0x7f11c814d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:12.531 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.523+0000 7f11c659c700 1 --2- 172.21.15.158:0/1550194225 >> v2:172.21.15.158:3300/0 conn(0x7f11c814d020 0x7f11c814d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.531 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.523+0000 7f11c659c700 1 -- 172.21.15.158:0/1550194225 >> v1:172.21.15.158:6789/0 conn(0x7f11c8066340 legacy=0x7f11c80c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.531 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.523+0000 7f11c659c700 1 -- 172.21.15.158:0/1550194225 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c8153570 con 0x7f11c8062270 2023-10-18T17:24:12.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.523+0000 7f11c659c700 1 --2- 172.21.15.158:0/1550194225 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11c8062270 0x7f11c8062650 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f11b8009830 tx=0x7f11b80090f0).ready entity=mon.2 client_cookie=c4020c2234d0415f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:12.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.523+0000 7f11c559a700 1 -- 172.21.15.158:0/1550194225 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b800b610 con 0x7f11c8062270 2023-10-18T17:24:12.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.523+0000 7f11c559a700 1 -- 172.21.15.158:0/1550194225 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b800b770 con 0x7f11c8062270 2023-10-18T17:24:12.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.523+0000 7f11c559a700 1 -- 172.21.15.158:0/1550194225 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b800baf0 con 0x7f11c8062270 2023-10-18T17:24:12.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.523+0000 7f11c759e700 1 -- 172.21.15.158:0/1550194225 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11c8062270 msgr2=0x7f11c8062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.523+0000 7f11c759e700 1 --2- 172.21.15.158:0/1550194225 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11c8062270 0x7f11c8062650 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f11b8009830 tx=0x7f11b80090f0).stop 2023-10-18T17:24:12.533 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.523+0000 7f11c759e700 1 -- 172.21.15.158:0/1550194225 shutdown_connections 2023-10-18T17:24:12.533 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.523+0000 7f11c759e700 1 --2- 172.21.15.158:0/1550194225 >> v2:172.21.15.158:3300/0 conn(0x7f11c814d020 0x7f11c814d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.533 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.523+0000 7f11c759e700 1 --2- 172.21.15.158:0/1550194225 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11c8062270 0x7f11c8062650 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.533 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.523+0000 7f11c759e700 1 -- 172.21.15.158:0/1550194225 >> 172.21.15.158:0/1550194225 conn(0x7f11c805ddc0 msgr2=0x7f11c805e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:12.533 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.523+0000 7f11c759e700 1 -- 172.21.15.158:0/1550194225 shutdown_connections 2023-10-18T17:24:12.534 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.523+0000 7f11c759e700 1 -- 172.21.15.158:0/1550194225 wait complete. 2023-10-18T17:24:12.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c759e700 1 Processor -- start 2023-10-18T17:24:12.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c759e700 1 -- start start 2023-10-18T17:24:12.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c759e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11c8062270 0x7f11c80c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c759e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11c8066340 0x7f11c81488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c759e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11c814d020 0x7f11c814aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c759e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c814ed60 con 0x7f11c8062270 2023-10-18T17:24:12.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c759e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c8163d20 con 0x7f11c814d020 2023-10-18T17:24:12.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c759e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c8164000 con 0x7f11c8066340 2023-10-18T17:24:12.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c659c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11c8062270 0x7f11c80c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c659c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11c8062270 0x7f11c80c5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56114/0 (socket says 172.21.15.158:56114) 2023-10-18T17:24:12.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c659c700 1 -- 172.21.15.158:0/1374420030 learned_addr learned my addr 172.21.15.158:0/1374420030 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:12.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c5d9b700 1 --2- 172.21.15.158:0/1374420030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11c8066340 0x7f11c81488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c6d9d700 1 --2- 172.21.15.158:0/1374420030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11c814d020 0x7f11c814aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c659c700 1 -- 172.21.15.158:0/1374420030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11c8066340 msgr2=0x7f11c81488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c659c700 1 --2- 172.21.15.158:0/1374420030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11c8066340 0x7f11c81488a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c659c700 1 -- 172.21.15.158:0/1374420030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11c814d020 msgr2=0x7f11c814aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c659c700 1 --2- 172.21.15.158:0/1374420030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11c814d020 0x7f11c814aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c659c700 1 -- 172.21.15.158:0/1374420030 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b8009370 con 0x7f11c8062270 2023-10-18T17:24:12.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c659c700 1 --2- 172.21.15.158:0/1374420030 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11c8062270 0x7f11c80c5630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f11b8009130 tx=0x7f11b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:12.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11b67fc700 1 -- 172.21.15.158:0/1374420030 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b800beb0 con 0x7f11c8062270 2023-10-18T17:24:12.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11b67fc700 1 -- 172.21.15.158:0/1374420030 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b800b8e0 con 0x7f11c8062270 2023-10-18T17:24:12.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c759e700 1 -- 172.21.15.158:0/1374420030 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c8157c10 con 0x7f11c8062270 2023-10-18T17:24:12.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11b67fc700 1 -- 172.21.15.158:0/1374420030 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b801c670 con 0x7f11c8062270 2023-10-18T17:24:12.541 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.527+0000 7f11c759e700 1 -- 172.21.15.158:0/1374420030 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c81581d0 con 0x7f11c8062270 2023-10-18T17:24:12.542 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.531+0000 7f11c759e700 1 -- 172.21.15.158:0/1374420030 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f11c8046f00 con 0x7f11c8062270 2023-10-18T17:24:12.542 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.531+0000 7f11b67fc700 1 -- 172.21.15.158:0/1374420030 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f11b801ca20 con 0x7f11c8062270 2023-10-18T17:24:12.543 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.531+0000 7f11b67fc700 1 --2- 172.21.15.158:0/1374420030 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f11a805a510 0x7f11a805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.543 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.531+0000 7f11b67fc700 1 -- 172.21.15.158:0/1374420030 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f11b8076490 con 0x7f11c8062270 2023-10-18T17:24:12.543 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.535+0000 7f11c5d9b700 1 --2- 172.21.15.158:0/1374420030 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f11a805a510 0x7f11a805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.543 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.535+0000 7f11b67fc700 1 --2- 172.21.15.158:0/1374420030 >> [v2:172.21.15.158:6823/33196,v1:172.21.15.158:6825/33196] conn(0x7f11a80638b0 0x7f11a8065d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.543 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.535+0000 7f11b67fc700 1 -- 172.21.15.158:0/1374420030 --> [v2:172.21.15.158:6823/33196,v1:172.21.15.158:6825/33196] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11a8066390 con 0x7f11a80638b0 2023-10-18T17:24:12.544 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.535+0000 7f11b67fc700 1 -- 172.21.15.158:0/1374420030 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11b8078ab0 con 0x7f11c8062270 2023-10-18T17:24:12.544 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.535+0000 7f11c6d9d700 1 --2- 172.21.15.158:0/1374420030 >> [v2:172.21.15.158:6823/33196,v1:172.21.15.158:6825/33196] conn(0x7f11a80638b0 0x7f11a8065d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.544 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.535+0000 7f11c5d9b700 1 --2- 172.21.15.158:0/1374420030 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f11a805a510 0x7f11a805c9d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f11c815d870 tx=0x7f11bc007d30).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:12.544 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.535+0000 7f11c6d9d700 1 --2- 172.21.15.158:0/1374420030 >> [v2:172.21.15.158:6823/33196,v1:172.21.15.158:6825/33196] conn(0x7f11a80638b0 0x7f11a8065d10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:12.544 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.535+0000 7f11b67fc700 1 -- 172.21.15.158:0/1374420030 <== osd.1 v2:172.21.15.158:6823/33196 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f11a8066390 con 0x7f11a80638b0 2023-10-18T17:24:12.560 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.555+0000 7f11c759e700 1 -- 172.21.15.158:0/1374420030 --> [v2:172.21.15.158:6823/33196,v1:172.21.15.158:6825/33196] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f11c8153850 con 0x7f11a80638b0 2023-10-18T17:24:12.560 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.555+0000 7f11b67fc700 1 -- 172.21.15.158:0/1374420030 <== osd.1 v2:172.21.15.158:6823/33196 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f11c8153850 con 0x7f11a80638b0 2023-10-18T17:24:12.561 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.555+0000 7f11c759e700 1 -- 172.21.15.158:0/1374420030 >> [v2:172.21.15.158:6823/33196,v1:172.21.15.158:6825/33196] conn(0x7f11a80638b0 msgr2=0x7f11a8065d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.561 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.555+0000 7f11c759e700 1 --2- 172.21.15.158:0/1374420030 >> [v2:172.21.15.158:6823/33196,v1:172.21.15.158:6825/33196] conn(0x7f11a80638b0 0x7f11a8065d10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.562 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.555+0000 7f11c759e700 1 -- 172.21.15.158:0/1374420030 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f11a805a510 msgr2=0x7f11a805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.555+0000 7f11c759e700 1 --2- 172.21.15.158:0/1374420030 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f11a805a510 0x7f11a805c9d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f11c815d870 tx=0x7f11bc007d30).stop 2023-10-18T17:24:12.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.555+0000 7f11c759e700 1 -- 172.21.15.158:0/1374420030 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11c8062270 msgr2=0x7f11c80c5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.555+0000 7f11c759e700 1 --2- 172.21.15.158:0/1374420030 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11c8062270 0x7f11c80c5630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f11b8009130 tx=0x7f11b8017000).stop 2023-10-18T17:24:12.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.555+0000 7f11c6d9d700 1 -- 172.21.15.158:0/1374420030 reap_dead start 2023-10-18T17:24:12.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.555+0000 7f11c759e700 1 -- 172.21.15.158:0/1374420030 shutdown_connections 2023-10-18T17:24:12.564 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.555+0000 7f11c759e700 1 -- 172.21.15.158:0/1374420030 >> 172.21.15.158:0/1374420030 conn(0x7f11c805ddc0 msgr2=0x7f11c80c1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:12.564 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.555+0000 7f11c759e700 1 -- 172.21.15.158:0/1374420030 shutdown_connections 2023-10-18T17:24:12.564 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.555+0000 7f11c759e700 1 -- 172.21.15.158:0/1374420030 wait complete. 2023-10-18T17:24:12.586 INFO:teuthology.orchestra.run.smithi158.stdout:60129542151 2023-10-18T17:24:12.586 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-18T17:24:12.751 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-18T17:24:12.753 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.747+0000 7fd45288f700 1 Processor -- start 2023-10-18T17:24:12.754 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.747+0000 7fd45288f700 1 -- start start 2023-10-18T17:24:12.757 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.751+0000 7fd45288f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd44c0bf340 0x7fd44c0bf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.757 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.751+0000 7fd45288f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd44c0bcaf0 0x7fd44c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.758 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.751+0000 7fd45288f700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44c068ea0 con 0x7fd44c13d180 2023-10-18T17:24:12.758 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.751+0000 7fd45288f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44c154220 con 0x7fd44c0bcaf0 2023-10-18T17:24:12.758 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.751+0000 7fd45288f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c157970 con 0x7fd44c0bf340 2023-10-18T17:24:12.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.751+0000 7fd45108c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd44c0bcaf0 0x7fd44c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.751+0000 7fd45188d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd44c0bf340 0x7fd44c0bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.751+0000 7fd45208e700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fd44c13d180 0x7fd44c154670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:38622/0 (socket says 172.21.15.158:38622) 2023-10-18T17:24:12.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.751+0000 7fd45208e700 1 -- 172.21.15.158:0/2637296758 learned_addr learned my addr 172.21.15.158:0/2637296758 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:12.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.751+0000 7fd45188d700 1 -- 172.21.15.158:0/2637296758 >> v2:172.21.15.158:3300/0 conn(0x7fd44c0bcaf0 msgr2=0x7fd44c0689b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:12.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.751+0000 7fd45088b700 1 -- 172.21.15.158:0/2637296758 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935136157 0 0) 0x7fd44c068ea0 con 0x7fd44c13d180 2023-10-18T17:24:12.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.751+0000 7fd45188d700 1 --2- 172.21.15.158:0/2637296758 >> v2:172.21.15.158:3300/0 conn(0x7fd44c0bcaf0 0x7fd44c0689b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.751+0000 7fd45188d700 1 -- 172.21.15.158:0/2637296758 >> v1:172.21.15.158:6789/0 conn(0x7fd44c13d180 legacy=0x7fd44c154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.751+0000 7fd45188d700 1 -- 172.21.15.158:0/2637296758 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c157bf0 con 0x7fd44c0bf340 2023-10-18T17:24:12.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.751+0000 7fd45108c700 1 --2- 172.21.15.158:0/2637296758 >> v2:172.21.15.158:3300/0 conn(0x7fd44c0bcaf0 0x7fd44c0689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:12.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.751+0000 7fd45188d700 1 --2- 172.21.15.158:0/2637296758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd44c0bf340 0x7fd44c0bf720 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd448009760 tx=0x7fd448009060).ready entity=mon.2 client_cookie=ae01fd0fd115164e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:12.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.755+0000 7fd45088b700 1 -- 172.21.15.158:0/2637296758 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44800b590 con 0x7fd44c0bf340 2023-10-18T17:24:12.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.755+0000 7fd45088b700 1 -- 172.21.15.158:0/2637296758 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44800b6f0 con 0x7fd44c0bf340 2023-10-18T17:24:12.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.755+0000 7fd45088b700 1 -- 172.21.15.158:0/2637296758 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44800ba70 con 0x7fd44c0bf340 2023-10-18T17:24:12.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.755+0000 7fd45288f700 1 -- 172.21.15.158:0/2637296758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd44c0bf340 msgr2=0x7fd44c0bf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.755+0000 7fd45288f700 1 --2- 172.21.15.158:0/2637296758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd44c0bf340 0x7fd44c0bf720 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd448009760 tx=0x7fd448009060).stop 2023-10-18T17:24:12.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.755+0000 7fd45288f700 1 -- 172.21.15.158:0/2637296758 shutdown_connections 2023-10-18T17:24:12.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.755+0000 7fd45288f700 1 --2- 172.21.15.158:0/2637296758 >> v2:172.21.15.158:3300/0 conn(0x7fd44c0bcaf0 0x7fd44c0689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.755+0000 7fd45288f700 1 --2- 172.21.15.158:0/2637296758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd44c0bf340 0x7fd44c0bf720 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.755+0000 7fd45288f700 1 -- 172.21.15.158:0/2637296758 >> 172.21.15.158:0/2637296758 conn(0x7fd44c05ddc0 msgr2=0x7fd44c05e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:12.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.755+0000 7fd45288f700 1 -- 172.21.15.158:0/2637296758 shutdown_connections 2023-10-18T17:24:12.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.755+0000 7fd45288f700 1 -- 172.21.15.158:0/2637296758 wait complete. 2023-10-18T17:24:12.765 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.759+0000 7fd45288f700 1 Processor -- start 2023-10-18T17:24:12.765 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.759+0000 7fd45288f700 1 -- start start 2023-10-18T17:24:12.766 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.759+0000 7fd45288f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd44c0bcaf0 0x7fd44c137030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.766 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.759+0000 7fd45288f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd44c0bf340 0x7fd44c150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.766 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.759+0000 7fd45288f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd44c13d180 0x7fd44c0c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.759+0000 7fd45288f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c165400 con 0x7fd44c0bcaf0 2023-10-18T17:24:12.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.759+0000 7fd45288f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c136a50 con 0x7fd44c13d180 2023-10-18T17:24:12.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.759+0000 7fd45288f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c136cf0 con 0x7fd44c0bf340 2023-10-18T17:24:12.769 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.759+0000 7fd45188d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd44c0bcaf0 0x7fd44c137030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.769 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.759+0000 7fd45188d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd44c0bcaf0 0x7fd44c137030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56138/0 (socket says 172.21.15.158:56138) 2023-10-18T17:24:12.769 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.759+0000 7fd45188d700 1 -- 172.21.15.158:0/853471173 learned_addr learned my addr 172.21.15.158:0/853471173 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:12.769 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.759+0000 7fd45108c700 1 --2- 172.21.15.158:0/853471173 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd44c0bf340 0x7fd44c150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.769 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.759+0000 7fd45208e700 1 --2- 172.21.15.158:0/853471173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd44c13d180 0x7fd44c0c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.770 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.759+0000 7fd45188d700 1 -- 172.21.15.158:0/853471173 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd44c0bf340 msgr2=0x7fd44c150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.770 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.759+0000 7fd45188d700 1 --2- 172.21.15.158:0/853471173 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd44c0bf340 0x7fd44c150740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.770 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.759+0000 7fd45188d700 1 -- 172.21.15.158:0/853471173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd44c13d180 msgr2=0x7fd44c0c10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.770 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.759+0000 7fd45188d700 1 --2- 172.21.15.158:0/853471173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd44c13d180 0x7fd44c0c10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.770 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.759+0000 7fd45188d700 1 -- 172.21.15.158:0/853471173 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c0092a0 con 0x7fd44c0bcaf0 2023-10-18T17:24:12.771 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.759+0000 7fd45208e700 1 --2- 172.21.15.158:0/853471173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd44c13d180 0x7fd44c0c10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:24:12.771 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.763+0000 7fd45188d700 1 --2- 172.21.15.158:0/853471173 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd44c0bcaf0 0x7fd44c137030 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fd44c154360 tx=0x7fd448017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:12.771 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.763+0000 7fd441ffb700 1 -- 172.21.15.158:0/853471173 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44800b860 con 0x7fd44c0bcaf0 2023-10-18T17:24:12.771 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.763+0000 7fd441ffb700 1 -- 172.21.15.158:0/853471173 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44800b9c0 con 0x7fd44c0bcaf0 2023-10-18T17:24:12.771 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.763+0000 7fd45288f700 1 -- 172.21.15.158:0/853471173 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4480092a0 con 0x7fd44c0bcaf0 2023-10-18T17:24:12.772 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.763+0000 7fd441ffb700 1 -- 172.21.15.158:0/853471173 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44801b660 con 0x7fd44c0bcaf0 2023-10-18T17:24:12.772 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.763+0000 7fd45288f700 1 -- 172.21.15.158:0/853471173 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c164db0 con 0x7fd44c0bcaf0 2023-10-18T17:24:12.773 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.763+0000 7fd45288f700 1 -- 172.21.15.158:0/853471173 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd44c046f00 con 0x7fd44c0bcaf0 2023-10-18T17:24:12.773 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.763+0000 7fd441ffb700 1 -- 172.21.15.158:0/853471173 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd44801b9d0 con 0x7fd44c0bcaf0 2023-10-18T17:24:12.774 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.767+0000 7fd441ffb700 1 --2- 172.21.15.158:0/853471173 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fd43005a510 0x7fd43005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.774 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.767+0000 7fd441ffb700 1 -- 172.21.15.158:0/853471173 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd448076a50 con 0x7fd44c0bcaf0 2023-10-18T17:24:12.774 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.767+0000 7fd45108c700 1 --2- 172.21.15.158:0/853471173 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fd43005a510 0x7fd43005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.774 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.767+0000 7fd441ffb700 1 --2- 172.21.15.158:0/853471173 >> [v2:172.21.15.158:6808/33193,v1:172.21.15.158:6809/33193] conn(0x7fd4300638b0 0x7fd430065d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.774 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.767+0000 7fd441ffb700 1 -- 172.21.15.158:0/853471173 --> [v2:172.21.15.158:6808/33193,v1:172.21.15.158:6809/33193] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd430066390 con 0x7fd4300638b0 2023-10-18T17:24:12.775 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.767+0000 7fd441ffb700 1 -- 172.21.15.158:0/853471173 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd448076e00 con 0x7fd44c0bcaf0 2023-10-18T17:24:12.775 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.767+0000 7fd45208e700 1 --2- 172.21.15.158:0/853471173 >> [v2:172.21.15.158:6808/33193,v1:172.21.15.158:6809/33193] conn(0x7fd4300638b0 0x7fd430065d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.775 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.767+0000 7fd45108c700 1 --2- 172.21.15.158:0/853471173 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fd43005a510 0x7fd43005c9d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fd44c137a10 tx=0x7fd43c009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:12.776 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.767+0000 7fd45208e700 1 --2- 172.21.15.158:0/853471173 >> [v2:172.21.15.158:6808/33193,v1:172.21.15.158:6809/33193] conn(0x7fd4300638b0 0x7fd430065d10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:12.776 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.767+0000 7fd441ffb700 1 -- 172.21.15.158:0/853471173 <== osd.2 v2:172.21.15.158:6808/33193 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fd430066390 con 0x7fd4300638b0 2023-10-18T17:24:12.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.787+0000 7fd45288f700 1 -- 172.21.15.158:0/853471173 --> [v2:172.21.15.158:6808/33193,v1:172.21.15.158:6809/33193] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd44c157ed0 con 0x7fd4300638b0 2023-10-18T17:24:12.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.787+0000 7fd441ffb700 1 -- 172.21.15.158:0/853471173 <== osd.2 v2:172.21.15.158:6808/33193 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd44c157ed0 con 0x7fd4300638b0 2023-10-18T17:24:12.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.787+0000 7fd45288f700 1 -- 172.21.15.158:0/853471173 >> [v2:172.21.15.158:6808/33193,v1:172.21.15.158:6809/33193] conn(0x7fd4300638b0 msgr2=0x7fd430065d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.787+0000 7fd45288f700 1 --2- 172.21.15.158:0/853471173 >> [v2:172.21.15.158:6808/33193,v1:172.21.15.158:6809/33193] conn(0x7fd4300638b0 0x7fd430065d10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.787+0000 7fd45288f700 1 -- 172.21.15.158:0/853471173 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fd43005a510 msgr2=0x7fd43005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.787+0000 7fd45288f700 1 --2- 172.21.15.158:0/853471173 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fd43005a510 0x7fd43005c9d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fd44c137a10 tx=0x7fd43c009060).stop 2023-10-18T17:24:12.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.787+0000 7fd45288f700 1 -- 172.21.15.158:0/853471173 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd44c0bcaf0 msgr2=0x7fd44c137030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.787+0000 7fd45288f700 1 --2- 172.21.15.158:0/853471173 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd44c0bcaf0 0x7fd44c137030 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fd44c154360 tx=0x7fd448017000).stop 2023-10-18T17:24:12.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.787+0000 7fd45208e700 1 -- 172.21.15.158:0/853471173 reap_dead start 2023-10-18T17:24:12.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.787+0000 7fd45288f700 1 -- 172.21.15.158:0/853471173 shutdown_connections 2023-10-18T17:24:12.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.787+0000 7fd45288f700 1 -- 172.21.15.158:0/853471173 >> 172.21.15.158:0/853471173 conn(0x7fd44c05ddc0 msgr2=0x7fd44c154670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:12.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.787+0000 7fd45288f700 1 -- 172.21.15.158:0/853471173 shutdown_connections 2023-10-18T17:24:12.797 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.787+0000 7fd45288f700 1 -- 172.21.15.158:0/853471173 wait complete. 2023-10-18T17:24:12.816 INFO:teuthology.orchestra.run.smithi158.stdout:60129542150 2023-10-18T17:24:12.816 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-18T17:24:12.975 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.967+0000 7fc86359e700 1 Processor -- start 2023-10-18T17:24:12.976 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.967+0000 7fc86359e700 1 -- start start 2023-10-18T17:24:12.978 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.971+0000 7fc86359e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc864062270 0x7fc864062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.978 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.971+0000 7fc86359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc864066340 0x7fc8640c0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.979 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.971+0000 7fc86359e700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8640c2dd0 con 0x7fc86414d020 2023-10-18T17:24:12.979 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.971+0000 7fc86359e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc864153570 con 0x7fc864066340 2023-10-18T17:24:12.979 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.971+0000 7fc86359e700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc864153850 con 0x7fc864062270 2023-10-18T17:24:12.979 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.971+0000 7fc861d9b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc864066340 0x7fc8640c0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.980 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.971+0000 7fc86259c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc864062270 0x7fc864062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.980 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.971+0000 7fc86259c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc864062270 0x7fc864062650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:43736/0 (socket says 172.21.15.158:43736) 2023-10-18T17:24:12.980 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.971+0000 7fc86259c700 1 -- 172.21.15.158:0/438270158 learned_addr learned my addr 172.21.15.158:0/438270158 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:12.980 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.971+0000 7fc862d9d700 1 --1- 172.21.15.158:0/438270158 >> v1:172.21.15.183:6789/0 conn(0x7fc86414d020 0x7fc86414d470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:57040/0 (socket says 172.21.15.158:57040) 2023-10-18T17:24:12.982 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.971+0000 7fc86259c700 1 -- 172.21.15.158:0/438270158 >> v2:172.21.15.158:3300/0 conn(0x7fc864066340 msgr2=0x7fc8640c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:12.982 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.971+0000 7fc86259c700 1 --2- 172.21.15.158:0/438270158 >> v2:172.21.15.158:3300/0 conn(0x7fc864066340 0x7fc8640c0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.982 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.971+0000 7fc86259c700 1 -- 172.21.15.158:0/438270158 >> v1:172.21.15.183:6789/0 conn(0x7fc86414d020 legacy=0x7fc86414d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.982 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.971+0000 7fc86259c700 1 -- 172.21.15.158:0/438270158 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc864153b30 con 0x7fc864062270 2023-10-18T17:24:12.983 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.975+0000 7fc86259c700 1 --2- 172.21.15.158:0/438270158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc864062270 0x7fc864062650 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fc8640c3630 tx=0x7fc8540090f0).ready entity=mon.1 client_cookie=e41ff6834c660700 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:12.983 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.975+0000 7fc86159a700 1 -- 172.21.15.158:0/438270158 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85400b5b0 con 0x7fc864062270 2023-10-18T17:24:12.983 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.975+0000 7fc86159a700 1 -- 172.21.15.158:0/438270158 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85400b710 con 0x7fc864062270 2023-10-18T17:24:12.983 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.975+0000 7fc86159a700 1 -- 172.21.15.158:0/438270158 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85400ba90 con 0x7fc864062270 2023-10-18T17:24:12.983 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.975+0000 7fc86359e700 1 -- 172.21.15.158:0/438270158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc864062270 msgr2=0x7fc864062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.983 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.975+0000 7fc86359e700 1 --2- 172.21.15.158:0/438270158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc864062270 0x7fc864062650 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fc8640c3630 tx=0x7fc8540090f0).stop 2023-10-18T17:24:12.984 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.975+0000 7fc86359e700 1 -- 172.21.15.158:0/438270158 shutdown_connections 2023-10-18T17:24:12.984 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.975+0000 7fc86359e700 1 --2- 172.21.15.158:0/438270158 >> v2:172.21.15.158:3300/0 conn(0x7fc864066340 0x7fc8640c0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.984 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.975+0000 7fc86359e700 1 --2- 172.21.15.158:0/438270158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc864062270 0x7fc864062650 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.984 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.975+0000 7fc86359e700 1 -- 172.21.15.158:0/438270158 >> 172.21.15.158:0/438270158 conn(0x7fc86405ddc0 msgr2=0x7fc86405e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:12.984 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.975+0000 7fc86359e700 1 -- 172.21.15.158:0/438270158 shutdown_connections 2023-10-18T17:24:12.985 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.975+0000 7fc86359e700 1 -- 172.21.15.158:0/438270158 wait complete. 2023-10-18T17:24:12.986 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc86359e700 1 Processor -- start 2023-10-18T17:24:12.986 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc86359e700 1 -- start start 2023-10-18T17:24:12.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc86359e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc864062270 0x7fc8640bf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc86359e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc864066340 0x7fc864163f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc86359e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc86414d020 0x7fc8641486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc86359e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc864164450 con 0x7fc864066340 2023-10-18T17:24:12.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc86359e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86415ffa0 con 0x7fc864062270 2023-10-18T17:24:12.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc86359e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8640bfef0 con 0x7fc86414d020 2023-10-18T17:24:12.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc86259c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc864062270 0x7fc8640bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc86259c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc864062270 0x7fc8640bf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:43740/0 (socket says 172.21.15.158:43740) 2023-10-18T17:24:12.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc86259c700 1 -- 172.21.15.158:0/833234181 learned_addr learned my addr 172.21.15.158:0/833234181 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:12.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc862d9d700 1 --2- 172.21.15.158:0/833234181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc86414d020 0x7fc8641486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc861d9b700 1 --2- 172.21.15.158:0/833234181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc864066340 0x7fc864163f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.989 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc86259c700 1 -- 172.21.15.158:0/833234181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc86414d020 msgr2=0x7fc8641486e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.989 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc86259c700 1 --2- 172.21.15.158:0/833234181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc86414d020 0x7fc8641486e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.989 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc86259c700 1 -- 172.21.15.158:0/833234181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc864066340 msgr2=0x7fc864163f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:12.989 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc86259c700 1 --2- 172.21.15.158:0/833234181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc864066340 0x7fc864163f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:12.990 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc86259c700 1 -- 172.21.15.158:0/833234181 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc854009370 con 0x7fc864062270 2023-10-18T17:24:12.990 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc86259c700 1 --2- 172.21.15.158:0/833234181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc864062270 0x7fc8640bf900 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fc864153990 tx=0x7fc854017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:12.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc8527fc700 1 -- 172.21.15.158:0/833234181 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854000bc0 con 0x7fc864062270 2023-10-18T17:24:12.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc8527fc700 1 -- 172.21.15.158:0/833234181 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85400b880 con 0x7fc864062270 2023-10-18T17:24:12.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc8527fc700 1 -- 172.21.15.158:0/833234181 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854000d20 con 0x7fc864062270 2023-10-18T17:24:12.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc86359e700 1 -- 172.21.15.158:0/833234181 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8641601b0 con 0x7fc864062270 2023-10-18T17:24:12.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.979+0000 7fc86359e700 1 -- 172.21.15.158:0/833234181 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc864160770 con 0x7fc864062270 2023-10-18T17:24:12.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.983+0000 7fc86359e700 1 -- 172.21.15.158:0/833234181 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc864046f00 con 0x7fc864062270 2023-10-18T17:24:12.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.983+0000 7fc8527fc700 1 -- 172.21.15.158:0/833234181 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc85401c900 con 0x7fc864062270 2023-10-18T17:24:12.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.983+0000 7fc8527fc700 1 --2- 172.21.15.158:0/833234181 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc84405a510 0x7fc84405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.983+0000 7fc8527fc700 1 -- 172.21.15.158:0/833234181 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc854076790 con 0x7fc864062270 2023-10-18T17:24:12.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.983+0000 7fc8527fc700 1 --2- 172.21.15.158:0/833234181 >> [v2:172.21.15.158:6800/33194,v1:172.21.15.158:6801/33194] conn(0x7fc844063830 0x7fc844065c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:12.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.983+0000 7fc8527fc700 1 -- 172.21.15.158:0/833234181 --> [v2:172.21.15.158:6800/33194,v1:172.21.15.158:6801/33194] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc844066310 con 0x7fc844063830 2023-10-18T17:24:12.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.983+0000 7fc8527fc700 1 -- 172.21.15.158:0/833234181 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc854076a80 con 0x7fc864062270 2023-10-18T17:24:12.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.987+0000 7fc861d9b700 1 --2- 172.21.15.158:0/833234181 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc84405a510 0x7fc84405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.987+0000 7fc862d9d700 1 --2- 172.21.15.158:0/833234181 >> [v2:172.21.15.158:6800/33194,v1:172.21.15.158:6801/33194] conn(0x7fc844063830 0x7fc844065c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:12.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.987+0000 7fc861d9b700 1 --2- 172.21.15.158:0/833234181 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc84405a510 0x7fc84405c9d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc8640c3c80 tx=0x7fc858009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:12.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.987+0000 7fc862d9d700 1 --2- 172.21.15.158:0/833234181 >> [v2:172.21.15.158:6800/33194,v1:172.21.15.158:6801/33194] conn(0x7fc844063830 0x7fc844065c90 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:12.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:12.987+0000 7fc8527fc700 1 -- 172.21.15.158:0/833234181 <== osd.3 v2:172.21.15.158:6800/33194 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fc844066310 con 0x7fc844063830 2023-10-18T17:24:13.012 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.007+0000 7fc86359e700 1 -- 172.21.15.158:0/833234181 --> [v2:172.21.15.158:6800/33194,v1:172.21.15.158:6801/33194] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc864153e10 con 0x7fc844063830 2023-10-18T17:24:13.013 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.007+0000 7fc8527fc700 1 -- 172.21.15.158:0/833234181 <== osd.3 v2:172.21.15.158:6800/33194 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc864153e10 con 0x7fc844063830 2023-10-18T17:24:13.014 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.007+0000 7fc86359e700 1 -- 172.21.15.158:0/833234181 >> [v2:172.21.15.158:6800/33194,v1:172.21.15.158:6801/33194] conn(0x7fc844063830 msgr2=0x7fc844065c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.014 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.007+0000 7fc86359e700 1 --2- 172.21.15.158:0/833234181 >> [v2:172.21.15.158:6800/33194,v1:172.21.15.158:6801/33194] conn(0x7fc844063830 0x7fc844065c90 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.015 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.007+0000 7fc86359e700 1 -- 172.21.15.158:0/833234181 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc84405a510 msgr2=0x7fc84405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.015 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.007+0000 7fc86359e700 1 --2- 172.21.15.158:0/833234181 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc84405a510 0x7fc84405c9d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc8640c3c80 tx=0x7fc858009060).stop 2023-10-18T17:24:13.015 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.007+0000 7fc86359e700 1 -- 172.21.15.158:0/833234181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc864062270 msgr2=0x7fc8640bf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.015 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.007+0000 7fc86359e700 1 --2- 172.21.15.158:0/833234181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc864062270 0x7fc8640bf900 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fc864153990 tx=0x7fc854017000).stop 2023-10-18T17:24:13.016 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.007+0000 7fc862d9d700 1 -- 172.21.15.158:0/833234181 reap_dead start 2023-10-18T17:24:13.016 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.007+0000 7fc86359e700 1 -- 172.21.15.158:0/833234181 shutdown_connections 2023-10-18T17:24:13.016 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.007+0000 7fc86359e700 1 -- 172.21.15.158:0/833234181 >> 172.21.15.158:0/833234181 conn(0x7fc86405ddc0 msgr2=0x7fc8640c4560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:13.016 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.007+0000 7fc86359e700 1 -- 172.21.15.158:0/833234181 shutdown_connections 2023-10-18T17:24:13.016 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.007+0000 7fc86359e700 1 -- 172.21.15.158:0/833234181 wait complete. 2023-10-18T17:24:13.037 INFO:teuthology.orchestra.run.smithi158.stdout:55834574853 2023-10-18T17:24:13.038 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-18T17:24:13.197 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.191+0000 7f9c61839700 1 Processor -- start 2023-10-18T17:24:13.198 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.191+0000 7f9c61839700 1 -- start start 2023-10-18T17:24:13.202 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c61839700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9c5c1497c0 0x7f9c5c14f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.202 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c61839700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9c5c0bd9d0 0x7f9c5c14cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.202 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c61839700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c5c149ba0 0x7f9c5c0bcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.202 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c61839700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5c14c8f0 con 0x7f9c5c1497c0 2023-10-18T17:24:13.203 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c61839700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5c1507a0 con 0x7f9c5c0bd9d0 2023-10-18T17:24:13.203 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c61839700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c14ff00 con 0x7f9c5c149ba0 2023-10-18T17:24:13.203 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c53fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9c5c0bd9d0 0x7f9c5c14cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.203 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c53fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9c5c0bd9d0 0x7f9c5c14cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:43744/0 (socket says 172.21.15.158:43744) 2023-10-18T17:24:13.203 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c53fff700 1 -- 172.21.15.158:0/3898064974 learned_addr learned my addr 172.21.15.158:0/3898064974 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:13.204 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c60837700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9c5c1497c0 0x7f9c5c14f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.204 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c61038700 1 --2- 172.21.15.158:0/3898064974 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c5c149ba0 0x7f9c5c0bcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.206 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c53fff700 1 -- 172.21.15.158:0/3898064974 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c5c149ba0 msgr2=0x7f9c5c0bcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:13.206 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c53fff700 1 --2- 172.21.15.158:0/3898064974 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c5c149ba0 0x7f9c5c0bcaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.206 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c53fff700 1 -- 172.21.15.158:0/3898064974 >> v2:172.21.15.158:3300/0 conn(0x7f9c5c1497c0 msgr2=0x7f9c5c14f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:13.206 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c53fff700 1 --2- 172.21.15.158:0/3898064974 >> v2:172.21.15.158:3300/0 conn(0x7f9c5c1497c0 0x7f9c5c14f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c53fff700 1 -- 172.21.15.158:0/3898064974 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c1501e0 con 0x7f9c5c0bd9d0 2023-10-18T17:24:13.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c53fff700 1 --2- 172.21.15.158:0/3898064974 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c5c0bd9d0 0x7f9c5c14cd80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f9c5c0bfb90 tx=0x7f9c4c0090f0).ready entity=mon.1 client_cookie=842b9b930539849c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:13.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c537fe700 1 -- 172.21.15.158:0/3898064974 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c00f510 con 0x7f9c5c0bd9d0 2023-10-18T17:24:13.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c537fe700 1 -- 172.21.15.158:0/3898064974 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c00f670 con 0x7f9c5c0bd9d0 2023-10-18T17:24:13.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.195+0000 7f9c537fe700 1 -- 172.21.15.158:0/3898064974 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c00f9f0 con 0x7f9c5c0bd9d0 2023-10-18T17:24:13.208 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.199+0000 7f9c61839700 1 -- 172.21.15.158:0/3898064974 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c5c0bd9d0 msgr2=0x7f9c5c14cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.208 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.199+0000 7f9c61839700 1 --2- 172.21.15.158:0/3898064974 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c5c0bd9d0 0x7f9c5c14cd80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f9c5c0bfb90 tx=0x7f9c4c0090f0).stop 2023-10-18T17:24:13.208 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.199+0000 7f9c61839700 1 -- 172.21.15.158:0/3898064974 shutdown_connections 2023-10-18T17:24:13.208 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.199+0000 7f9c61839700 1 --2- 172.21.15.158:0/3898064974 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c5c149ba0 0x7f9c5c0bcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.199+0000 7f9c61839700 1 --2- 172.21.15.158:0/3898064974 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c5c0bd9d0 0x7f9c5c14cd80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.199+0000 7f9c61839700 1 --2- 172.21.15.158:0/3898064974 >> v2:172.21.15.158:3300/0 conn(0x7f9c5c1497c0 0x7f9c5c14f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.199+0000 7f9c61839700 1 -- 172.21.15.158:0/3898064974 >> 172.21.15.158:0/3898064974 conn(0x7f9c5c05ddc0 msgr2=0x7f9c5c05e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:13.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.199+0000 7f9c61839700 1 -- 172.21.15.158:0/3898064974 shutdown_connections 2023-10-18T17:24:13.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.199+0000 7f9c61839700 1 -- 172.21.15.158:0/3898064974 wait complete. 2023-10-18T17:24:13.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.199+0000 7f9c61839700 1 Processor -- start 2023-10-18T17:24:13.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.203+0000 7f9c61839700 1 -- start start 2023-10-18T17:24:13.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.203+0000 7f9c61839700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c5c0bd9d0 0x7f9c5c0b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.203+0000 7f9c61839700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c5c1497c0 0x7f9c5c0aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.203+0000 7f9c61839700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c5c149ba0 0x7f9c5c1646d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.203+0000 7f9c61839700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c164bc0 con 0x7f9c5c149ba0 2023-10-18T17:24:13.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.203+0000 7f9c61839700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0b21d0 con 0x7f9c5c1497c0 2023-10-18T17:24:13.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.203+0000 7f9c61839700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0b2b20 con 0x7f9c5c0bd9d0 2023-10-18T17:24:13.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.203+0000 7f9c60837700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c5c0bd9d0 0x7f9c5c0b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.203+0000 7f9c60837700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c5c0bd9d0 0x7f9c5c0b2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:60962/0 (socket says 172.21.15.158:60962) 2023-10-18T17:24:13.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.203+0000 7f9c60837700 1 -- 172.21.15.158:0/2850154400 learned_addr learned my addr 172.21.15.158:0/2850154400 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:13.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.203+0000 7f9c61038700 1 --2- 172.21.15.158:0/2850154400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c5c149ba0 0x7f9c5c1646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.203+0000 7f9c53fff700 1 --2- 172.21.15.158:0/2850154400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c5c1497c0 0x7f9c5c0aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.203+0000 7f9c60837700 1 -- 172.21.15.158:0/2850154400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c5c1497c0 msgr2=0x7f9c5c0aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.203+0000 7f9c60837700 1 --2- 172.21.15.158:0/2850154400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c5c1497c0 0x7f9c5c0aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.203+0000 7f9c60837700 1 -- 172.21.15.158:0/2850154400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c5c149ba0 msgr2=0x7f9c5c1646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.203+0000 7f9c60837700 1 --2- 172.21.15.158:0/2850154400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c5c149ba0 0x7f9c5c1646d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.203+0000 7f9c60837700 1 -- 172.21.15.158:0/2850154400 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c009370 con 0x7f9c5c0bd9d0 2023-10-18T17:24:13.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.203+0000 7f9c60837700 1 --2- 172.21.15.158:0/2850154400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c5c0bd9d0 0x7f9c5c0b2fb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9c5800e990 tx=0x7f9c58009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:13.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.203+0000 7f9c50ff9700 1 -- 172.21.15.158:0/2850154400 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5800c670 con 0x7f9c5c0bd9d0 2023-10-18T17:24:13.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.207+0000 7f9c50ff9700 1 -- 172.21.15.158:0/2850154400 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5800c7d0 con 0x7f9c5c0bd9d0 2023-10-18T17:24:13.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.207+0000 7f9c61839700 1 -- 172.21.15.158:0/2850154400 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5c0b1c50 con 0x7f9c5c0bd9d0 2023-10-18T17:24:13.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.207+0000 7f9c50ff9700 1 -- 172.21.15.158:0/2850154400 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5800cb50 con 0x7f9c5c0bd9d0 2023-10-18T17:24:13.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.207+0000 7f9c61839700 1 -- 172.21.15.158:0/2850154400 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5c0b24d0 con 0x7f9c5c0bd9d0 2023-10-18T17:24:13.218 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.207+0000 7f9c61839700 1 -- 172.21.15.158:0/2850154400 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9c5c046f00 con 0x7f9c5c0bd9d0 2023-10-18T17:24:13.219 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.207+0000 7f9c50ff9700 1 -- 172.21.15.158:0/2850154400 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9c5801b400 con 0x7f9c5c0bd9d0 2023-10-18T17:24:13.219 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.211+0000 7f9c50ff9700 1 --2- 172.21.15.158:0/2850154400 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9c4805a510 0x7f9c4805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.219 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.211+0000 7f9c50ff9700 1 -- 172.21.15.158:0/2850154400 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9c580752e0 con 0x7f9c5c0bd9d0 2023-10-18T17:24:13.219 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.211+0000 7f9c53fff700 1 --2- 172.21.15.158:0/2850154400 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9c4805a510 0x7f9c4805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.220 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.211+0000 7f9c50ff9700 1 --2- 172.21.15.158:0/2850154400 >> [v2:172.21.15.183:6800/33897,v1:172.21.15.183:6801/33897] conn(0x7f9c48063930 0x7f9c48065d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.220 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.211+0000 7f9c50ff9700 1 -- 172.21.15.158:0/2850154400 --> [v2:172.21.15.183:6800/33897,v1:172.21.15.183:6801/33897] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c48066410 con 0x7f9c48063930 2023-10-18T17:24:13.220 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.211+0000 7f9c50ff9700 1 -- 172.21.15.158:0/2850154400 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c58075610 con 0x7f9c5c0bd9d0 2023-10-18T17:24:13.220 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.211+0000 7f9c61038700 1 --2- 172.21.15.158:0/2850154400 >> [v2:172.21.15.183:6800/33897,v1:172.21.15.183:6801/33897] conn(0x7f9c48063930 0x7f9c48065d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.220 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.211+0000 7f9c53fff700 1 --2- 172.21.15.158:0/2850154400 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9c4805a510 0x7f9c4805c9d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f9c5c0bfb90 tx=0x7f9c4c017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:13.221 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.211+0000 7f9c61038700 1 --2- 172.21.15.158:0/2850154400 >> [v2:172.21.15.183:6800/33897,v1:172.21.15.183:6801/33897] conn(0x7f9c48063930 0x7f9c48065d90 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:13.221 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.211+0000 7f9c50ff9700 1 -- 172.21.15.158:0/2850154400 <== osd.4 v2:172.21.15.183:6800/33897 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f9c48066410 con 0x7f9c48063930 2023-10-18T17:24:13.237 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.231+0000 7f9c61839700 1 -- 172.21.15.158:0/2850154400 --> [v2:172.21.15.183:6800/33897,v1:172.21.15.183:6801/33897] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9c5c0b2c60 con 0x7f9c48063930 2023-10-18T17:24:13.238 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.231+0000 7f9c50ff9700 1 -- 172.21.15.158:0/2850154400 <== osd.4 v2:172.21.15.183:6800/33897 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9c5400f040 con 0x7f9c48063930 2023-10-18T17:24:13.239 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.231+0000 7f9c61839700 1 -- 172.21.15.158:0/2850154400 >> [v2:172.21.15.183:6800/33897,v1:172.21.15.183:6801/33897] conn(0x7f9c48063930 msgr2=0x7f9c48065d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.239 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.231+0000 7f9c61839700 1 --2- 172.21.15.158:0/2850154400 >> [v2:172.21.15.183:6800/33897,v1:172.21.15.183:6801/33897] conn(0x7f9c48063930 0x7f9c48065d90 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.231+0000 7f9c61839700 1 -- 172.21.15.158:0/2850154400 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9c4805a510 msgr2=0x7f9c4805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.231+0000 7f9c61839700 1 --2- 172.21.15.158:0/2850154400 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9c4805a510 0x7f9c4805c9d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f9c5c0bfb90 tx=0x7f9c4c017000).stop 2023-10-18T17:24:13.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.231+0000 7f9c61839700 1 -- 172.21.15.158:0/2850154400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c5c0bd9d0 msgr2=0x7f9c5c0b2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.231+0000 7f9c61839700 1 --2- 172.21.15.158:0/2850154400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c5c0bd9d0 0x7f9c5c0b2fb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9c5800e990 tx=0x7f9c58009060).stop 2023-10-18T17:24:13.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.231+0000 7f9c61038700 1 -- 172.21.15.158:0/2850154400 reap_dead start 2023-10-18T17:24:13.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.231+0000 7f9c61839700 1 -- 172.21.15.158:0/2850154400 shutdown_connections 2023-10-18T17:24:13.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.231+0000 7f9c61839700 1 -- 172.21.15.158:0/2850154400 >> 172.21.15.158:0/2850154400 conn(0x7f9c5c05ddc0 msgr2=0x7f9c5c0bf170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:13.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.235+0000 7f9c61839700 1 -- 172.21.15.158:0/2850154400 shutdown_connections 2023-10-18T17:24:13.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.235+0000 7f9c61839700 1 -- 172.21.15.158:0/2850154400 wait complete. 2023-10-18T17:24:13.261 INFO:teuthology.orchestra.run.smithi158.stdout:55834574854 2023-10-18T17:24:13.262 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-18T17:24:13.426 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.419+0000 7f5342ab9700 1 Processor -- start 2023-10-18T17:24:13.427 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.419+0000 7f5342ab9700 1 -- start start 2023-10-18T17:24:13.428 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5342ab9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f533c0bf340 0x7f533c0bf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.428 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5342ab9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f533c13d890 0x7f533c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.428 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5342ab9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f533c068ea0 con 0x7f533c0bcaf0 2023-10-18T17:24:13.428 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5342ab9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f533c154220 con 0x7f533c13d890 2023-10-18T17:24:13.429 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5342ab9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533c157970 con 0x7f533c0bf340 2023-10-18T17:24:13.431 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5341ab7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f533c0bf340 0x7f533c0bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.431 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f53422b8700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f533c13d890 0x7f533c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.431 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5341ab7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f533c0bf340 0x7f533c0bf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:60966/0 (socket says 172.21.15.158:60966) 2023-10-18T17:24:13.431 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5341ab7700 1 -- 172.21.15.158:0/3054717000 learned_addr learned my addr 172.21.15.158:0/3054717000 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:13.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5341ab7700 1 -- 172.21.15.158:0/3054717000 >> v2:172.21.15.183:3300/0 conn(0x7f533c13d890 msgr2=0x7f533c0689b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:13.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5341ab7700 1 --2- 172.21.15.158:0/3054717000 >> v2:172.21.15.183:3300/0 conn(0x7f533c13d890 0x7f533c0689b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5341ab7700 1 -- 172.21.15.158:0/3054717000 >> v1:172.21.15.183:6789/0 conn(0x7f533c0bcaf0 legacy=0x7f533c13d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5341ab7700 1 -- 172.21.15.158:0/3054717000 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c157bf0 con 0x7f533c0bf340 2023-10-18T17:24:13.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5341ab7700 1 --2- 172.21.15.158:0/3054717000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f533c0bf340 0x7f533c0bf720 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5338006fd0 tx=0x7f53380090f0).ready entity=mon.2 client_cookie=54b38db15d6a274a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:13.433 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5340ab5700 1 -- 172.21.15.158:0/3054717000 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533800b610 con 0x7f533c0bf340 2023-10-18T17:24:13.433 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5340ab5700 1 -- 172.21.15.158:0/3054717000 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533800b770 con 0x7f533c0bf340 2023-10-18T17:24:13.433 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5340ab5700 1 -- 172.21.15.158:0/3054717000 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533800baf0 con 0x7f533c0bf340 2023-10-18T17:24:13.433 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5342ab9700 1 -- 172.21.15.158:0/3054717000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f533c0bf340 msgr2=0x7f533c0bf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.433 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5342ab9700 1 --2- 172.21.15.158:0/3054717000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f533c0bf340 0x7f533c0bf720 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5338006fd0 tx=0x7f53380090f0).stop 2023-10-18T17:24:13.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5342ab9700 1 -- 172.21.15.158:0/3054717000 shutdown_connections 2023-10-18T17:24:13.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5342ab9700 1 --2- 172.21.15.158:0/3054717000 >> v2:172.21.15.183:3300/0 conn(0x7f533c13d890 0x7f533c0689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5342ab9700 1 --2- 172.21.15.158:0/3054717000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f533c0bf340 0x7f533c0bf720 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5342ab9700 1 -- 172.21.15.158:0/3054717000 >> 172.21.15.158:0/3054717000 conn(0x7f533c05ddc0 msgr2=0x7f533c05e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:13.435 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5342ab9700 1 -- 172.21.15.158:0/3054717000 shutdown_connections 2023-10-18T17:24:13.435 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.423+0000 7f5342ab9700 1 -- 172.21.15.158:0/3054717000 wait complete. 2023-10-18T17:24:13.436 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.427+0000 7f5342ab9700 1 Processor -- start 2023-10-18T17:24:13.437 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.427+0000 7f5342ab9700 1 -- start start 2023-10-18T17:24:13.437 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.427+0000 7f5342ab9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f533c0bcaf0 0x7f533c156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.437 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.427+0000 7f5342ab9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f533c0bf340 0x7f533c138290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.437 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.427+0000 7f5342ab9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f533c13d890 0x7f533c167dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.427+0000 7f5342ab9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c155620 con 0x7f533c13d890 2023-10-18T17:24:13.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.427+0000 7f5342ab9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c0bc530 con 0x7f533c0bcaf0 2023-10-18T17:24:13.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.427+0000 7f5342ab9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533c167940 con 0x7f533c0bf340 2023-10-18T17:24:13.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.427+0000 7f5341ab7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f533c0bcaf0 0x7f533c156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.427+0000 7f5341ab7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f533c0bcaf0 0x7f533c156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:43780/0 (socket says 172.21.15.158:43780) 2023-10-18T17:24:13.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.427+0000 7f5341ab7700 1 -- 172.21.15.158:0/2081740384 learned_addr learned my addr 172.21.15.158:0/2081740384 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:13.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.427+0000 7f53412b6700 1 --2- 172.21.15.158:0/2081740384 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f533c0bf340 0x7f533c138290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.427+0000 7f53422b8700 1 --2- 172.21.15.158:0/2081740384 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f533c13d890 0x7f533c167dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.431+0000 7f5341ab7700 1 -- 172.21.15.158:0/2081740384 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f533c0bf340 msgr2=0x7f533c138290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.431+0000 7f5341ab7700 1 --2- 172.21.15.158:0/2081740384 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f533c0bf340 0x7f533c138290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.440 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.431+0000 7f5341ab7700 1 -- 172.21.15.158:0/2081740384 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f533c13d890 msgr2=0x7f533c167dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.440 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.431+0000 7f5341ab7700 1 --2- 172.21.15.158:0/2081740384 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f533c13d890 0x7f533c167dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.440 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.431+0000 7f5341ab7700 1 -- 172.21.15.158:0/2081740384 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5338009370 con 0x7f533c0bcaf0 2023-10-18T17:24:13.440 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.431+0000 7f5341ab7700 1 --2- 172.21.15.158:0/2081740384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f533c0bcaf0 0x7f533c156d00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f5338009fd0 tx=0x7f5338017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:13.442 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.431+0000 7f5331ffb700 1 -- 172.21.15.158:0/2081740384 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533800beb0 con 0x7f533c0bcaf0 2023-10-18T17:24:13.442 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.431+0000 7f5331ffb700 1 -- 172.21.15.158:0/2081740384 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5338006a40 con 0x7f533c0bcaf0 2023-10-18T17:24:13.442 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.431+0000 7f5342ab9700 1 -- 172.21.15.158:0/2081740384 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533c0bb9b0 con 0x7f533c0bcaf0 2023-10-18T17:24:13.442 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.431+0000 7f5331ffb700 1 -- 172.21.15.158:0/2081740384 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533801c420 con 0x7f533c0bcaf0 2023-10-18T17:24:13.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.431+0000 7f5342ab9700 1 -- 172.21.15.158:0/2081740384 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533c0bbf70 con 0x7f533c0bcaf0 2023-10-18T17:24:13.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.431+0000 7f5342ab9700 1 -- 172.21.15.158:0/2081740384 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f533c046f00 con 0x7f533c0bcaf0 2023-10-18T17:24:13.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.435+0000 7f5331ffb700 1 -- 172.21.15.158:0/2081740384 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f533801c7d0 con 0x7f533c0bcaf0 2023-10-18T17:24:13.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.435+0000 7f5331ffb700 1 --2- 172.21.15.158:0/2081740384 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f532005a510 0x7f532005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.435+0000 7f5331ffb700 1 -- 172.21.15.158:0/2081740384 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f53380764f0 con 0x7f533c0bcaf0 2023-10-18T17:24:13.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.435+0000 7f5331ffb700 1 --2- 172.21.15.158:0/2081740384 >> [v2:172.21.15.183:6802/33898,v1:172.21.15.183:6804/33898] conn(0x7f5320063930 0x7f5320065d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.435+0000 7f5331ffb700 1 -- 172.21.15.158:0/2081740384 --> [v2:172.21.15.183:6802/33898,v1:172.21.15.183:6804/33898] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5320066410 con 0x7f5320063930 2023-10-18T17:24:13.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.435+0000 7f53412b6700 1 --2- 172.21.15.158:0/2081740384 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f532005a510 0x7f532005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.435+0000 7f5331ffb700 1 -- 172.21.15.158:0/2081740384 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5338078a10 con 0x7f533c0bcaf0 2023-10-18T17:24:13.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.435+0000 7f53422b8700 1 --2- 172.21.15.158:0/2081740384 >> [v2:172.21.15.183:6802/33898,v1:172.21.15.183:6804/33898] conn(0x7f5320063930 0x7f5320065d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.435+0000 7f53412b6700 1 --2- 172.21.15.158:0/2081740384 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f532005a510 0x7f532005c9d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f533c154ac0 tx=0x7f532c007d40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:13.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.435+0000 7f53422b8700 1 --2- 172.21.15.158:0/2081740384 >> [v2:172.21.15.183:6802/33898,v1:172.21.15.183:6804/33898] conn(0x7f5320063930 0x7f5320065d90 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:13.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.439+0000 7f5331ffb700 1 -- 172.21.15.158:0/2081740384 <== osd.5 v2:172.21.15.183:6802/33898 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f5320066410 con 0x7f5320063930 2023-10-18T17:24:13.466 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.459+0000 7f5342ab9700 1 -- 172.21.15.158:0/2081740384 --> [v2:172.21.15.183:6802/33898,v1:172.21.15.183:6804/33898] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f533c157ed0 con 0x7f5320063930 2023-10-18T17:24:13.466 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.459+0000 7f5331ffb700 1 -- 172.21.15.158:0/2081740384 <== osd.5 v2:172.21.15.183:6802/33898 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f533c157ed0 con 0x7f5320063930 2023-10-18T17:24:13.467 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.459+0000 7f5342ab9700 1 -- 172.21.15.158:0/2081740384 >> [v2:172.21.15.183:6802/33898,v1:172.21.15.183:6804/33898] conn(0x7f5320063930 msgr2=0x7f5320065d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.467 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.459+0000 7f5342ab9700 1 --2- 172.21.15.158:0/2081740384 >> [v2:172.21.15.183:6802/33898,v1:172.21.15.183:6804/33898] conn(0x7f5320063930 0x7f5320065d90 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.468 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.463+0000 7f5342ab9700 1 -- 172.21.15.158:0/2081740384 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f532005a510 msgr2=0x7f532005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.469 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.463+0000 7f5342ab9700 1 --2- 172.21.15.158:0/2081740384 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f532005a510 0x7f532005c9d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f533c154ac0 tx=0x7f532c007d40).stop 2023-10-18T17:24:13.469 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.463+0000 7f5342ab9700 1 -- 172.21.15.158:0/2081740384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f533c0bcaf0 msgr2=0x7f533c156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.469 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.463+0000 7f5342ab9700 1 --2- 172.21.15.158:0/2081740384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f533c0bcaf0 0x7f533c156d00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f5338009fd0 tx=0x7f5338017000).stop 2023-10-18T17:24:13.469 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.463+0000 7f53422b8700 1 -- 172.21.15.158:0/2081740384 reap_dead start 2023-10-18T17:24:13.470 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.463+0000 7f5342ab9700 1 -- 172.21.15.158:0/2081740384 shutdown_connections 2023-10-18T17:24:13.470 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.463+0000 7f5342ab9700 1 -- 172.21.15.158:0/2081740384 >> 172.21.15.158:0/2081740384 conn(0x7f533c05ddc0 msgr2=0x7f533c065220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:13.470 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.463+0000 7f5342ab9700 1 -- 172.21.15.158:0/2081740384 shutdown_connections 2023-10-18T17:24:13.470 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.463+0000 7f5342ab9700 1 -- 172.21.15.158:0/2081740384 wait complete. 2023-10-18T17:24:13.491 INFO:teuthology.orchestra.run.smithi158.stdout:55834574854 2023-10-18T17:24:13.492 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-18T17:24:13.659 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.651+0000 7f566ae5b700 1 Processor -- start 2023-10-18T17:24:13.659 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.651+0000 7f566ae5b700 1 -- start start 2023-10-18T17:24:13.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.655+0000 7f566ae5b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56640c2840 0x7f5664157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.655+0000 7f566ae5b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5664155b60 con 0x7f56640c2460 2023-10-18T17:24:13.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.655+0000 7f566ae5b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56640bcd80 con 0x7f56641578f0 2023-10-18T17:24:13.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.655+0000 7f566ae5b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56641546a0 con 0x7f56640c2840 2023-10-18T17:24:13.663 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.655+0000 7f5668bf7700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f56640c2460 0x7f5664151160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:38638/0 (socket says 172.21.15.158:38638) 2023-10-18T17:24:13.663 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.655+0000 7f5668bf7700 1 -- 172.21.15.158:0/684126163 learned_addr learned my addr 172.21.15.158:0/684126163 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:13.664 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.655+0000 7f56693f8700 1 --2- 172.21.15.158:0/684126163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56640c2840 0x7f5664157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.664 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.655+0000 7f56637fe700 1 -- 172.21.15.158:0/684126163 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319896071 0 0) 0x7f5664155b60 con 0x7f56640c2460 2023-10-18T17:24:13.664 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.655+0000 7f56637fe700 1 -- 172.21.15.158:0/684126163 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56540033f0 con 0x7f56640c2460 2023-10-18T17:24:13.665 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.655+0000 7f56693f8700 1 -- 172.21.15.158:0/684126163 >> v1:172.21.15.183:6789/0 conn(0x7f56641578f0 legacy=0x7f5664151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.665 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.655+0000 7f56693f8700 1 -- 172.21.15.158:0/684126163 >> v1:172.21.15.158:6789/0 conn(0x7f56640c2460 legacy=0x7f5664151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.665 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.655+0000 7f56693f8700 1 -- 172.21.15.158:0/684126163 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5664154960 con 0x7f56640c2840 2023-10-18T17:24:13.665 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.655+0000 7f56693f8700 1 --2- 172.21.15.158:0/684126163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56640c2840 0x7f5664157000 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f565c009e90 tx=0x7f565c009780).ready entity=mon.2 client_cookie=d4e9108a4ed9126b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:13.665 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.659+0000 7f56637fe700 1 -- 172.21.15.158:0/684126163 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c00e070 con 0x7f56640c2840 2023-10-18T17:24:13.666 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.659+0000 7f56637fe700 1 -- 172.21.15.158:0/684126163 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c00bb60 con 0x7f56640c2840 2023-10-18T17:24:13.666 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.659+0000 7f56637fe700 1 -- 172.21.15.158:0/684126163 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c012410 con 0x7f56640c2840 2023-10-18T17:24:13.667 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.659+0000 7f566ae5b700 1 -- 172.21.15.158:0/684126163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56640c2840 msgr2=0x7f5664157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.667 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.659+0000 7f566ae5b700 1 --2- 172.21.15.158:0/684126163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56640c2840 0x7f5664157000 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f565c009e90 tx=0x7f565c009780).stop 2023-10-18T17:24:13.667 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.659+0000 7f566ae5b700 1 -- 172.21.15.158:0/684126163 shutdown_connections 2023-10-18T17:24:13.668 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.659+0000 7f566ae5b700 1 --2- 172.21.15.158:0/684126163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56640c2840 0x7f5664157000 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.668 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.659+0000 7f566ae5b700 1 -- 172.21.15.158:0/684126163 >> 172.21.15.158:0/684126163 conn(0x7f566405dc20 msgr2=0x7f566405e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:13.668 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.659+0000 7f566ae5b700 1 -- 172.21.15.158:0/684126163 shutdown_connections 2023-10-18T17:24:13.668 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.659+0000 7f566ae5b700 1 -- 172.21.15.158:0/684126163 wait complete. 2023-10-18T17:24:13.668 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.659+0000 7f566ae5b700 1 Processor -- start 2023-10-18T17:24:13.669 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f566ae5b700 1 -- start start 2023-10-18T17:24:13.670 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f566ae5b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56640c2460 0x7f566415af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.670 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f566ae5b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56640c2840 0x7f56641502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.670 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f566ae5b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56641578f0 0x7f566415a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.670 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f566ae5b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566415b8f0 con 0x7f56641578f0 2023-10-18T17:24:13.671 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f566ae5b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56640b8d70 con 0x7f56640c2460 2023-10-18T17:24:13.671 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f566ae5b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56641507e0 con 0x7f56640c2840 2023-10-18T17:24:13.671 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f56693f8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56641578f0 0x7f566415a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.671 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f5668bf7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56640c2460 0x7f566415af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.671 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f56693f8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56641578f0 0x7f566415a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56188/0 (socket says 172.21.15.158:56188) 2023-10-18T17:24:13.672 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f56693f8700 1 -- 172.21.15.158:0/605665321 learned_addr learned my addr 172.21.15.158:0/605665321 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:13.672 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f5663fff700 1 --2- 172.21.15.158:0/605665321 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56640c2840 0x7f56641502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.673 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f56693f8700 1 -- 172.21.15.158:0/605665321 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56640c2840 msgr2=0x7f56641502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.674 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f56693f8700 1 --2- 172.21.15.158:0/605665321 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56640c2840 0x7f56641502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.674 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f56693f8700 1 -- 172.21.15.158:0/605665321 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56640c2460 msgr2=0x7f566415af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.674 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f56693f8700 1 --2- 172.21.15.158:0/605665321 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56640c2460 0x7f566415af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.674 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f56693f8700 1 -- 172.21.15.158:0/605665321 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c009a20 con 0x7f56641578f0 2023-10-18T17:24:13.674 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f56693f8700 1 --2- 172.21.15.158:0/605665321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56641578f0 0x7f566415a320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f565c00b6c0 tx=0x7f5664069960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:13.675 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f5660ff9700 1 -- 172.21.15.158:0/605665321 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c01d630 con 0x7f56641578f0 2023-10-18T17:24:13.675 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f5660ff9700 1 -- 172.21.15.158:0/605665321 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c01d790 con 0x7f56641578f0 2023-10-18T17:24:13.675 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f566ae5b700 1 -- 172.21.15.158:0/605665321 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5664159e90 con 0x7f56641578f0 2023-10-18T17:24:13.675 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f5660ff9700 1 -- 172.21.15.158:0/605665321 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c01db50 con 0x7f56641578f0 2023-10-18T17:24:13.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.663+0000 7f566ae5b700 1 -- 172.21.15.158:0/605665321 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56640b9c30 con 0x7f56641578f0 2023-10-18T17:24:13.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.667+0000 7f566ae5b700 1 -- 172.21.15.158:0/605665321 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f566406c190 con 0x7f56641578f0 2023-10-18T17:24:13.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.667+0000 7f5660ff9700 1 -- 172.21.15.158:0/605665321 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f565c003040 con 0x7f56641578f0 2023-10-18T17:24:13.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.667+0000 7f5660ff9700 1 --2- 172.21.15.158:0/605665321 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f564805a510 0x7f564805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.667+0000 7f5660ff9700 1 -- 172.21.15.158:0/605665321 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f565c0765c0 con 0x7f56641578f0 2023-10-18T17:24:13.678 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.667+0000 7f5660ff9700 1 --2- 172.21.15.158:0/605665321 >> [v2:172.21.15.183:6824/33910,v1:172.21.15.183:6825/33910] conn(0x7f5648063930 0x7f5648065d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.678 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.667+0000 7f5660ff9700 1 -- 172.21.15.158:0/605665321 --> [v2:172.21.15.183:6824/33910,v1:172.21.15.183:6825/33910] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5648066410 con 0x7f5648063930 2023-10-18T17:24:13.678 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.667+0000 7f5660ff9700 1 -- 172.21.15.158:0/605665321 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f565c078ae0 con 0x7f56641578f0 2023-10-18T17:24:13.678 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.667+0000 7f5668bf7700 1 --2- 172.21.15.158:0/605665321 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f564805a510 0x7f564805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.679 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.667+0000 7f5663fff700 1 --2- 172.21.15.158:0/605665321 >> [v2:172.21.15.183:6824/33910,v1:172.21.15.183:6825/33910] conn(0x7f5648063930 0x7f5648065d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.679 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.671+0000 7f5668bf7700 1 --2- 172.21.15.158:0/605665321 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f564805a510 0x7f564805c9d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f5658005750 tx=0x7f5658009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:13.679 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.671+0000 7f5663fff700 1 --2- 172.21.15.158:0/605665321 >> [v2:172.21.15.183:6824/33910,v1:172.21.15.183:6825/33910] conn(0x7f5648063930 0x7f5648065d90 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:13.679 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.671+0000 7f5660ff9700 1 -- 172.21.15.158:0/605665321 <== osd.6 v2:172.21.15.183:6824/33910 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f5648066410 con 0x7f5648063930 2023-10-18T17:24:13.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.691+0000 7f566ae5b700 1 -- 172.21.15.158:0/605665321 --> [v2:172.21.15.183:6824/33910,v1:172.21.15.183:6825/33910] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f566415a020 con 0x7f5648063930 2023-10-18T17:24:13.700 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.691+0000 7f5660ff9700 1 -- 172.21.15.158:0/605665321 <== osd.6 v2:172.21.15.183:6824/33910 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f566415a020 con 0x7f5648063930 2023-10-18T17:24:13.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.691+0000 7f566ae5b700 1 -- 172.21.15.158:0/605665321 >> [v2:172.21.15.183:6824/33910,v1:172.21.15.183:6825/33910] conn(0x7f5648063930 msgr2=0x7f5648065d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.695+0000 7f566ae5b700 1 --2- 172.21.15.158:0/605665321 >> [v2:172.21.15.183:6824/33910,v1:172.21.15.183:6825/33910] conn(0x7f5648063930 0x7f5648065d90 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.695+0000 7f566ae5b700 1 -- 172.21.15.158:0/605665321 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f564805a510 msgr2=0x7f564805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.695+0000 7f566ae5b700 1 --2- 172.21.15.158:0/605665321 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f564805a510 0x7f564805c9d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f5658005750 tx=0x7f5658009040).stop 2023-10-18T17:24:13.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.695+0000 7f566ae5b700 1 -- 172.21.15.158:0/605665321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56641578f0 msgr2=0x7f566415a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.695+0000 7f566ae5b700 1 --2- 172.21.15.158:0/605665321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56641578f0 0x7f566415a320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f565c00b6c0 tx=0x7f5664069960).stop 2023-10-18T17:24:13.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.695+0000 7f56693f8700 1 -- 172.21.15.158:0/605665321 reap_dead start 2023-10-18T17:24:13.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.695+0000 7f566ae5b700 1 -- 172.21.15.158:0/605665321 shutdown_connections 2023-10-18T17:24:13.703 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.695+0000 7f566ae5b700 1 -- 172.21.15.158:0/605665321 >> 172.21.15.158:0/605665321 conn(0x7f566405dc20 msgr2=0x7f5664065260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:13.703 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.695+0000 7f566ae5b700 1 -- 172.21.15.158:0/605665321 shutdown_connections 2023-10-18T17:24:13.703 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.695+0000 7f566ae5b700 1 -- 172.21.15.158:0/605665321 wait complete. 2023-10-18T17:24:13.721 INFO:teuthology.orchestra.run.smithi158.stdout:55834574853 2023-10-18T17:24:13.721 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-18T17:24:13.893 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.887+0000 7f164cd47700 1 Processor -- start 2023-10-18T17:24:13.893 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.887+0000 7f164cd47700 1 -- start start 2023-10-18T17:24:13.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.887+0000 7f164cd47700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f16480bd9d0 0x7f164814f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.887+0000 7f164cd47700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164814c8f0 con 0x7f1648149ba0 2023-10-18T17:24:13.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.887+0000 7f164cd47700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16481507a0 con 0x7f16481497c0 2023-10-18T17:24:13.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.887+0000 7f164cd47700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164814ff00 con 0x7f16480bd9d0 2023-10-18T17:24:13.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.891+0000 7f16477fe700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f16481497c0 0x7f164814cd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:57062/0 (socket says 172.21.15.158:57062) 2023-10-18T17:24:13.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.891+0000 7f16477fe700 1 -- 172.21.15.158:0/1199214689 learned_addr learned my addr 172.21.15.158:0/1199214689 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:13.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.891+0000 7f1646ffd700 1 --2- 172.21.15.158:0/1199214689 >> v2:172.21.15.158:3300/0 conn(0x7f16480bd9d0 0x7f164814f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.891+0000 7f16467fc700 1 -- 172.21.15.158:0/1199214689 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731428302 0 0) 0x7f16481507a0 con 0x7f16481497c0 2023-10-18T17:24:13.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.891+0000 7f16467fc700 1 -- 172.21.15.158:0/1199214689 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1630004500 con 0x7f16481497c0 2023-10-18T17:24:13.899 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.891+0000 7f1646ffd700 1 -- 172.21.15.158:0/1199214689 >> v1:172.21.15.183:6789/0 conn(0x7f16481497c0 legacy=0x7f164814cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.899 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.891+0000 7f1646ffd700 1 -- 172.21.15.158:0/1199214689 >> v1:172.21.15.158:6789/0 conn(0x7f1648149ba0 legacy=0x7f16480bcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.899 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.891+0000 7f1646ffd700 1 -- 172.21.15.158:0/1199214689 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16481501e0 con 0x7f16480bd9d0 2023-10-18T17:24:13.899 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.891+0000 7f1646ffd700 1 --2- 172.21.15.158:0/1199214689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16480bd9d0 0x7f164814f930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f163c009760 tx=0x7f163c009060).ready entity=mon.0 client_cookie=ce1a0d08e836c380 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:13.899 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.891+0000 7f16467fc700 1 -- 172.21.15.158:0/1199214689 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c00f510 con 0x7f16480bd9d0 2023-10-18T17:24:13.900 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.891+0000 7f16467fc700 1 -- 172.21.15.158:0/1199214689 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163c00f670 con 0x7f16480bd9d0 2023-10-18T17:24:13.900 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.891+0000 7f16467fc700 1 -- 172.21.15.158:0/1199214689 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c00f9f0 con 0x7f16480bd9d0 2023-10-18T17:24:13.900 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.891+0000 7f164cd47700 1 -- 172.21.15.158:0/1199214689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16480bd9d0 msgr2=0x7f164814f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.900 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.891+0000 7f164cd47700 1 --2- 172.21.15.158:0/1199214689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16480bd9d0 0x7f164814f930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f163c009760 tx=0x7f163c009060).stop 2023-10-18T17:24:13.900 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.891+0000 7f164cd47700 1 -- 172.21.15.158:0/1199214689 shutdown_connections 2023-10-18T17:24:13.901 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.891+0000 7f164cd47700 1 --2- 172.21.15.158:0/1199214689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16480bd9d0 0x7f164814f930 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.901 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.891+0000 7f164cd47700 1 -- 172.21.15.158:0/1199214689 >> 172.21.15.158:0/1199214689 conn(0x7f164805ddc0 msgr2=0x7f164805e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:13.901 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.891+0000 7f164cd47700 1 -- 172.21.15.158:0/1199214689 shutdown_connections 2023-10-18T17:24:13.901 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.891+0000 7f164cd47700 1 -- 172.21.15.158:0/1199214689 wait complete. 2023-10-18T17:24:13.902 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.895+0000 7f164cd47700 1 Processor -- start 2023-10-18T17:24:13.902 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.895+0000 7f164cd47700 1 -- start start 2023-10-18T17:24:13.903 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.895+0000 7f164cd47700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16480bd9d0 0x7f1648062270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.903 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.895+0000 7f164cd47700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16481497c0 0x7f16481468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.903 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.895+0000 7f164cd47700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1648149ba0 0x7f1648146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.904 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.895+0000 7f164cd47700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16481472a0 con 0x7f1648149ba0 2023-10-18T17:24:13.904 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.895+0000 7f164cd47700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1648160260 con 0x7f16480bd9d0 2023-10-18T17:24:13.904 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.895+0000 7f164cd47700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164814f960 con 0x7f16481497c0 2023-10-18T17:24:13.904 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.895+0000 7f16477fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16480bd9d0 0x7f1648062270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.904 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.895+0000 7f1647fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1648149ba0 0x7f1648146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.905 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.895+0000 7f1646ffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16481497c0 0x7f16481468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.905 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.895+0000 7f16477fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16480bd9d0 0x7f1648062270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:43790/0 (socket says 172.21.15.158:43790) 2023-10-18T17:24:13.905 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.895+0000 7f16477fe700 1 -- 172.21.15.158:0/2043654813 learned_addr learned my addr 172.21.15.158:0/2043654813 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:13.906 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.899+0000 7f1647fff700 1 -- 172.21.15.158:0/2043654813 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16481497c0 msgr2=0x7f16481468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.907 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.899+0000 7f1647fff700 1 --2- 172.21.15.158:0/2043654813 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16481497c0 0x7f16481468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.907 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.899+0000 7f1647fff700 1 -- 172.21.15.158:0/2043654813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16480bd9d0 msgr2=0x7f1648062270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.907 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.899+0000 7f1647fff700 1 --2- 172.21.15.158:0/2043654813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16480bd9d0 0x7f1648062270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.907 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.899+0000 7f1647fff700 1 -- 172.21.15.158:0/2043654813 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c0092a0 con 0x7f1648149ba0 2023-10-18T17:24:13.907 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.899+0000 7f16477fe700 1 --2- 172.21.15.158:0/2043654813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16480bd9d0 0x7f1648062270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:13.908 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.899+0000 7f1647fff700 1 --2- 172.21.15.158:0/2043654813 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1648149ba0 0x7f1648146db0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f164000c790 tx=0x7f1640001460).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:13.908 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.899+0000 7f162f7fe700 1 -- 172.21.15.158:0/2043654813 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164000e4a0 con 0x7f1648149ba0 2023-10-18T17:24:13.908 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.899+0000 7f162f7fe700 1 -- 172.21.15.158:0/2043654813 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164000e600 con 0x7f1648149ba0 2023-10-18T17:24:13.908 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.899+0000 7f162f7fe700 1 -- 172.21.15.158:0/2043654813 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164000e980 con 0x7f1648149ba0 2023-10-18T17:24:13.908 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.899+0000 7f164cd47700 1 -- 172.21.15.158:0/2043654813 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16481604e0 con 0x7f1648149ba0 2023-10-18T17:24:13.908 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.899+0000 7f164cd47700 1 -- 172.21.15.158:0/2043654813 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1648160aa0 con 0x7f1648149ba0 2023-10-18T17:24:13.909 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.899+0000 7f164cd47700 1 -- 172.21.15.158:0/2043654813 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1648046f00 con 0x7f1648149ba0 2023-10-18T17:24:13.910 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.899+0000 7f162f7fe700 1 -- 172.21.15.158:0/2043654813 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f16400123f0 con 0x7f1648149ba0 2023-10-18T17:24:13.910 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.903+0000 7f162f7fe700 1 --2- 172.21.15.158:0/2043654813 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f163405a510 0x7f163405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.910 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.903+0000 7f162f7fe700 1 -- 172.21.15.158:0/2043654813 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1640073fe0 con 0x7f1648149ba0 2023-10-18T17:24:13.910 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.903+0000 7f162f7fe700 1 --2- 172.21.15.158:0/2043654813 >> [v2:172.21.15.183:6816/33903,v1:172.21.15.183:6817/33903] conn(0x7f16340638b0 0x7f1634065d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:13.911 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.903+0000 7f162f7fe700 1 -- 172.21.15.158:0/2043654813 --> [v2:172.21.15.183:6816/33903,v1:172.21.15.183:6817/33903] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1634066390 con 0x7f16340638b0 2023-10-18T17:24:13.911 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.903+0000 7f162f7fe700 1 -- 172.21.15.158:0/2043654813 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1640076540 con 0x7f1648149ba0 2023-10-18T17:24:13.911 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.903+0000 7f16477fe700 1 --2- 172.21.15.158:0/2043654813 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f163405a510 0x7f163405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.911 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.903+0000 7f1646ffd700 1 --2- 172.21.15.158:0/2043654813 >> [v2:172.21.15.183:6816/33903,v1:172.21.15.183:6817/33903] conn(0x7f16340638b0 0x7f1634065d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:13.911 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.903+0000 7f16477fe700 1 --2- 172.21.15.158:0/2043654813 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f163405a510 0x7f163405c9d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f1638001d50 tx=0x7f1638009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:13.911 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.903+0000 7f1646ffd700 1 --2- 172.21.15.158:0/2043654813 >> [v2:172.21.15.183:6816/33903,v1:172.21.15.183:6817/33903] conn(0x7f16340638b0 0x7f1634065d10 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:13.912 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.907+0000 7f162f7fe700 1 -- 172.21.15.158:0/2043654813 <== osd.7 v2:172.21.15.183:6816/33903 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f1634066390 con 0x7f16340638b0 2023-10-18T17:24:13.927 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.919+0000 7f164cd47700 1 -- 172.21.15.158:0/2043654813 --> [v2:172.21.15.183:6816/33903,v1:172.21.15.183:6817/33903] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f164806b210 con 0x7f16340638b0 2023-10-18T17:24:13.929 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.923+0000 7f162f7fe700 1 -- 172.21.15.158:0/2043654813 <== osd.7 v2:172.21.15.183:6816/33903 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f164806b210 con 0x7f16340638b0 2023-10-18T17:24:13.930 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.923+0000 7f164cd47700 1 -- 172.21.15.158:0/2043654813 >> [v2:172.21.15.183:6816/33903,v1:172.21.15.183:6817/33903] conn(0x7f16340638b0 msgr2=0x7f1634065d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.930 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.923+0000 7f164cd47700 1 --2- 172.21.15.158:0/2043654813 >> [v2:172.21.15.183:6816/33903,v1:172.21.15.183:6817/33903] conn(0x7f16340638b0 0x7f1634065d10 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:13.930 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.923+0000 7f164cd47700 1 -- 172.21.15.158:0/2043654813 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f163405a510 msgr2=0x7f163405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.930 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.923+0000 7f164cd47700 1 --2- 172.21.15.158:0/2043654813 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f163405a510 0x7f163405c9d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f1638001d50 tx=0x7f1638009040).stop 2023-10-18T17:24:13.931 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.923+0000 7f164cd47700 1 -- 172.21.15.158:0/2043654813 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1648149ba0 msgr2=0x7f1648146db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:13.931 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.923+0000 7f164cd47700 1 --2- 172.21.15.158:0/2043654813 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1648149ba0 0x7f1648146db0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f164000c790 tx=0x7f1640001460).stop 2023-10-18T17:24:13.931 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.923+0000 7f1647fff700 1 -- 172.21.15.158:0/2043654813 reap_dead start 2023-10-18T17:24:13.931 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.923+0000 7f164cd47700 1 -- 172.21.15.158:0/2043654813 shutdown_connections 2023-10-18T17:24:13.931 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.923+0000 7f164cd47700 1 -- 172.21.15.158:0/2043654813 >> 172.21.15.158:0/2043654813 conn(0x7f164805ddc0 msgr2=0x7f16480bce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:13.931 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.923+0000 7f164cd47700 1 -- 172.21.15.158:0/2043654813 shutdown_connections 2023-10-18T17:24:13.932 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:13.923+0000 7f164cd47700 1 -- 172.21.15.158:0/2043654813 wait complete. 2023-10-18T17:24:13.954 INFO:teuthology.orchestra.run.smithi158.stdout:55834574854 2023-10-18T17:24:13.955 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-18T17:24:14.136 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.127+0000 7f2901bf9700 1 Processor -- start 2023-10-18T17:24:14.136 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.131+0000 7f2901bf9700 1 -- start start 2023-10-18T17:24:14.137 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.131+0000 7f2901bf9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f28fc0bf340 0x7f28fc0bf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:14.137 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.131+0000 7f2901bf9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28fc14e3d0 0x7f28fc14e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:14.138 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.131+0000 7f2901bf9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28fc14dc30 con 0x7f28fc066180 2023-10-18T17:24:14.139 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.131+0000 7f2901bf9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28fc0bbb60 con 0x7f28fc0bf340 2023-10-18T17:24:14.139 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.131+0000 7f2901bf9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc0bbe00 con 0x7f28fc14e3d0 2023-10-18T17:24:14.139 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.131+0000 7f28f3fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28fc14e3d0 0x7f28fc14e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:14.139 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.131+0000 7f2900bf7700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f28fc0bf340 0x7f28fc0bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:14.139 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.131+0000 7f2900bf7700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f28fc0bf340 0x7f28fc0bf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:43802/0 (socket says 172.21.15.158:43802) 2023-10-18T17:24:14.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.131+0000 7f2900bf7700 1 -- 172.21.15.158:0/3065917412 learned_addr learned my addr 172.21.15.158:0/3065917412 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:14.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.131+0000 7f28f3fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28fc14e3d0 0x7f28fc14e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:32802/0 (socket says 172.21.15.158:32802) 2023-10-18T17:24:14.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.131+0000 7f2900bf7700 1 -- 172.21.15.158:0/3065917412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28fc14e3d0 msgr2=0x7f28fc14e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:14.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.131+0000 7f2900bf7700 1 --2- 172.21.15.158:0/3065917412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28fc14e3d0 0x7f28fc14e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.131+0000 7f2900bf7700 1 -- 172.21.15.158:0/3065917412 >> v1:172.21.15.183:6789/0 conn(0x7f28fc066180 legacy=0x7f28fc151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:14.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.131+0000 7f2900bf7700 1 -- 172.21.15.158:0/3065917412 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc0bc0c0 con 0x7f28fc0bf340 2023-10-18T17:24:14.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.131+0000 7f2900bf7700 1 --2- 172.21.15.158:0/3065917412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28fc0bf340 0x7f28fc0bf720 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f28f8006fd0 tx=0x7f28f80090f0).ready entity=mon.1 client_cookie=1b5c95efc97d8518 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:14.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.131+0000 7f28f37fe700 1 -- 172.21.15.158:0/3065917412 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f800b610 con 0x7f28fc0bf340 2023-10-18T17:24:14.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.131+0000 7f28f37fe700 1 -- 172.21.15.158:0/3065917412 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f800b770 con 0x7f28fc0bf340 2023-10-18T17:24:14.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.131+0000 7f28f37fe700 1 -- 172.21.15.158:0/3065917412 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f800baf0 con 0x7f28fc0bf340 2023-10-18T17:24:14.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.135+0000 7f2901bf9700 1 -- 172.21.15.158:0/3065917412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28fc0bf340 msgr2=0x7f28fc0bf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:14.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.135+0000 7f2901bf9700 1 --2- 172.21.15.158:0/3065917412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28fc0bf340 0x7f28fc0bf720 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f28f8006fd0 tx=0x7f28f80090f0).stop 2023-10-18T17:24:14.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.135+0000 7f2901bf9700 1 -- 172.21.15.158:0/3065917412 shutdown_connections 2023-10-18T17:24:14.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.135+0000 7f2901bf9700 1 --2- 172.21.15.158:0/3065917412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28fc14e3d0 0x7f28fc14e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.135+0000 7f2901bf9700 1 --2- 172.21.15.158:0/3065917412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28fc0bf340 0x7f28fc0bf720 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.135+0000 7f2901bf9700 1 -- 172.21.15.158:0/3065917412 >> 172.21.15.158:0/3065917412 conn(0x7f28fc05ddc0 msgr2=0x7f28fc05e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:14.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.135+0000 7f2901bf9700 1 -- 172.21.15.158:0/3065917412 shutdown_connections 2023-10-18T17:24:14.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.135+0000 7f2901bf9700 1 -- 172.21.15.158:0/3065917412 wait complete. 2023-10-18T17:24:14.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.139+0000 7f2901bf9700 1 Processor -- start 2023-10-18T17:24:14.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.139+0000 7f2901bf9700 1 -- start start 2023-10-18T17:24:14.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.139+0000 7f2901bf9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28fc066180 0x7f28fc1482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:14.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.139+0000 7f2901bf9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28fc0bf340 0x7f28fc165730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:14.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.139+0000 7f2901bf9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28fc14e3d0 0x7f28fc0c1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:14.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.139+0000 7f2901bf9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc14b9f0 con 0x7f28fc0bf340 2023-10-18T17:24:14.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.139+0000 7f2901bf9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc165c20 con 0x7f28fc14e3d0 2023-10-18T17:24:14.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.139+0000 7f2901bf9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc1488c0 con 0x7f28fc066180 2023-10-18T17:24:14.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.139+0000 7f28f3fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28fc0bf340 0x7f28fc165730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:14.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.139+0000 7f2900bf7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28fc066180 0x7f28fc1482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:14.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.139+0000 7f29013f8700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28fc14e3d0 0x7f28fc0c1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:14.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.139+0000 7f2900bf7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28fc066180 0x7f28fc1482a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:32812/0 (socket says 172.21.15.158:32812) 2023-10-18T17:24:14.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.139+0000 7f2900bf7700 1 -- 172.21.15.158:0/2419796876 learned_addr learned my addr 172.21.15.158:0/2419796876 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:14.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.139+0000 7f2900bf7700 1 -- 172.21.15.158:0/2419796876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28fc14e3d0 msgr2=0x7f28fc0c1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:14.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.139+0000 7f2900bf7700 1 --2- 172.21.15.158:0/2419796876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28fc14e3d0 0x7f28fc0c1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.139+0000 7f2900bf7700 1 -- 172.21.15.158:0/2419796876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28fc0bf340 msgr2=0x7f28fc165730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:14.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.139+0000 7f2900bf7700 1 --2- 172.21.15.158:0/2419796876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28fc0bf340 0x7f28fc165730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.139+0000 7f2900bf7700 1 -- 172.21.15.158:0/2419796876 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f8009370 con 0x7f28fc066180 2023-10-18T17:24:14.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.139+0000 7f2900bf7700 1 --2- 172.21.15.158:0/2419796876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28fc066180 0x7f28fc1482a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f28f8009130 tx=0x7f28f8017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:14.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.143+0000 7f28f0ff9700 1 -- 172.21.15.158:0/2419796876 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f800beb0 con 0x7f28fc066180 2023-10-18T17:24:14.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.143+0000 7f28f0ff9700 1 -- 172.21.15.158:0/2419796876 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f8006a40 con 0x7f28fc066180 2023-10-18T17:24:14.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.143+0000 7f28f0ff9700 1 -- 172.21.15.158:0/2419796876 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f801c420 con 0x7f28fc066180 2023-10-18T17:24:14.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.143+0000 7f2901bf9700 1 -- 172.21.15.158:0/2419796876 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28fc068070 con 0x7f28fc066180 2023-10-18T17:24:14.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.143+0000 7f2901bf9700 1 -- 172.21.15.158:0/2419796876 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28fc068630 con 0x7f28fc066180 2023-10-18T17:24:14.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.143+0000 7f2901bf9700 1 -- 172.21.15.158:0/2419796876 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28fc046f00 con 0x7f28fc066180 2023-10-18T17:24:14.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.143+0000 7f28f0ff9700 1 -- 172.21.15.158:0/2419796876 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f28f801c790 con 0x7f28fc066180 2023-10-18T17:24:14.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.147+0000 7f28f0ff9700 1 --2- 172.21.15.158:0/2419796876 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f28e805a540 0x7f28e805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:14.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.147+0000 7f28f0ff9700 1 -- 172.21.15.158:0/2419796876 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f28f80764e0 con 0x7f28fc066180 2023-10-18T17:24:14.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.147+0000 7f28f3fff700 1 --2- 172.21.15.158:0/2419796876 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f28e805a540 0x7f28e805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:14.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.147+0000 7f28f3fff700 1 --2- 172.21.15.158:0/2419796876 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f28e805a540 0x7f28e805ca00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f28fc069d70 tx=0x7f28ec009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:14.162 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.155+0000 7f28f0ff9700 1 -- 172.21.15.158:0/2419796876 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f28f8049ba0 con 0x7f28fc066180 2023-10-18T17:24:14.326 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.319+0000 7f2901bf9700 1 -- 172.21.15.158:0/2419796876 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f28fc0bcbc0 con 0x7f28fc066180 2023-10-18T17:24:14.327 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.319+0000 7f28f0ff9700 1 -- 172.21.15.158:0/2419796876 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f28f8020020 con 0x7f28fc066180 2023-10-18T17:24:14.327 INFO:teuthology.orchestra.run.smithi158.stdout:60129542149 2023-10-18T17:24:14.332 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.323+0000 7f2901bf9700 1 -- 172.21.15.158:0/2419796876 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f28e805a540 msgr2=0x7f28e805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:14.332 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.323+0000 7f2901bf9700 1 --2- 172.21.15.158:0/2419796876 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f28e805a540 0x7f28e805ca00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f28fc069d70 tx=0x7f28ec009060).stop 2023-10-18T17:24:14.333 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.323+0000 7f2901bf9700 1 -- 172.21.15.158:0/2419796876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28fc066180 msgr2=0x7f28fc1482a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:14.333 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.323+0000 7f2901bf9700 1 --2- 172.21.15.158:0/2419796876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28fc066180 0x7f28fc1482a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f28f8009130 tx=0x7f28f8017000).stop 2023-10-18T17:24:14.333 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.327+0000 7f2901bf9700 1 -- 172.21.15.158:0/2419796876 shutdown_connections 2023-10-18T17:24:14.333 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.327+0000 7f2901bf9700 1 --2- 172.21.15.158:0/2419796876 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f28e805a540 0x7f28e805ca00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.334 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.327+0000 7f2901bf9700 1 --2- 172.21.15.158:0/2419796876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28fc14e3d0 0x7f28fc0c1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.334 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.327+0000 7f2901bf9700 1 --2- 172.21.15.158:0/2419796876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28fc0bf340 0x7f28fc165730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.334 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.327+0000 7f2901bf9700 1 --2- 172.21.15.158:0/2419796876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28fc066180 0x7f28fc1482a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.335 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.327+0000 7f2901bf9700 1 -- 172.21.15.158:0/2419796876 >> 172.21.15.158:0/2419796876 conn(0x7f28fc05ddc0 msgr2=0x7f28fc14ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:14.335 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.327+0000 7f2901bf9700 1 -- 172.21.15.158:0/2419796876 shutdown_connections 2023-10-18T17:24:14.336 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.327+0000 7f2901bf9700 1 -- 172.21.15.158:0/2419796876 wait complete. 2023-10-18T17:24:14.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2023-10-18T17:24:14.356 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-18T17:24:14.518 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.511+0000 7fabd5bf9700 1 Processor -- start 2023-10-18T17:24:14.518 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.511+0000 7fabd5bf9700 1 -- start start 2023-10-18T17:24:14.521 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.515+0000 7fabd5bf9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fabd0066340 0x7fabd0062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:14.522 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.515+0000 7fabd5bf9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd00c1610 con 0x7fabd0062270 2023-10-18T17:24:14.522 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.515+0000 7fabd5bf9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd00c2dd0 con 0x7fabd014d020 2023-10-18T17:24:14.523 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.515+0000 7fabd5bf9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd0153570 con 0x7fabd0066340 2023-10-18T17:24:14.523 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.515+0000 7fabc7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fabd0066340 0x7fabd0062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:14.523 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.515+0000 7fabd4bf7700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fabd0062270 0x7fabd00c0f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:38650/0 (socket says 172.21.15.158:38650) 2023-10-18T17:24:14.523 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.515+0000 7fabd4bf7700 1 -- 172.21.15.158:0/4011455538 learned_addr learned my addr 172.21.15.158:0/4011455538 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:14.524 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.515+0000 7fabc77fe700 1 -- 172.21.15.158:0/4011455538 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197848459 0 0) 0x7fabd00c1610 con 0x7fabd0062270 2023-10-18T17:24:14.524 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.515+0000 7fabc77fe700 1 -- 172.21.15.158:0/4011455538 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabb80033f0 con 0x7fabd0062270 2023-10-18T17:24:14.525 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.515+0000 7fabc7fff700 1 -- 172.21.15.158:0/4011455538 >> v1:172.21.15.183:6789/0 conn(0x7fabd014d020 legacy=0x7fabd014d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:14.525 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.515+0000 7fabc7fff700 1 -- 172.21.15.158:0/4011455538 >> v1:172.21.15.158:6789/0 conn(0x7fabd0062270 legacy=0x7fabd00c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:14.525 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.515+0000 7fabc7fff700 1 -- 172.21.15.158:0/4011455538 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd0153850 con 0x7fabd0066340 2023-10-18T17:24:14.525 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.519+0000 7fabc7fff700 1 --2- 172.21.15.158:0/4011455538 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd0066340 0x7fabd0062650 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fabc0009760 tx=0x7fabc0009060).ready entity=mon.1 client_cookie=36bf2acba6297e6d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:14.525 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.519+0000 7fabc77fe700 1 -- 172.21.15.158:0/4011455538 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc000b590 con 0x7fabd0066340 2023-10-18T17:24:14.526 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.519+0000 7fabc77fe700 1 -- 172.21.15.158:0/4011455538 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc000b6f0 con 0x7fabd0066340 2023-10-18T17:24:14.526 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.519+0000 7fabc77fe700 1 -- 172.21.15.158:0/4011455538 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc000ba70 con 0x7fabd0066340 2023-10-18T17:24:14.527 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.519+0000 7fabd5bf9700 1 -- 172.21.15.158:0/4011455538 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd0066340 msgr2=0x7fabd0062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:14.527 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.519+0000 7fabd5bf9700 1 --2- 172.21.15.158:0/4011455538 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd0066340 0x7fabd0062650 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fabc0009760 tx=0x7fabc0009060).stop 2023-10-18T17:24:14.527 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.519+0000 7fabd5bf9700 1 -- 172.21.15.158:0/4011455538 shutdown_connections 2023-10-18T17:24:14.527 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.519+0000 7fabd5bf9700 1 --2- 172.21.15.158:0/4011455538 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd0066340 0x7fabd0062650 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.527 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.519+0000 7fabd5bf9700 1 -- 172.21.15.158:0/4011455538 >> 172.21.15.158:0/4011455538 conn(0x7fabd005ddc0 msgr2=0x7fabd005e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:14.528 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.519+0000 7fabd5bf9700 1 -- 172.21.15.158:0/4011455538 shutdown_connections 2023-10-18T17:24:14.528 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.519+0000 7fabd5bf9700 1 -- 172.21.15.158:0/4011455538 wait complete. 2023-10-18T17:24:14.528 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.523+0000 7fabd5bf9700 1 Processor -- start 2023-10-18T17:24:14.529 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.523+0000 7fabd5bf9700 1 -- start start 2023-10-18T17:24:14.530 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.523+0000 7fabd5bf9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabd0062270 0x7fabd0147a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:14.531 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.523+0000 7fabd5bf9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd0066340 0x7fabd00c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:14.531 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.523+0000 7fabd5bf9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabd014d020 0x7fabd00c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:14.531 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.523+0000 7fabd5bf9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd0147f70 con 0x7fabd0062270 2023-10-18T17:24:14.531 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.523+0000 7fabd5bf9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00c4ed0 con 0x7fabd0066340 2023-10-18T17:24:14.533 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.523+0000 7fabd5bf9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd0155fc0 con 0x7fabd014d020 2023-10-18T17:24:14.533 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.523+0000 7fabd4bf7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabd0062270 0x7fabd0147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:14.534 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.523+0000 7fabd4bf7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabd0062270 0x7fabd0147a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56232/0 (socket says 172.21.15.158:56232) 2023-10-18T17:24:14.534 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.523+0000 7fabd4bf7700 1 -- 172.21.15.158:0/2516539890 learned_addr learned my addr 172.21.15.158:0/2516539890 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:14.534 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.523+0000 7fabc7fff700 1 --2- 172.21.15.158:0/2516539890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd0066340 0x7fabd00c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:14.535 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.523+0000 7fabd53f8700 1 --2- 172.21.15.158:0/2516539890 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabd014d020 0x7fabd00c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:14.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.523+0000 7fabd4bf7700 1 -- 172.21.15.158:0/2516539890 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabd014d020 msgr2=0x7fabd00c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:14.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.523+0000 7fabd4bf7700 1 --2- 172.21.15.158:0/2516539890 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabd014d020 0x7fabd00c49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.523+0000 7fabd4bf7700 1 -- 172.21.15.158:0/2516539890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd0066340 msgr2=0x7fabd00c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:14.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.523+0000 7fabd4bf7700 1 --2- 172.21.15.158:0/2516539890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd0066340 0x7fabd00c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.523+0000 7fabd4bf7700 1 -- 172.21.15.158:0/2516539890 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc00092a0 con 0x7fabd0062270 2023-10-18T17:24:14.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.523+0000 7fabd4bf7700 1 --2- 172.21.15.158:0/2516539890 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabd0062270 0x7fabd0147a80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fabcc00c5c0 tx=0x7fabcc007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:14.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.527+0000 7fabc4ff9700 1 -- 172.21.15.158:0/2516539890 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc0072e0 con 0x7fabd0062270 2023-10-18T17:24:14.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.527+0000 7fabc4ff9700 1 -- 172.21.15.158:0/2516539890 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabcc007440 con 0x7fabd0062270 2023-10-18T17:24:14.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.527+0000 7fabd5bf9700 1 -- 172.21.15.158:0/2516539890 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd01550d0 con 0x7fabd0062270 2023-10-18T17:24:14.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.527+0000 7fabc4ff9700 1 -- 172.21.15.158:0/2516539890 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc0057a0 con 0x7fabd0062270 2023-10-18T17:24:14.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.527+0000 7fabd5bf9700 1 -- 172.21.15.158:0/2516539890 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd0155690 con 0x7fabd0062270 2023-10-18T17:24:14.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.527+0000 7fabd5bf9700 1 -- 172.21.15.158:0/2516539890 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd00c0ea0 con 0x7fabd0062270 2023-10-18T17:24:14.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.527+0000 7fabc4ff9700 1 -- 172.21.15.158:0/2516539890 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fabcc005bd0 con 0x7fabd0062270 2023-10-18T17:24:14.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.531+0000 7fabc4ff9700 1 --2- 172.21.15.158:0/2516539890 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fabbc05a510 0x7fabbc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:14.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.531+0000 7fabc4ff9700 1 -- 172.21.15.158:0/2516539890 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fabcc073ca0 con 0x7fabd0062270 2023-10-18T17:24:14.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.531+0000 7fabc7fff700 1 --2- 172.21.15.158:0/2516539890 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fabbc05a510 0x7fabbc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:14.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.531+0000 7fabc7fff700 1 --2- 172.21.15.158:0/2516539890 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fabbc05a510 0x7fabbc05c9d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fabc0009760 tx=0x7fabc0017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:14.543 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.535+0000 7fabc4ff9700 1 -- 172.21.15.158:0/2516539890 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fabd00c0ea0 con 0x7fabd0062270 2023-10-18T17:24:14.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.699+0000 7fabd5bf9700 1 -- 172.21.15.158:0/2516539890 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fabd00c0ea0 con 0x7fabd0062270 2023-10-18T17:24:14.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.699+0000 7fabc4ff9700 1 -- 172.21.15.158:0/2516539890 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fabd00c0ea0 con 0x7fabd0062270 2023-10-18T17:24:14.708 INFO:teuthology.orchestra.run.smithi158.stdout:60129542151 2023-10-18T17:24:14.710 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.703+0000 7fabd5bf9700 1 -- 172.21.15.158:0/2516539890 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fabbc05a510 msgr2=0x7fabbc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:14.710 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.703+0000 7fabd5bf9700 1 --2- 172.21.15.158:0/2516539890 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fabbc05a510 0x7fabbc05c9d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fabc0009760 tx=0x7fabc0017000).stop 2023-10-18T17:24:14.710 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.703+0000 7fabd5bf9700 1 -- 172.21.15.158:0/2516539890 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabd0062270 msgr2=0x7fabd0147a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:14.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.703+0000 7fabd5bf9700 1 --2- 172.21.15.158:0/2516539890 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabd0062270 0x7fabd0147a80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fabcc00c5c0 tx=0x7fabcc007c80).stop 2023-10-18T17:24:14.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.703+0000 7fabd5bf9700 1 -- 172.21.15.158:0/2516539890 shutdown_connections 2023-10-18T17:24:14.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.703+0000 7fabd5bf9700 1 --2- 172.21.15.158:0/2516539890 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fabbc05a510 0x7fabbc05c9d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.703+0000 7fabd5bf9700 1 --2- 172.21.15.158:0/2516539890 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabd014d020 0x7fabd00c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.703+0000 7fabd5bf9700 1 --2- 172.21.15.158:0/2516539890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd0066340 0x7fabd00c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.703+0000 7fabd5bf9700 1 --2- 172.21.15.158:0/2516539890 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabd0062270 0x7fabd0147a80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.703+0000 7fabd5bf9700 1 -- 172.21.15.158:0/2516539890 >> 172.21.15.158:0/2516539890 conn(0x7fabd005ddc0 msgr2=0x7fabd00c2370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:14.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.703+0000 7fabd5bf9700 1 -- 172.21.15.158:0/2516539890 shutdown_connections 2023-10-18T17:24:14.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.703+0000 7fabd5bf9700 1 -- 172.21.15.158:0/2516539890 wait complete. 2023-10-18T17:24:14.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.1 2023-10-18T17:24:14.734 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-18T17:24:14.907 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.899+0000 7f361db07700 1 Processor -- start 2023-10-18T17:24:14.907 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.899+0000 7f361db07700 1 -- start start 2023-10-18T17:24:14.910 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.903+0000 7f361db07700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3618066340 0x7f3618062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:14.910 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.903+0000 7f361db07700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f361814d020 0x7f361814d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:14.911 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.903+0000 7f361db07700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36180c1610 con 0x7f3618062270 2023-10-18T17:24:14.911 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.903+0000 7f361db07700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361814d9c0 con 0x7f3618066340 2023-10-18T17:24:14.911 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.903+0000 7f361db07700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36180c2dd0 con 0x7f361814d020 2023-10-18T17:24:14.911 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.903+0000 7f3617fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3618066340 0x7f3618062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:14.911 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.903+0000 7f361d306700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f361814d020 0x7f361814d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:14.912 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.903+0000 7f3617fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3618066340 0x7f3618062650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56240/0 (socket says 172.21.15.158:56240) 2023-10-18T17:24:14.912 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.903+0000 7f3617fff700 1 -- 172.21.15.158:0/405636623 learned_addr learned my addr 172.21.15.158:0/405636623 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:14.912 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.903+0000 7f361cb05700 1 --1- 172.21.15.158:0/405636623 >> v1:172.21.15.158:6789/0 conn(0x7f3618062270 0x7f36180c0f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:38652/0 (socket says 172.21.15.158:38652) 2023-10-18T17:24:14.914 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.903+0000 7f3617fff700 1 -- 172.21.15.158:0/405636623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f361814d020 msgr2=0x7f361814d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:14.914 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.903+0000 7f3617fff700 1 --2- 172.21.15.158:0/405636623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f361814d020 0x7f361814d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.914 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.903+0000 7f3617fff700 1 -- 172.21.15.158:0/405636623 >> v1:172.21.15.158:6789/0 conn(0x7f3618062270 legacy=0x7f36180c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:14.915 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.903+0000 7f3617fff700 1 -- 172.21.15.158:0/405636623 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3618153570 con 0x7f3618066340 2023-10-18T17:24:14.915 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.903+0000 7f3617fff700 1 --2- 172.21.15.158:0/405636623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3618066340 0x7f3618062650 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f3604006fd0 tx=0x7f36040090f0).ready entity=mon.0 client_cookie=c3ca5ce22609d8a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:14.915 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.907+0000 7f36177fe700 1 -- 172.21.15.158:0/405636623 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360400b610 con 0x7f3618066340 2023-10-18T17:24:14.915 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.907+0000 7f36177fe700 1 -- 172.21.15.158:0/405636623 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360400b770 con 0x7f3618066340 2023-10-18T17:24:14.915 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.907+0000 7f36177fe700 1 -- 172.21.15.158:0/405636623 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360400baf0 con 0x7f3618066340 2023-10-18T17:24:14.916 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.907+0000 7f361db07700 1 -- 172.21.15.158:0/405636623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3618066340 msgr2=0x7f3618062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:14.916 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.907+0000 7f361db07700 1 --2- 172.21.15.158:0/405636623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3618066340 0x7f3618062650 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f3604006fd0 tx=0x7f36040090f0).stop 2023-10-18T17:24:14.916 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.907+0000 7f361db07700 1 -- 172.21.15.158:0/405636623 shutdown_connections 2023-10-18T17:24:14.916 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.907+0000 7f361db07700 1 --2- 172.21.15.158:0/405636623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f361814d020 0x7f361814d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.916 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.907+0000 7f361db07700 1 --2- 172.21.15.158:0/405636623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3618066340 0x7f3618062650 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.917 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.907+0000 7f361db07700 1 -- 172.21.15.158:0/405636623 >> 172.21.15.158:0/405636623 conn(0x7f361805ddc0 msgr2=0x7f361805e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:14.917 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.907+0000 7f361db07700 1 -- 172.21.15.158:0/405636623 shutdown_connections 2023-10-18T17:24:14.917 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.907+0000 7f361db07700 1 -- 172.21.15.158:0/405636623 wait complete. 2023-10-18T17:24:14.917 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.911+0000 7f361db07700 1 Processor -- start 2023-10-18T17:24:14.918 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.911+0000 7f361db07700 1 -- start start 2023-10-18T17:24:14.919 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.911+0000 7f361db07700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3618062270 0x7f361814ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:14.919 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.911+0000 7f361db07700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3618066340 0x7f3618162bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:14.919 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.911+0000 7f361db07700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f361814d020 0x7f361815f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:14.920 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.911+0000 7f361db07700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3618162730 con 0x7f3618062270 2023-10-18T17:24:14.920 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.911+0000 7f361db07700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36180bd400 con 0x7f361814d020 2023-10-18T17:24:14.920 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.911+0000 7f361db07700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36180bd6c0 con 0x7f3618066340 2023-10-18T17:24:14.920 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.911+0000 7f361cb05700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3618062270 0x7f361814ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:14.920 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.911+0000 7f3617fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3618066340 0x7f3618162bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:14.921 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.911+0000 7f361d306700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f361814d020 0x7f361815f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:14.921 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.911+0000 7f361d306700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f361814d020 0x7f361815f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:43852/0 (socket says 172.21.15.158:43852) 2023-10-18T17:24:14.921 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.911+0000 7f361cb05700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3618062270 0x7f361814ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56250/0 (socket says 172.21.15.158:56250) 2023-10-18T17:24:14.921 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.911+0000 7f3617fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3618066340 0x7f3618162bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:32836/0 (socket says 172.21.15.158:32836) 2023-10-18T17:24:14.921 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.911+0000 7f361d306700 1 -- 172.21.15.158:0/3934851812 learned_addr learned my addr 172.21.15.158:0/3934851812 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:14.923 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.915+0000 7f361cb05700 1 -- 172.21.15.158:0/3934851812 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3618066340 msgr2=0x7f3618162bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:14.923 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.915+0000 7f361cb05700 1 --2- 172.21.15.158:0/3934851812 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3618066340 0x7f3618162bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.923 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.915+0000 7f361cb05700 1 -- 172.21.15.158:0/3934851812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f361814d020 msgr2=0x7f361815f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:14.923 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.915+0000 7f361cb05700 1 --2- 172.21.15.158:0/3934851812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f361814d020 0x7f361815f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:14.923 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.915+0000 7f361cb05700 1 -- 172.21.15.158:0/3934851812 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3604009370 con 0x7f3618062270 2023-10-18T17:24:14.924 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.915+0000 7f3617fff700 1 --2- 172.21.15.158:0/3934851812 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3618066340 0x7f3618162bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:14.924 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.915+0000 7f361d306700 1 --2- 172.21.15.158:0/3934851812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f361814d020 0x7f361815f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:14.924 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.915+0000 7f361cb05700 1 --2- 172.21.15.158:0/3934851812 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3618062270 0x7f361814ddb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f360c00c410 tx=0x7f360c007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:14.924 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.915+0000 7f3614ff9700 1 -- 172.21.15.158:0/3934851812 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c0070d0 con 0x7f3618062270 2023-10-18T17:24:14.924 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.915+0000 7f3614ff9700 1 -- 172.21.15.158:0/3934851812 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360c007230 con 0x7f3618062270 2023-10-18T17:24:14.925 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.915+0000 7f3614ff9700 1 -- 172.21.15.158:0/3934851812 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c0075b0 con 0x7f3618062270 2023-10-18T17:24:14.925 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.915+0000 7f361db07700 1 -- 172.21.15.158:0/3934851812 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36181620e0 con 0x7f3618062270 2023-10-18T17:24:14.925 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.915+0000 7f361db07700 1 -- 172.21.15.158:0/3934851812 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3618161dd0 con 0x7f3618062270 2023-10-18T17:24:14.925 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.915+0000 7f361db07700 1 -- 172.21.15.158:0/3934851812 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3618046f00 con 0x7f3618062270 2023-10-18T17:24:14.926 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.919+0000 7f3614ff9700 1 -- 172.21.15.158:0/3934851812 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f360c0058f0 con 0x7f3618062270 2023-10-18T17:24:14.926 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.919+0000 7f3614ff9700 1 --2- 172.21.15.158:0/3934851812 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f35fc05a540 0x7f35fc05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:14.927 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.919+0000 7f3614ff9700 1 -- 172.21.15.158:0/3934851812 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f360c073d30 con 0x7f3618062270 2023-10-18T17:24:14.927 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.919+0000 7f3617fff700 1 --2- 172.21.15.158:0/3934851812 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f35fc05a540 0x7f35fc05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:14.927 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.919+0000 7f3617fff700 1 --2- 172.21.15.158:0/3934851812 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f35fc05a540 0x7f35fc05ca00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3604006fd0 tx=0x7f3604017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:14.930 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:14.923+0000 7f3614ff9700 1 -- 172.21.15.158:0/3934851812 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f360c047510 con 0x7f3618062270 2023-10-18T17:24:15.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.087+0000 7f361db07700 1 -- 172.21.15.158:0/3934851812 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3618153850 con 0x7f3618062270 2023-10-18T17:24:15.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.087+0000 7f3614ff9700 1 -- 172.21.15.158:0/3934851812 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f360c04ab30 con 0x7f3618062270 2023-10-18T17:24:15.093 INFO:teuthology.orchestra.run.smithi158.stdout:60129542150 2023-10-18T17:24:15.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.087+0000 7f361db07700 1 -- 172.21.15.158:0/3934851812 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f35fc05a540 msgr2=0x7f35fc05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:15.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.087+0000 7f361db07700 1 --2- 172.21.15.158:0/3934851812 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f35fc05a540 0x7f35fc05ca00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3604006fd0 tx=0x7f3604017000).stop 2023-10-18T17:24:15.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.091+0000 7f361db07700 1 -- 172.21.15.158:0/3934851812 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3618062270 msgr2=0x7f361814ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:15.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.091+0000 7f361db07700 1 --2- 172.21.15.158:0/3934851812 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3618062270 0x7f361814ddb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f360c00c410 tx=0x7f360c007d30).stop 2023-10-18T17:24:15.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.091+0000 7f361db07700 1 -- 172.21.15.158:0/3934851812 shutdown_connections 2023-10-18T17:24:15.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.091+0000 7f361db07700 1 --2- 172.21.15.158:0/3934851812 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f35fc05a540 0x7f35fc05ca00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.091+0000 7f361db07700 1 --2- 172.21.15.158:0/3934851812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f361814d020 0x7f361815f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.091+0000 7f361db07700 1 --2- 172.21.15.158:0/3934851812 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3618066340 0x7f3618162bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.091+0000 7f361db07700 1 --2- 172.21.15.158:0/3934851812 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3618062270 0x7f361814ddb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.091+0000 7f361db07700 1 -- 172.21.15.158:0/3934851812 >> 172.21.15.158:0/3934851812 conn(0x7f361805ddc0 msgr2=0x7f361814ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:15.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.091+0000 7f361db07700 1 -- 172.21.15.158:0/3934851812 shutdown_connections 2023-10-18T17:24:15.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.091+0000 7f361db07700 1 -- 172.21.15.158:0/3934851812 wait complete. 2023-10-18T17:24:15.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2023-10-18T17:24:15.116 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-18T17:24:15.275 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.267+0000 7fc988f46700 1 Processor -- start 2023-10-18T17:24:15.275 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.267+0000 7fc988f46700 1 -- start start 2023-10-18T17:24:15.277 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc988f46700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc9840c2460 0x7fc9841578f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:15.277 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc988f46700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9840c2840 0x7fc984151160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:15.278 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc988f46700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc984151650 0x7fc984151a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:15.278 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc988f46700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc984155b60 con 0x7fc9840c2460 2023-10-18T17:24:15.278 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc988f46700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9840bcd80 con 0x7fc984151650 2023-10-18T17:24:15.278 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc988f46700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9841546a0 con 0x7fc9840c2840 2023-10-18T17:24:15.279 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc98259c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc9840c2460 0x7fc9841578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:15.280 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc981d9b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9840c2840 0x7fc984151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:15.280 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc982d9d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc984151650 0x7fc984151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:15.280 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc982d9d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc984151650 0x7fc984151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:43856/0 (socket says 172.21.15.158:43856) 2023-10-18T17:24:15.280 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc982d9d700 1 -- 172.21.15.158:0/3006281240 learned_addr learned my addr 172.21.15.158:0/3006281240 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:15.281 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc982d9d700 1 -- 172.21.15.158:0/3006281240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9840c2840 msgr2=0x7fc984151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:15.281 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc982d9d700 1 --2- 172.21.15.158:0/3006281240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9840c2840 0x7fc984151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.281 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc982d9d700 1 -- 172.21.15.158:0/3006281240 >> v2:172.21.15.158:3300/0 conn(0x7fc9840c2460 msgr2=0x7fc9841578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:15.281 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc982d9d700 1 --2- 172.21.15.158:0/3006281240 >> v2:172.21.15.158:3300/0 conn(0x7fc9840c2460 0x7fc9841578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.281 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc982d9d700 1 -- 172.21.15.158:0/3006281240 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc984154960 con 0x7fc984151650 2023-10-18T17:24:15.281 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc982d9d700 1 --2- 172.21.15.158:0/3006281240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc984151650 0x7fc984151a90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fc9840bff60 tx=0x7fc97c009840).ready entity=mon.1 client_cookie=c6077e0893ac2393 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:15.282 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc98159a700 1 -- 172.21.15.158:0/3006281240 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c00e070 con 0x7fc984151650 2023-10-18T17:24:15.282 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc98159a700 1 -- 172.21.15.158:0/3006281240 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97c00b970 con 0x7fc984151650 2023-10-18T17:24:15.282 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.271+0000 7fc98159a700 1 -- 172.21.15.158:0/3006281240 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c00bcf0 con 0x7fc984151650 2023-10-18T17:24:15.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.275+0000 7fc988f46700 1 -- 172.21.15.158:0/3006281240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc984151650 msgr2=0x7fc984151a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:15.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.275+0000 7fc988f46700 1 --2- 172.21.15.158:0/3006281240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc984151650 0x7fc984151a90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fc9840bff60 tx=0x7fc97c009840).stop 2023-10-18T17:24:15.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.275+0000 7fc988f46700 1 -- 172.21.15.158:0/3006281240 shutdown_connections 2023-10-18T17:24:15.284 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.275+0000 7fc988f46700 1 --2- 172.21.15.158:0/3006281240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc984151650 0x7fc984151a90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.284 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.275+0000 7fc988f46700 1 --2- 172.21.15.158:0/3006281240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9840c2840 0x7fc984151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.284 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.275+0000 7fc988f46700 1 --2- 172.21.15.158:0/3006281240 >> v2:172.21.15.158:3300/0 conn(0x7fc9840c2460 0x7fc9841578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.284 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.275+0000 7fc988f46700 1 -- 172.21.15.158:0/3006281240 >> 172.21.15.158:0/3006281240 conn(0x7fc98405dc20 msgr2=0x7fc98405e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:15.285 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.275+0000 7fc988f46700 1 -- 172.21.15.158:0/3006281240 shutdown_connections 2023-10-18T17:24:15.285 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.275+0000 7fc988f46700 1 -- 172.21.15.158:0/3006281240 wait complete. 2023-10-18T17:24:15.286 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc988f46700 1 Processor -- start 2023-10-18T17:24:15.286 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc988f46700 1 -- start start 2023-10-18T17:24:15.286 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc988f46700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9840c2460 0x7fc9840bafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:15.286 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc988f46700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9840c2840 0x7fc9840bb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:15.286 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc988f46700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc984151650 0x7fc98415b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:15.287 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc988f46700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9840b6b70 con 0x7fc984151650 2023-10-18T17:24:15.287 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc988f46700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9840ba560 con 0x7fc9840c2840 2023-10-18T17:24:15.287 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc988f46700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9840bab20 con 0x7fc9840c2460 2023-10-18T17:24:15.288 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc982d9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc984151650 0x7fc98415b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:15.289 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc98259c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9840c2460 0x7fc9840bafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:15.289 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc981d9b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9840c2840 0x7fc9840bb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:15.289 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc98259c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9840c2460 0x7fc9840bafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:32858/0 (socket says 172.21.15.158:32858) 2023-10-18T17:24:15.289 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc98259c700 1 -- 172.21.15.158:0/817352691 learned_addr learned my addr 172.21.15.158:0/817352691 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:15.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc98259c700 1 -- 172.21.15.158:0/817352691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9840c2840 msgr2=0x7fc9840bb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:15.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc98259c700 1 --2- 172.21.15.158:0/817352691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9840c2840 0x7fc9840bb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc98259c700 1 -- 172.21.15.158:0/817352691 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc984151650 msgr2=0x7fc98415b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:15.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc98259c700 1 --2- 172.21.15.158:0/817352691 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc984151650 0x7fc98415b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc98259c700 1 -- 172.21.15.158:0/817352691 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c009ae0 con 0x7fc9840c2460 2023-10-18T17:24:15.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc982d9d700 1 --2- 172.21.15.158:0/817352691 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc984151650 0x7fc98415b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:15.291 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.279+0000 7fc98259c700 1 --2- 172.21.15.158:0/817352691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9840c2460 0x7fc9840bafb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc97400e930 tx=0x7fc974009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:15.291 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.283+0000 7fc9727fc700 1 -- 172.21.15.158:0/817352691 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97400c680 con 0x7fc9840c2460 2023-10-18T17:24:15.291 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.283+0000 7fc9727fc700 1 -- 172.21.15.158:0/817352691 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97400c7e0 con 0x7fc9840c2460 2023-10-18T17:24:15.291 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.283+0000 7fc988f46700 1 -- 172.21.15.158:0/817352691 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9840bb990 con 0x7fc9840c2460 2023-10-18T17:24:15.291 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.283+0000 7fc9727fc700 1 -- 172.21.15.158:0/817352691 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97400cb60 con 0x7fc9840c2460 2023-10-18T17:24:15.292 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.283+0000 7fc988f46700 1 -- 172.21.15.158:0/817352691 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9840b9210 con 0x7fc9840c2460 2023-10-18T17:24:15.292 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.283+0000 7fc988f46700 1 -- 172.21.15.158:0/817352691 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc98406c190 con 0x7fc9840c2460 2023-10-18T17:24:15.293 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.283+0000 7fc9727fc700 1 -- 172.21.15.158:0/817352691 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc97401b400 con 0x7fc9840c2460 2023-10-18T17:24:15.293 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.287+0000 7fc9727fc700 1 --2- 172.21.15.158:0/817352691 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc96405a510 0x7fc96405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:15.293 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.287+0000 7fc9727fc700 1 -- 172.21.15.158:0/817352691 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc974074ca0 con 0x7fc9840c2460 2023-10-18T17:24:15.293 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.287+0000 7fc981d9b700 1 --2- 172.21.15.158:0/817352691 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc96405a510 0x7fc96405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:15.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.287+0000 7fc981d9b700 1 --2- 172.21.15.158:0/817352691 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc96405a510 0x7fc96405c9d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fc984154250 tx=0x7fc978009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:15.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.295+0000 7fc9727fc700 1 -- 172.21.15.158:0/817352691 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fc974048450 con 0x7fc9840c2460 2023-10-18T17:24:15.467 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.459+0000 7fc988f46700 1 -- 172.21.15.158:0/817352691 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc984066870 con 0x7fc9840c2460 2023-10-18T17:24:15.467 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.459+0000 7fc9727fc700 1 -- 172.21.15.158:0/817352691 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc97404ba70 con 0x7fc9840c2460 2023-10-18T17:24:15.468 INFO:teuthology.orchestra.run.smithi158.stdout:55834574853 2023-10-18T17:24:15.473 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.467+0000 7fc988f46700 1 -- 172.21.15.158:0/817352691 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc96405a510 msgr2=0x7fc96405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:15.473 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.467+0000 7fc988f46700 1 --2- 172.21.15.158:0/817352691 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc96405a510 0x7fc96405c9d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fc984154250 tx=0x7fc978009060).stop 2023-10-18T17:24:15.473 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.467+0000 7fc988f46700 1 -- 172.21.15.158:0/817352691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9840c2460 msgr2=0x7fc9840bafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:15.474 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.467+0000 7fc988f46700 1 --2- 172.21.15.158:0/817352691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9840c2460 0x7fc9840bafb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc97400e930 tx=0x7fc974009060).stop 2023-10-18T17:24:15.474 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.467+0000 7fc988f46700 1 -- 172.21.15.158:0/817352691 shutdown_connections 2023-10-18T17:24:15.474 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.467+0000 7fc988f46700 1 --2- 172.21.15.158:0/817352691 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc96405a510 0x7fc96405c9d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.474 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.467+0000 7fc988f46700 1 --2- 172.21.15.158:0/817352691 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc984151650 0x7fc98415b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.474 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.467+0000 7fc988f46700 1 --2- 172.21.15.158:0/817352691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9840c2840 0x7fc9840bb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.475 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.467+0000 7fc988f46700 1 --2- 172.21.15.158:0/817352691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9840c2460 0x7fc9840bafb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.475 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.467+0000 7fc988f46700 1 -- 172.21.15.158:0/817352691 >> 172.21.15.158:0/817352691 conn(0x7fc98405dc20 msgr2=0x7fc9840c1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:15.475 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.467+0000 7fc988f46700 1 -- 172.21.15.158:0/817352691 shutdown_connections 2023-10-18T17:24:15.475 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.467+0000 7fc988f46700 1 -- 172.21.15.158:0/817352691 wait complete. 2023-10-18T17:24:15.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-10-18T17:24:15.493 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-18T17:24:15.664 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.659+0000 7f873d81b700 1 Processor -- start 2023-10-18T17:24:15.664 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.659+0000 7f873d81b700 1 -- start start 2023-10-18T17:24:15.667 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.659+0000 7f873d81b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f87380bbd10 0x7f87380bc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:15.667 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.659+0000 7f873d81b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8738068990 0x7f87380bd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:15.667 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.659+0000 7f873d81b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8738069110 con 0x7f87380c2460 2023-10-18T17:24:15.667 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.659+0000 7f873d81b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873814a740 con 0x7f87380bbd10 2023-10-18T17:24:15.667 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.659+0000 7f873d81b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873814dc20 con 0x7f8738068990 2023-10-18T17:24:15.669 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.659+0000 7f87367fc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8738068990 0x7f87380bd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:15.669 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.659+0000 7f87367fc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8738068990 0x7f87380bd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:32866/0 (socket says 172.21.15.158:32866) 2023-10-18T17:24:15.669 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.659+0000 7f87367fc700 1 -- 172.21.15.158:0/2691600564 learned_addr learned my addr 172.21.15.158:0/2691600564 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:15.669 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.659+0000 7f8736ffd700 1 --2- 172.21.15.158:0/2691600564 >> v2:172.21.15.183:3300/0 conn(0x7f87380bbd10 0x7f87380bc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:15.669 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.663+0000 7f87367fc700 1 -- 172.21.15.158:0/2691600564 >> v2:172.21.15.183:3300/0 conn(0x7f87380bbd10 msgr2=0x7f87380bc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:15.670 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.663+0000 7f87367fc700 1 --2- 172.21.15.158:0/2691600564 >> v2:172.21.15.183:3300/0 conn(0x7f87380bbd10 0x7f87380bc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.670 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.663+0000 7f87367fc700 1 -- 172.21.15.158:0/2691600564 >> v1:172.21.15.183:6789/0 conn(0x7f87380c2460 legacy=0x7f87380695a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:15.670 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.663+0000 7f87367fc700 1 -- 172.21.15.158:0/2691600564 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873814d0a0 con 0x7f8738068990 2023-10-18T17:24:15.670 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.663+0000 7f8736ffd700 1 --2- 172.21.15.158:0/2691600564 >> v2:172.21.15.183:3300/0 conn(0x7f87380bbd10 0x7f87380bc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:24:15.671 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.663+0000 7f87367fc700 1 --2- 172.21.15.158:0/2691600564 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8738068990 0x7f87380bd2d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f872c006fd0 tx=0x7f872c0090f0).ready entity=mon.2 client_cookie=47e0c05ac96739fc server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:15.671 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.663+0000 7f8735ffb700 1 -- 172.21.15.158:0/2691600564 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c00b600 con 0x7f8738068990 2023-10-18T17:24:15.671 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.663+0000 7f8735ffb700 1 -- 172.21.15.158:0/2691600564 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872c00b760 con 0x7f8738068990 2023-10-18T17:24:15.671 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.663+0000 7f8735ffb700 1 -- 172.21.15.158:0/2691600564 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c00bae0 con 0x7f8738068990 2023-10-18T17:24:15.672 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.663+0000 7f873d81b700 1 -- 172.21.15.158:0/2691600564 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8738068990 msgr2=0x7f87380bd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:15.672 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.663+0000 7f873d81b700 1 --2- 172.21.15.158:0/2691600564 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8738068990 0x7f87380bd2d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f872c006fd0 tx=0x7f872c0090f0).stop 2023-10-18T17:24:15.672 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.663+0000 7f873d81b700 1 -- 172.21.15.158:0/2691600564 shutdown_connections 2023-10-18T17:24:15.673 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.663+0000 7f873d81b700 1 --2- 172.21.15.158:0/2691600564 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8738068990 0x7f87380bd2d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.673 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.663+0000 7f873d81b700 1 --2- 172.21.15.158:0/2691600564 >> v2:172.21.15.183:3300/0 conn(0x7f87380bbd10 0x7f87380bc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.673 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.663+0000 7f873d81b700 1 -- 172.21.15.158:0/2691600564 >> 172.21.15.158:0/2691600564 conn(0x7f873805dc20 msgr2=0x7f873805e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:15.673 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.663+0000 7f873d81b700 1 -- 172.21.15.158:0/2691600564 shutdown_connections 2023-10-18T17:24:15.673 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.663+0000 7f873d81b700 1 -- 172.21.15.158:0/2691600564 wait complete. 2023-10-18T17:24:15.674 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.667+0000 7f873d81b700 1 Processor -- start 2023-10-18T17:24:15.674 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.667+0000 7f873d81b700 1 -- start start 2023-10-18T17:24:15.675 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.667+0000 7f873d81b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8738068990 0x7f8738142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:15.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.667+0000 7f873d81b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f87380bbd10 0x7f8738160930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:15.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.667+0000 7f873d81b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87380c2460 0x7f8738160e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:15.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.667+0000 7f873d81b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87380b1b40 con 0x7f87380bbd10 2023-10-18T17:24:15.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.667+0000 7f873d81b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87380b06d0 con 0x7f8738068990 2023-10-18T17:24:15.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.667+0000 7f873d81b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87380b09b0 con 0x7f87380c2460 2023-10-18T17:24:15.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.667+0000 7f8736ffd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8738068990 0x7f8738142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:15.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.667+0000 7f87367fc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f87380bbd10 0x7f8738160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:15.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.667+0000 7f8736ffd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8738068990 0x7f8738142f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:43864/0 (socket says 172.21.15.158:43864) 2023-10-18T17:24:15.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.667+0000 7f8736ffd700 1 -- 172.21.15.158:0/1079568270 learned_addr learned my addr 172.21.15.158:0/1079568270 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:15.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.667+0000 7f87377fe700 1 --2- 172.21.15.158:0/1079568270 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87380c2460 0x7f8738160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:15.678 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.671+0000 7f8736ffd700 1 -- 172.21.15.158:0/1079568270 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87380c2460 msgr2=0x7f8738160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:15.678 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.671+0000 7f8736ffd700 1 --2- 172.21.15.158:0/1079568270 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87380c2460 0x7f8738160e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.678 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.671+0000 7f8736ffd700 1 -- 172.21.15.158:0/1079568270 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f87380bbd10 msgr2=0x7f8738160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:15.678 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.671+0000 7f8736ffd700 1 --2- 172.21.15.158:0/1079568270 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f87380bbd10 0x7f8738160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.678 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.671+0000 7f8736ffd700 1 -- 172.21.15.158:0/1079568270 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c009370 con 0x7f8738068990 2023-10-18T17:24:15.679 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.671+0000 7f8736ffd700 1 --2- 172.21.15.158:0/1079568270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8738068990 0x7f8738142f30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f872800d890 tx=0x7f8728008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:15.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.671+0000 7f871effd700 1 -- 172.21.15.158:0/1079568270 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728011590 con 0x7f8738068990 2023-10-18T17:24:15.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.671+0000 7f871effd700 1 -- 172.21.15.158:0/1079568270 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87280116f0 con 0x7f8738068990 2023-10-18T17:24:15.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.671+0000 7f871effd700 1 -- 172.21.15.158:0/1079568270 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728011a70 con 0x7f8738068990 2023-10-18T17:24:15.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.671+0000 7f873d81b700 1 -- 172.21.15.158:0/1079568270 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87380b0e40 con 0x7f8738068990 2023-10-18T17:24:15.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.671+0000 7f873d81b700 1 -- 172.21.15.158:0/1079568270 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87380b1d90 con 0x7f8738068990 2023-10-18T17:24:15.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.671+0000 7f873d81b700 1 -- 172.21.15.158:0/1079568270 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873806c190 con 0x7f8738068990 2023-10-18T17:24:15.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.675+0000 7f871effd700 1 -- 172.21.15.158:0/1079568270 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f872801c460 con 0x7f8738068990 2023-10-18T17:24:15.682 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.675+0000 7f871effd700 1 --2- 172.21.15.158:0/1079568270 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f872405a510 0x7f872405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:15.682 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.675+0000 7f871effd700 1 -- 172.21.15.158:0/1079568270 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f87280744c0 con 0x7f8738068990 2023-10-18T17:24:15.682 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.675+0000 7f87367fc700 1 --2- 172.21.15.158:0/1079568270 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f872405a510 0x7f872405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:15.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.679+0000 7f87367fc700 1 --2- 172.21.15.158:0/1079568270 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f872405a510 0x7f872405c9d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f872c00b3c0 tx=0x7f872c017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:15.690 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.683+0000 7f871effd700 1 -- 172.21.15.158:0/1079568270 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f8728047b80 con 0x7f8738068990 2023-10-18T17:24:15.854 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.847+0000 7f873d81b700 1 -- 172.21.15.158:0/1079568270 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f873805e740 con 0x7f8738068990 2023-10-18T17:24:15.855 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.847+0000 7f871effd700 1 -- 172.21.15.158:0/1079568270 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f872804b1a0 con 0x7f8738068990 2023-10-18T17:24:15.856 INFO:teuthology.orchestra.run.smithi158.stdout:55834574855 2023-10-18T17:24:15.858 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.851+0000 7f873d81b700 1 -- 172.21.15.158:0/1079568270 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f872405a510 msgr2=0x7f872405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:15.859 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.851+0000 7f873d81b700 1 --2- 172.21.15.158:0/1079568270 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f872405a510 0x7f872405c9d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f872c00b3c0 tx=0x7f872c017000).stop 2023-10-18T17:24:15.859 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.851+0000 7f873d81b700 1 -- 172.21.15.158:0/1079568270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8738068990 msgr2=0x7f8738142f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:15.859 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.851+0000 7f873d81b700 1 --2- 172.21.15.158:0/1079568270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8738068990 0x7f8738142f30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f872800d890 tx=0x7f8728008040).stop 2023-10-18T17:24:15.859 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.851+0000 7f873d81b700 1 -- 172.21.15.158:0/1079568270 shutdown_connections 2023-10-18T17:24:15.859 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.851+0000 7f873d81b700 1 --2- 172.21.15.158:0/1079568270 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f872405a510 0x7f872405c9d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.851+0000 7f873d81b700 1 --2- 172.21.15.158:0/1079568270 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87380c2460 0x7f8738160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.851+0000 7f873d81b700 1 --2- 172.21.15.158:0/1079568270 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f87380bbd10 0x7f8738160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.851+0000 7f873d81b700 1 --2- 172.21.15.158:0/1079568270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8738068990 0x7f8738142f30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:15.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.851+0000 7f873d81b700 1 -- 172.21.15.158:0/1079568270 >> 172.21.15.158:0/1079568270 conn(0x7f873805dc20 msgr2=0x7f8738069460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:15.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.851+0000 7f873d81b700 1 -- 172.21.15.158:0/1079568270 shutdown_connections 2023-10-18T17:24:15.861 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:15.851+0000 7f873d81b700 1 -- 172.21.15.158:0/1079568270 wait complete. 2023-10-18T17:24:15.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.4 2023-10-18T17:24:15.879 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-18T17:24:16.040 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.031+0000 7fb7aa3f9700 1 Processor -- start 2023-10-18T17:24:16.040 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.035+0000 7fb7aa3f9700 1 -- start start 2023-10-18T17:24:16.043 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.035+0000 7fb7aa3f9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb7a40bf340 0x7fb7a40bf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:16.044 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.035+0000 7fb7aa3f9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb7a413d890 0x7fb7a40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:16.044 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.035+0000 7fb7aa3f9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a4068ea0 con 0x7fb7a40bcaf0 2023-10-18T17:24:16.044 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.035+0000 7fb7aa3f9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a4154220 con 0x7fb7a413d890 2023-10-18T17:24:16.044 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.035+0000 7fb7aa3f9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a4157970 con 0x7fb7a40bf340 2023-10-18T17:24:16.046 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb7a8bf6700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fb7a40bcaf0 0x7fb7a413d180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:38666/0 (socket says 172.21.15.158:38666) 2023-10-18T17:24:16.046 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb7a8bf6700 1 -- 172.21.15.158:0/2008507270 learned_addr learned my addr 172.21.15.158:0/2008507270 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:16.046 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb7a9bf8700 1 --2- 172.21.15.158:0/2008507270 >> v2:172.21.15.158:3300/0 conn(0x7fb7a413d890 0x7fb7a40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:16.046 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb7a93f7700 1 --2- 172.21.15.158:0/2008507270 >> v2:172.21.15.183:3300/0 conn(0x7fb7a40bf340 0x7fb7a40bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:16.047 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb79bfff700 1 -- 172.21.15.158:0/2008507270 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511453485 0 0) 0x7fb7a4068ea0 con 0x7fb7a40bcaf0 2023-10-18T17:24:16.047 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb79bfff700 1 -- 172.21.15.158:0/2008507270 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7900033f0 con 0x7fb7a40bcaf0 2023-10-18T17:24:16.047 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb7a9bf8700 1 -- 172.21.15.158:0/2008507270 >> v2:172.21.15.183:3300/0 conn(0x7fb7a40bf340 msgr2=0x7fb7a40bf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:16.047 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb7a9bf8700 1 --2- 172.21.15.158:0/2008507270 >> v2:172.21.15.183:3300/0 conn(0x7fb7a40bf340 0x7fb7a40bf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.047 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb7a9bf8700 1 -- 172.21.15.158:0/2008507270 >> v1:172.21.15.158:6789/0 conn(0x7fb7a40bcaf0 legacy=0x7fb7a413d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:16.048 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb7a9bf8700 1 -- 172.21.15.158:0/2008507270 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a4157bf0 con 0x7fb7a413d890 2023-10-18T17:24:16.048 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb7a9bf8700 1 --2- 172.21.15.158:0/2008507270 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb7a413d890 0x7fb7a40689b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb7a4067380 tx=0x7fb79c009780).ready entity=mon.0 client_cookie=d0f0abe98d8d94ce server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:16.048 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb79bfff700 1 -- 172.21.15.158:0/2008507270 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c00e070 con 0x7fb7a413d890 2023-10-18T17:24:16.048 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb79bfff700 1 -- 172.21.15.158:0/2008507270 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79c00bb40 con 0x7fb7a413d890 2023-10-18T17:24:16.048 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb79bfff700 1 -- 172.21.15.158:0/2008507270 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c012410 con 0x7fb7a413d890 2023-10-18T17:24:16.049 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb7aa3f9700 1 -- 172.21.15.158:0/2008507270 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb7a413d890 msgr2=0x7fb7a40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:16.050 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb7aa3f9700 1 --2- 172.21.15.158:0/2008507270 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb7a413d890 0x7fb7a40689b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb7a4067380 tx=0x7fb79c009780).stop 2023-10-18T17:24:16.050 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb7aa3f9700 1 -- 172.21.15.158:0/2008507270 shutdown_connections 2023-10-18T17:24:16.050 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb7aa3f9700 1 --2- 172.21.15.158:0/2008507270 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb7a413d890 0x7fb7a40689b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.050 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb7aa3f9700 1 --2- 172.21.15.158:0/2008507270 >> v2:172.21.15.183:3300/0 conn(0x7fb7a40bf340 0x7fb7a40bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.050 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb7aa3f9700 1 -- 172.21.15.158:0/2008507270 >> 172.21.15.158:0/2008507270 conn(0x7fb7a405ddc0 msgr2=0x7fb7a405e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:16.051 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb7aa3f9700 1 -- 172.21.15.158:0/2008507270 shutdown_connections 2023-10-18T17:24:16.051 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.039+0000 7fb7aa3f9700 1 -- 172.21.15.158:0/2008507270 wait complete. 2023-10-18T17:24:16.051 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.043+0000 7fb7aa3f9700 1 Processor -- start 2023-10-18T17:24:16.052 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.043+0000 7fb7aa3f9700 1 -- start start 2023-10-18T17:24:16.053 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7aa3f9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb7a40bcaf0 0x7fb7a4152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:16.053 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7aa3f9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7a40bf340 0x7fb7a4167b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:16.053 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7aa3f9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7a413d890 0x7fb7a41537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:16.053 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7aa3f9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a40ba540 con 0x7fb7a40bcaf0 2023-10-18T17:24:16.054 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7aa3f9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a40c1630 con 0x7fb7a413d890 2023-10-18T17:24:16.054 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7aa3f9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a40c1b60 con 0x7fb7a40bf340 2023-10-18T17:24:16.054 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7a93f7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb7a40bcaf0 0x7fb7a4152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:16.054 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7a8bf6700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7a40bf340 0x7fb7a4167b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:16.054 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7a93f7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb7a40bcaf0 0x7fb7a4152e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56278/0 (socket says 172.21.15.158:56278) 2023-10-18T17:24:16.055 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7a93f7700 1 -- 172.21.15.158:0/3366734792 learned_addr learned my addr 172.21.15.158:0/3366734792 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:16.055 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7a9bf8700 1 --2- 172.21.15.158:0/3366734792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7a413d890 0x7fb7a41537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:16.056 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7a93f7700 1 -- 172.21.15.158:0/3366734792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7a40bf340 msgr2=0x7fb7a4167b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:16.056 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7a93f7700 1 --2- 172.21.15.158:0/3366734792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7a40bf340 0x7fb7a4167b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.057 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7a93f7700 1 -- 172.21.15.158:0/3366734792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7a413d890 msgr2=0x7fb7a41537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:16.057 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7a93f7700 1 --2- 172.21.15.158:0/3366734792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7a413d890 0x7fb7a41537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.057 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7a93f7700 1 -- 172.21.15.158:0/3366734792 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79c009a20 con 0x7fb7a40bcaf0 2023-10-18T17:24:16.057 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7a93f7700 1 --2- 172.21.15.158:0/3366734792 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb7a40bcaf0 0x7fb7a4152e40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fb7a000e930 tx=0x7fb7a0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:16.057 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7997fa700 1 -- 172.21.15.158:0/3366734792 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0012600 con 0x7fb7a40bcaf0 2023-10-18T17:24:16.058 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7997fa700 1 -- 172.21.15.158:0/3366734792 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a0012760 con 0x7fb7a40bcaf0 2023-10-18T17:24:16.058 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7aa3f9700 1 -- 172.21.15.158:0/3366734792 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a4167360 con 0x7fb7a40bcaf0 2023-10-18T17:24:16.058 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7997fa700 1 -- 172.21.15.158:0/3366734792 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0012ae0 con 0x7fb7a40bcaf0 2023-10-18T17:24:16.058 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.047+0000 7fb7aa3f9700 1 -- 172.21.15.158:0/3366734792 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a40c1880 con 0x7fb7a40bcaf0 2023-10-18T17:24:16.058 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.051+0000 7fb7aa3f9700 1 -- 172.21.15.158:0/3366734792 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a4046f00 con 0x7fb7a40bcaf0 2023-10-18T17:24:16.059 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.051+0000 7fb7997fa700 1 -- 172.21.15.158:0/3366734792 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb7a001b400 con 0x7fb7a40bcaf0 2023-10-18T17:24:16.059 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.051+0000 7fb7997fa700 1 --2- 172.21.15.158:0/3366734792 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb78805a510 0x7fb78805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:16.060 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.051+0000 7fb7997fa700 1 -- 172.21.15.158:0/3366734792 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb7a0074c90 con 0x7fb7a40bcaf0 2023-10-18T17:24:16.060 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.051+0000 7fb7a8bf6700 1 --2- 172.21.15.158:0/3366734792 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb78805a510 0x7fb78805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:16.060 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.055+0000 7fb7a8bf6700 1 --2- 172.21.15.158:0/3366734792 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb78805a510 0x7fb78805c9d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fb7a40bcf90 tx=0x7fb794009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:16.064 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.059+0000 7fb7997fa700 1 -- 172.21.15.158:0/3366734792 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fb7a0048350 con 0x7fb7a40bcaf0 2023-10-18T17:24:16.228 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.223+0000 7fb7aa3f9700 1 -- 172.21.15.158:0/3366734792 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb7a4157ed0 con 0x7fb7a40bcaf0 2023-10-18T17:24:16.229 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.223+0000 7fb7997fa700 1 -- 172.21.15.158:0/3366734792 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb7a004b970 con 0x7fb7a40bcaf0 2023-10-18T17:24:16.230 INFO:teuthology.orchestra.run.smithi158.stdout:55834574855 2023-10-18T17:24:16.232 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.227+0000 7fb7aa3f9700 1 -- 172.21.15.158:0/3366734792 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb78805a510 msgr2=0x7fb78805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:16.232 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.227+0000 7fb7aa3f9700 1 --2- 172.21.15.158:0/3366734792 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb78805a510 0x7fb78805c9d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fb7a40bcf90 tx=0x7fb794009040).stop 2023-10-18T17:24:16.232 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.227+0000 7fb7aa3f9700 1 -- 172.21.15.158:0/3366734792 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb7a40bcaf0 msgr2=0x7fb7a4152e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:16.233 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.227+0000 7fb7aa3f9700 1 --2- 172.21.15.158:0/3366734792 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb7a40bcaf0 0x7fb7a4152e40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fb7a000e930 tx=0x7fb7a0009060).stop 2023-10-18T17:24:16.233 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.227+0000 7fb7aa3f9700 1 -- 172.21.15.158:0/3366734792 shutdown_connections 2023-10-18T17:24:16.233 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.227+0000 7fb7aa3f9700 1 --2- 172.21.15.158:0/3366734792 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb78805a510 0x7fb78805c9d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.227+0000 7fb7aa3f9700 1 --2- 172.21.15.158:0/3366734792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7a413d890 0x7fb7a41537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.227+0000 7fb7aa3f9700 1 --2- 172.21.15.158:0/3366734792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7a40bf340 0x7fb7a4167b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.227+0000 7fb7aa3f9700 1 --2- 172.21.15.158:0/3366734792 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb7a40bcaf0 0x7fb7a4152e40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.227+0000 7fb7aa3f9700 1 -- 172.21.15.158:0/3366734792 >> 172.21.15.158:0/3366734792 conn(0x7fb7a405ddc0 msgr2=0x7fb7a4154570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:16.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.227+0000 7fb7aa3f9700 1 -- 172.21.15.158:0/3366734792 shutdown_connections 2023-10-18T17:24:16.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.227+0000 7fb7aa3f9700 1 -- 172.21.15.158:0/3366734792 wait complete. 2023-10-18T17:24:16.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.5 2023-10-18T17:24:16.252 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-18T17:24:16.411 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.403+0000 7f99b2b69700 1 Processor -- start 2023-10-18T17:24:16.411 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.403+0000 7f99b2b69700 1 -- start start 2023-10-18T17:24:16.413 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99b2b69700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f99ac0c2600 0x7f99ac0c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:16.413 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99b2b69700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99ac14e4d0 0x7f99ac066010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:16.413 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99b2b69700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f99ac14e8d0 0x7f99ac066500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:16.414 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99b2b69700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ac0bbb40 con 0x7f99ac0c2600 2023-10-18T17:24:16.414 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99b2b69700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ac0bbe00 con 0x7f99ac14e8d0 2023-10-18T17:24:16.414 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99b2b69700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0bc0e0 con 0x7f99ac14e4d0 2023-10-18T17:24:16.415 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99a3fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99ac14e4d0 0x7f99ac066010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:16.416 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99a3fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99ac14e4d0 0x7f99ac066010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:32908/0 (socket says 172.21.15.158:32908) 2023-10-18T17:24:16.416 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99a3fff700 1 -- 172.21.15.158:0/2768543922 learned_addr learned my addr 172.21.15.158:0/2768543922 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:16.416 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99b0905700 1 --2- 172.21.15.158:0/2768543922 >> v2:172.21.15.158:3300/0 conn(0x7f99ac0c2600 0x7f99ac0c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:16.416 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99b1106700 1 --2- 172.21.15.158:0/2768543922 >> v2:172.21.15.183:3300/0 conn(0x7f99ac14e8d0 0x7f99ac066500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:16.416 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99a3fff700 1 -- 172.21.15.158:0/2768543922 >> v2:172.21.15.183:3300/0 conn(0x7f99ac14e8d0 msgr2=0x7f99ac066500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:16.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99a3fff700 1 --2- 172.21.15.158:0/2768543922 >> v2:172.21.15.183:3300/0 conn(0x7f99ac14e8d0 0x7f99ac066500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99a3fff700 1 -- 172.21.15.158:0/2768543922 >> v2:172.21.15.158:3300/0 conn(0x7f99ac0c2600 msgr2=0x7f99ac0c29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:16.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99a3fff700 1 --2- 172.21.15.158:0/2768543922 >> v2:172.21.15.158:3300/0 conn(0x7f99ac0c2600 0x7f99ac0c29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99a3fff700 1 -- 172.21.15.158:0/2768543922 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac0bc3c0 con 0x7f99ac14e4d0 2023-10-18T17:24:16.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99b0905700 1 --2- 172.21.15.158:0/2768543922 >> v2:172.21.15.158:3300/0 conn(0x7f99ac0c2600 0x7f99ac0c29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:24:16.418 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99a3fff700 1 --2- 172.21.15.158:0/2768543922 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99ac14e4d0 0x7f99ac066010 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f99ac0bb620 tx=0x7f999c0090f0).ready entity=mon.2 client_cookie=886e2f18d1f57e11 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:16.418 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99a37fe700 1 -- 172.21.15.158:0/2768543922 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c00b600 con 0x7f99ac14e4d0 2023-10-18T17:24:16.418 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99a37fe700 1 -- 172.21.15.158:0/2768543922 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c00b760 con 0x7f99ac14e4d0 2023-10-18T17:24:16.418 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.407+0000 7f99a37fe700 1 -- 172.21.15.158:0/2768543922 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c00bae0 con 0x7f99ac14e4d0 2023-10-18T17:24:16.419 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.411+0000 7f99b2b69700 1 -- 172.21.15.158:0/2768543922 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99ac14e4d0 msgr2=0x7f99ac066010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:16.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.411+0000 7f99b2b69700 1 --2- 172.21.15.158:0/2768543922 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99ac14e4d0 0x7f99ac066010 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f99ac0bb620 tx=0x7f999c0090f0).stop 2023-10-18T17:24:16.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.411+0000 7f99b2b69700 1 -- 172.21.15.158:0/2768543922 shutdown_connections 2023-10-18T17:24:16.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.411+0000 7f99b2b69700 1 --2- 172.21.15.158:0/2768543922 >> v2:172.21.15.183:3300/0 conn(0x7f99ac14e8d0 0x7f99ac066500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.411+0000 7f99b2b69700 1 --2- 172.21.15.158:0/2768543922 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99ac14e4d0 0x7f99ac066010 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.411+0000 7f99b2b69700 1 --2- 172.21.15.158:0/2768543922 >> v2:172.21.15.158:3300/0 conn(0x7f99ac0c2600 0x7f99ac0c29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.421 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.411+0000 7f99b2b69700 1 -- 172.21.15.158:0/2768543922 >> 172.21.15.158:0/2768543922 conn(0x7f99ac05dc20 msgr2=0x7f99ac05e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:16.421 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.411+0000 7f99b2b69700 1 -- 172.21.15.158:0/2768543922 shutdown_connections 2023-10-18T17:24:16.421 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.411+0000 7f99b2b69700 1 -- 172.21.15.158:0/2768543922 wait complete. 2023-10-18T17:24:16.421 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.411+0000 7f99b2b69700 1 Processor -- start 2023-10-18T17:24:16.421 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.411+0000 7f99b2b69700 1 -- start start 2023-10-18T17:24:16.423 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99b2b69700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99ac0c2600 0x7f99ac1647a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:16.423 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99b2b69700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f99ac14e4d0 0x7f99ac14f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:16.424 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99b2b69700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99ac14e8d0 0x7f99ac161190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:16.424 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99b2b69700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac164310 con 0x7f99ac14e4d0 2023-10-18T17:24:16.424 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99b2b69700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0687c0 con 0x7f99ac14e8d0 2023-10-18T17:24:16.424 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99b2b69700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac068a60 con 0x7f99ac0c2600 2023-10-18T17:24:16.424 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99a3fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f99ac14e4d0 0x7f99ac14f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:16.425 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99b0905700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99ac0c2600 0x7f99ac1647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:16.425 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99a3fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f99ac14e4d0 0x7f99ac14f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56300/0 (socket says 172.21.15.158:56300) 2023-10-18T17:24:16.425 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99a3fff700 1 -- 172.21.15.158:0/3565422023 learned_addr learned my addr 172.21.15.158:0/3565422023 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:16.425 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99b1106700 1 --2- 172.21.15.158:0/3565422023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99ac14e8d0 0x7f99ac161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:16.425 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99b0905700 1 -- 172.21.15.158:0/3565422023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99ac14e8d0 msgr2=0x7f99ac161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:16.426 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99b0905700 1 --2- 172.21.15.158:0/3565422023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99ac14e8d0 0x7f99ac161190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.426 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99b0905700 1 -- 172.21.15.158:0/3565422023 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f99ac14e4d0 msgr2=0x7f99ac14f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:16.426 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99b0905700 1 --2- 172.21.15.158:0/3565422023 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f99ac14e4d0 0x7f99ac14f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.426 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99b0905700 1 -- 172.21.15.158:0/3565422023 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c009370 con 0x7f99ac0c2600 2023-10-18T17:24:16.426 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99a3fff700 1 --2- 172.21.15.158:0/3565422023 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f99ac14e4d0 0x7f99ac14f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:16.427 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99b0905700 1 --2- 172.21.15.158:0/3565422023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99ac0c2600 0x7f99ac1647a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f99a800d860 tx=0x7f99a8008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:16.427 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99a0ff9700 1 -- 172.21.15.158:0/3565422023 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8011590 con 0x7f99ac0c2600 2023-10-18T17:24:16.427 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99a0ff9700 1 -- 172.21.15.158:0/3565422023 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a80116f0 con 0x7f99ac0c2600 2023-10-18T17:24:16.427 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99b2b69700 1 -- 172.21.15.158:0/3565422023 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ac068d40 con 0x7f99ac0c2600 2023-10-18T17:24:16.427 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99a0ff9700 1 -- 172.21.15.158:0/3565422023 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8011a70 con 0x7f99ac0c2600 2023-10-18T17:24:16.428 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.415+0000 7f99b2b69700 1 -- 172.21.15.158:0/3565422023 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ac163fa0 con 0x7f99ac0c2600 2023-10-18T17:24:16.428 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.419+0000 7f99b2b69700 1 -- 172.21.15.158:0/3565422023 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ac0bb900 con 0x7f99ac0c2600 2023-10-18T17:24:16.429 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.419+0000 7f99a0ff9700 1 -- 172.21.15.158:0/3565422023 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f99a801c460 con 0x7f99ac0c2600 2023-10-18T17:24:16.429 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.419+0000 7f99a0ff9700 1 --2- 172.21.15.158:0/3565422023 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f999805a540 0x7f999805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:16.429 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.423+0000 7f99a0ff9700 1 -- 172.21.15.158:0/3565422023 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f99a80744f0 con 0x7f99ac0c2600 2023-10-18T17:24:16.429 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.423+0000 7f99a3fff700 1 --2- 172.21.15.158:0/3565422023 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f999805a540 0x7f999805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:16.430 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.423+0000 7f99a3fff700 1 --2- 172.21.15.158:0/3565422023 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f999805a540 0x7f999805ca00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f999c003080 tx=0x7f999c017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:16.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.431+0000 7f99a0ff9700 1 -- 172.21.15.158:0/3565422023 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f99ac0bb900 con 0x7f99ac0c2600 2023-10-18T17:24:16.604 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.599+0000 7f99b2b69700 1 -- 172.21.15.158:0/3565422023 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f99ac0bb900 con 0x7f99ac0c2600 2023-10-18T17:24:16.605 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.599+0000 7f99a0ff9700 1 -- 172.21.15.158:0/3565422023 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f99ac0bb900 con 0x7f99ac0c2600 2023-10-18T17:24:16.605 INFO:teuthology.orchestra.run.smithi158.stdout:55834574854 2023-10-18T17:24:16.607 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.599+0000 7f99b2b69700 1 -- 172.21.15.158:0/3565422023 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f999805a540 msgr2=0x7f999805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:16.608 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.599+0000 7f99b2b69700 1 --2- 172.21.15.158:0/3565422023 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f999805a540 0x7f999805ca00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f999c003080 tx=0x7f999c017000).stop 2023-10-18T17:24:16.608 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.599+0000 7f99b2b69700 1 -- 172.21.15.158:0/3565422023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99ac0c2600 msgr2=0x7f99ac1647a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:16.608 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.599+0000 7f99b2b69700 1 --2- 172.21.15.158:0/3565422023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99ac0c2600 0x7f99ac1647a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f99a800d860 tx=0x7f99a8008040).stop 2023-10-18T17:24:16.608 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.599+0000 7f99b2b69700 1 -- 172.21.15.158:0/3565422023 shutdown_connections 2023-10-18T17:24:16.609 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.599+0000 7f99b2b69700 1 --2- 172.21.15.158:0/3565422023 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f999805a540 0x7f999805ca00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.609 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.599+0000 7f99b2b69700 1 --2- 172.21.15.158:0/3565422023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99ac14e8d0 0x7f99ac161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.609 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.599+0000 7f99b2b69700 1 --2- 172.21.15.158:0/3565422023 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f99ac14e4d0 0x7f99ac14f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.609 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.599+0000 7f99b2b69700 1 --2- 172.21.15.158:0/3565422023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99ac0c2600 0x7f99ac1647a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.609 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.599+0000 7f99b2b69700 1 -- 172.21.15.158:0/3565422023 >> 172.21.15.158:0/3565422023 conn(0x7f99ac05dc20 msgr2=0x7f99ac14d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:16.610 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.603+0000 7f99b2b69700 1 -- 172.21.15.158:0/3565422023 shutdown_connections 2023-10-18T17:24:16.610 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.603+0000 7f99b2b69700 1 -- 172.21.15.158:0/3565422023 wait complete. 2023-10-18T17:24:16.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2023-10-18T17:24:16.626 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-18T17:24:16.790 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.783+0000 7f3678968700 1 Processor -- start 2023-10-18T17:24:16.790 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.783+0000 7f3678968700 1 -- start start 2023-10-18T17:24:16.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f3678968700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f36740bf720 0x7f36740bcea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:16.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f3678968700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36741539b0 0x7f3674153e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:16.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f3678968700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3674153520 con 0x7f36740bf340 2023-10-18T17:24:16.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f3678968700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3674154300 con 0x7f36740bf720 2023-10-18T17:24:16.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f3678968700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3674068150 con 0x7f36741539b0 2023-10-18T17:24:16.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f367359e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36741539b0 0x7f3674153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:16.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f366bfff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f36740bf720 0x7f36740bcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:16.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f3672d9d700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f36740bf340 0x7f3674066240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:38678/0 (socket says 172.21.15.158:38678) 2023-10-18T17:24:16.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f3672d9d700 1 -- 172.21.15.158:0/3307174845 learned_addr learned my addr 172.21.15.158:0/3307174845 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:16.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f366bfff700 1 -- 172.21.15.158:0/3307174845 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36741539b0 msgr2=0x7f3674153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:16.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f366bfff700 1 --2- 172.21.15.158:0/3307174845 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36741539b0 0x7f3674153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f366bfff700 1 -- 172.21.15.158:0/3307174845 >> v1:172.21.15.158:6789/0 conn(0x7f36740bf340 legacy=0x7f3674066240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:16.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f366bfff700 1 -- 172.21.15.158:0/3307174845 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3674068430 con 0x7f36740bf720 2023-10-18T17:24:16.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f366bfff700 1 --2- 172.21.15.158:0/3307174845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36740bf720 0x7f36740bcea0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f365c009760 tx=0x7f365c009060).ready entity=mon.1 client_cookie=474db70de1242223 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:16.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f367259c700 1 -- 172.21.15.158:0/3307174845 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c00b590 con 0x7f36740bf720 2023-10-18T17:24:16.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f367259c700 1 -- 172.21.15.158:0/3307174845 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c00b6f0 con 0x7f36740bf720 2023-10-18T17:24:16.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f367259c700 1 -- 172.21.15.158:0/3307174845 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c00ba70 con 0x7f36740bf720 2023-10-18T17:24:16.797 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f3678968700 1 -- 172.21.15.158:0/3307174845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36740bf720 msgr2=0x7f36740bcea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:16.798 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f3678968700 1 --2- 172.21.15.158:0/3307174845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36740bf720 0x7f36740bcea0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f365c009760 tx=0x7f365c009060).stop 2023-10-18T17:24:16.798 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f3678968700 1 -- 172.21.15.158:0/3307174845 shutdown_connections 2023-10-18T17:24:16.798 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f3678968700 1 --2- 172.21.15.158:0/3307174845 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36741539b0 0x7f3674153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.798 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f3678968700 1 --2- 172.21.15.158:0/3307174845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36740bf720 0x7f36740bcea0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.798 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f3678968700 1 -- 172.21.15.158:0/3307174845 >> 172.21.15.158:0/3307174845 conn(0x7f367405ddc0 msgr2=0x7f367405e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:16.799 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f3678968700 1 -- 172.21.15.158:0/3307174845 shutdown_connections 2023-10-18T17:24:16.799 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.787+0000 7f3678968700 1 -- 172.21.15.158:0/3307174845 wait complete. 2023-10-18T17:24:16.799 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.791+0000 7f3678968700 1 Processor -- start 2023-10-18T17:24:16.799 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.791+0000 7f3678968700 1 -- start start 2023-10-18T17:24:16.801 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.791+0000 7f3678968700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36740bf340 0x7f3674160c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:16.801 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.791+0000 7f3678968700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36740bf720 0x7f36740ba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:16.802 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.791+0000 7f3678968700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36741539b0 0x7f36740662d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:16.802 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.791+0000 7f3678968700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36741474b0 con 0x7f36740bf340 2023-10-18T17:24:16.802 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.791+0000 7f3678968700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3674161160 con 0x7f36741539b0 2023-10-18T17:24:16.802 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.791+0000 7f3678968700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3674148390 con 0x7f36740bf720 2023-10-18T17:24:16.803 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.791+0000 7f3672d9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36740bf340 0x7f3674160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:16.803 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.791+0000 7f366bfff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36740bf720 0x7f36740ba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:16.803 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.791+0000 7f3672d9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36740bf340 0x7f3674160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56306/0 (socket says 172.21.15.158:56306) 2023-10-18T17:24:16.803 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.791+0000 7f3672d9d700 1 -- 172.21.15.158:0/4185938129 learned_addr learned my addr 172.21.15.158:0/4185938129 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:16.804 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.791+0000 7f367359e700 1 --2- 172.21.15.158:0/4185938129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36741539b0 0x7f36740662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:16.804 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.795+0000 7f3672d9d700 1 -- 172.21.15.158:0/4185938129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36740bf720 msgr2=0x7f36740ba4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:16.804 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.795+0000 7f3672d9d700 1 --2- 172.21.15.158:0/4185938129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36740bf720 0x7f36740ba4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.804 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.795+0000 7f3672d9d700 1 -- 172.21.15.158:0/4185938129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36741539b0 msgr2=0x7f36740662d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:16.804 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.795+0000 7f3672d9d700 1 --2- 172.21.15.158:0/4185938129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36741539b0 0x7f36740662d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.805 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.795+0000 7f3672d9d700 1 -- 172.21.15.158:0/4185938129 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c0092a0 con 0x7f36740bf340 2023-10-18T17:24:16.805 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.795+0000 7f366bfff700 1 --2- 172.21.15.158:0/4185938129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36740bf720 0x7f36740ba4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:16.805 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.795+0000 7f3672d9d700 1 --2- 172.21.15.158:0/4185938129 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36740bf340 0x7f3674160c70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f3664007fd0 tx=0x7f3664007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:16.805 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.795+0000 7f366affd700 1 -- 172.21.15.158:0/4185938129 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366400ce10 con 0x7f36740bf340 2023-10-18T17:24:16.805 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.795+0000 7f3678968700 1 -- 172.21.15.158:0/4185938129 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3674148670 con 0x7f36740bf340 2023-10-18T17:24:16.806 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.795+0000 7f366affd700 1 -- 172.21.15.158:0/4185938129 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36640072e0 con 0x7f36740bf340 2023-10-18T17:24:16.806 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.795+0000 7f366affd700 1 -- 172.21.15.158:0/4185938129 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664007660 con 0x7f36740bf340 2023-10-18T17:24:16.806 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.795+0000 7f3678968700 1 -- 172.21.15.158:0/4185938129 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36741470d0 con 0x7f36740bf340 2023-10-18T17:24:16.807 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.795+0000 7f3678968700 1 -- 172.21.15.158:0/4185938129 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36741475f0 con 0x7f36740bf340 2023-10-18T17:24:16.807 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.795+0000 7f366affd700 1 -- 172.21.15.158:0/4185938129 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f36640059b0 con 0x7f36740bf340 2023-10-18T17:24:16.807 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.799+0000 7f366affd700 1 --2- 172.21.15.158:0/4185938129 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f365805a540 0x7f365805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:16.808 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.799+0000 7f366affd700 1 -- 172.21.15.158:0/4185938129 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3664073fd0 con 0x7f36740bf340 2023-10-18T17:24:16.808 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.799+0000 7f366bfff700 1 --2- 172.21.15.158:0/4185938129 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f365805a540 0x7f365805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:16.808 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.799+0000 7f366bfff700 1 --2- 172.21.15.158:0/4185938129 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f365805a540 0x7f365805ca00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f365c00b350 tx=0x7f365c017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:16.810 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.803+0000 7f366affd700 1 -- 172.21.15.158:0/4185938129 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f36640476f0 con 0x7f36740bf340 2023-10-18T17:24:16.968 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.963+0000 7f3678968700 1 -- 172.21.15.158:0/4185938129 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3674046f00 con 0x7f36740bf340 2023-10-18T17:24:16.968 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.963+0000 7f366affd700 1 -- 172.21.15.158:0/4185938129 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f366404ad10 con 0x7f36740bf340 2023-10-18T17:24:16.969 INFO:teuthology.orchestra.run.smithi158.stdout:55834574855 2023-10-18T17:24:16.970 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.963+0000 7f3678968700 1 -- 172.21.15.158:0/4185938129 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f365805a540 msgr2=0x7f365805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:16.971 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.963+0000 7f3678968700 1 --2- 172.21.15.158:0/4185938129 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f365805a540 0x7f365805ca00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f365c00b350 tx=0x7f365c017000).stop 2023-10-18T17:24:16.971 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.963+0000 7f3678968700 1 -- 172.21.15.158:0/4185938129 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36740bf340 msgr2=0x7f3674160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:16.971 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.963+0000 7f3678968700 1 --2- 172.21.15.158:0/4185938129 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36740bf340 0x7f3674160c70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f3664007fd0 tx=0x7f3664007df0).stop 2023-10-18T17:24:16.972 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.963+0000 7f3678968700 1 -- 172.21.15.158:0/4185938129 shutdown_connections 2023-10-18T17:24:16.972 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.963+0000 7f3678968700 1 --2- 172.21.15.158:0/4185938129 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f365805a540 0x7f365805ca00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.972 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.963+0000 7f3678968700 1 --2- 172.21.15.158:0/4185938129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36741539b0 0x7f36740662d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.973 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.963+0000 7f3678968700 1 --2- 172.21.15.158:0/4185938129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36740bf720 0x7f36740ba4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.973 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.963+0000 7f3678968700 1 --2- 172.21.15.158:0/4185938129 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36740bf340 0x7f3674160c70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:16.973 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.963+0000 7f3678968700 1 -- 172.21.15.158:0/4185938129 >> 172.21.15.158:0/4185938129 conn(0x7f367405ddc0 msgr2=0x7f367414f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:16.973 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.963+0000 7f3678968700 1 -- 172.21.15.158:0/4185938129 shutdown_connections 2023-10-18T17:24:16.973 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:16.963+0000 7f3678968700 1 -- 172.21.15.158:0/4185938129 wait complete. 2023-10-18T17:24:16.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.7 2023-10-18T17:24:16.990 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-18T17:24:16.991 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T17:24:17.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.155+0000 7f7083e9b700 1 Processor -- start 2023-10-18T17:24:17.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.155+0000 7f7083e9b700 1 -- start start 2023-10-18T17:24:17.163 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.155+0000 7f7083e9b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f707c14a090 0x7f707c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:17.163 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.155+0000 7f7083e9b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f707c0be020 con 0x7f707c149cb0 2023-10-18T17:24:17.163 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.155+0000 7f7083e9b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f707c065130 con 0x7f707c0bcab0 2023-10-18T17:24:17.163 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.155+0000 7f7083e9b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f707c0bfa80 con 0x7f707c14a090 2023-10-18T17:24:17.166 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.155+0000 7f7081436700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f707c0bcab0 0x7f707c067e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:57104/0 (socket says 172.21.15.158:57104) 2023-10-18T17:24:17.166 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.155+0000 7f7081436700 1 -- 172.21.15.158:0/2818014833 learned_addr learned my addr 172.21.15.158:0/2818014833 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:17.166 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.155+0000 7f7082438700 1 --2- 172.21.15.158:0/2818014833 >> v2:172.21.15.183:3300/0 conn(0x7f707c14a090 0x7f707c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:17.166 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 -- 172.21.15.158:0/2818014833 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2990938601 0 0) 0x7f707c065130 con 0x7f707c0bcab0 2023-10-18T17:24:17.167 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 -- 172.21.15.158:0/2818014833 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70680033f0 con 0x7f707c0bcab0 2023-10-18T17:24:17.167 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 -- 172.21.15.158:0/2818014833 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1659030884 0 0) 0x7f707c0be020 con 0x7f707c149cb0 2023-10-18T17:24:17.167 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 -- 172.21.15.158:0/2818014833 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f707c065130 con 0x7f707c149cb0 2023-10-18T17:24:17.167 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 -- 172.21.15.158:0/2818014833 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2171385847 0 0) 0x7f70680033f0 con 0x7f707c0bcab0 2023-10-18T17:24:17.167 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 -- 172.21.15.158:0/2818014833 >> v2:172.21.15.183:3300/0 conn(0x7f707c14a090 msgr2=0x7f707c069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:17.168 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 --2- 172.21.15.158:0/2818014833 >> v2:172.21.15.183:3300/0 conn(0x7f707c14a090 0x7f707c069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:17.168 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 -- 172.21.15.158:0/2818014833 >> v1:172.21.15.158:6789/0 conn(0x7f707c149cb0 legacy=0x7f707c0bd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:17.168 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 -- 172.21.15.158:0/2818014833 --> v1:172.21.15.183:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c0653f0 con 0x7f707c0bcab0 2023-10-18T17:24:17.168 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 -- 172.21.15.158:0/2818014833 <== mon.1 v1:172.21.15.183:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2074596555 0 0) 0x7f706c001470 con 0x7f707c0bcab0 2023-10-18T17:24:17.168 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 -- 172.21.15.158:0/2818014833 >> v1:172.21.15.183:6789/0 conn(0x7f707c0bcab0 legacy=0x7f707c067e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:17.169 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 --2- 172.21.15.158:0/2818014833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7068003a70 0x7f7068003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:17.169 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 --2- 172.21.15.158:0/2818014833 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7068004690 0x7f7068004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:17.169 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 --2- 172.21.15.158:0/2818014833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7068005000 0x7f706800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:17.169 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 -- 172.21.15.158:0/2818014833 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0bfa80 con 0x7f7068004690 2023-10-18T17:24:17.169 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 -- 172.21.15.158:0/2818014833 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706800be00 con 0x7f7068003a70 2023-10-18T17:24:17.169 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 -- 172.21.15.158:0/2818014833 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706800bfc0 con 0x7f7068005000 2023-10-18T17:24:17.170 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7082438700 1 --2- 172.21.15.158:0/2818014833 >> v2:172.21.15.183:3300/0 conn(0x7f707c14a090 0x7f707c069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:17.170 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7081436700 1 --2- 172.21.15.158:0/2818014833 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7068004690 0x7f7068004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:17.170 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7081c37700 1 --2- 172.21.15.158:0/2818014833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7068003a70 0x7f7068003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:17.170 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7082438700 1 --2- 172.21.15.158:0/2818014833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7068005000 0x7f706800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:17.172 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7081436700 1 -- 172.21.15.158:0/2818014833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7068005000 msgr2=0x7f706800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:17.172 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7081436700 1 --2- 172.21.15.158:0/2818014833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7068005000 0x7f706800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:17.172 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7081436700 1 -- 172.21.15.158:0/2818014833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7068003a70 msgr2=0x7f7068003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:17.172 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7081436700 1 --2- 172.21.15.158:0/2818014833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7068003a70 0x7f7068003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:17.173 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7081436700 1 -- 172.21.15.158:0/2818014833 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70680033f0 con 0x7f7068004690 2023-10-18T17:24:17.173 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7082438700 1 -- 172.21.15.158:0/2818014833 reap_dead start 2023-10-18T17:24:17.173 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7081436700 1 --2- 172.21.15.158:0/2818014833 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7068004690 0x7f7068004b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f706c004f50 tx=0x7f706c008a90).ready entity=mon.0 client_cookie=da5c41c4d456426b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:17.173 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 -- 172.21.15.158:0/2818014833 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c008170 con 0x7f7068004690 2023-10-18T17:24:17.173 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 -- 172.21.15.158:0/2818014833 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c0082d0 con 0x7f7068004690 2023-10-18T17:24:17.174 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.159+0000 7f7080c35700 1 -- 172.21.15.158:0/2818014833 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c0057a0 con 0x7f7068004690 2023-10-18T17:24:17.174 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.163+0000 7f7083e9b700 1 -- 172.21.15.158:0/2818014833 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7068004690 msgr2=0x7f7068004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:17.174 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.163+0000 7f7083e9b700 1 --2- 172.21.15.158:0/2818014833 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7068004690 0x7f7068004b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f706c004f50 tx=0x7f706c008a90).stop 2023-10-18T17:24:17.174 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.163+0000 7f7083e9b700 1 -- 172.21.15.158:0/2818014833 shutdown_connections 2023-10-18T17:24:17.174 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.163+0000 7f7083e9b700 1 --2- 172.21.15.158:0/2818014833 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7068004690 0x7f7068004b10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:17.175 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.163+0000 7f7083e9b700 1 -- 172.21.15.158:0/2818014833 >> 172.21.15.158:0/2818014833 conn(0x7f707c0620d0 msgr2=0x7f707c0624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:17.175 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.163+0000 7f7083e9b700 1 -- 172.21.15.158:0/2818014833 shutdown_connections 2023-10-18T17:24:17.175 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.163+0000 7f7083e9b700 1 -- 172.21.15.158:0/2818014833 wait complete. 2023-10-18T17:24:17.175 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.163+0000 7f7083e9b700 1 Processor -- start 2023-10-18T17:24:17.175 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.163+0000 7f7083e9b700 1 -- start start 2023-10-18T17:24:17.178 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7083e9b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7068004690 0x7f707c0bbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:17.178 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7083e9b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f707c0bc2a0 0x7f707c0ba050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:17.178 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7083e9b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f707c0ba540 0x7f707c14f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:17.178 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7083e9b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0b87f0 con 0x7f707c0bc2a0 2023-10-18T17:24:17.178 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7083e9b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0bb7f0 con 0x7f7068004690 2023-10-18T17:24:17.179 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7083e9b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707c152920 con 0x7f707c0ba540 2023-10-18T17:24:17.179 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7082438700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f707c0ba540 0x7f707c14f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:17.179 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7081436700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f707c0bc2a0 0x7f707c0ba050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:17.179 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7081c37700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7068004690 0x7f707c0bbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:17.179 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7081436700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f707c0bc2a0 0x7f707c0ba050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56328/0 (socket says 172.21.15.158:56328) 2023-10-18T17:24:17.180 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7081436700 1 -- 172.21.15.158:0/2852152736 learned_addr learned my addr 172.21.15.158:0/2852152736 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:17.180 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7081436700 1 -- 172.21.15.158:0/2852152736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f707c0ba540 msgr2=0x7f707c14f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:17.180 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7081436700 1 --2- 172.21.15.158:0/2852152736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f707c0ba540 0x7f707c14f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:17.180 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7081436700 1 -- 172.21.15.158:0/2852152736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7068004690 msgr2=0x7f707c0bbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:17.180 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7081436700 1 --2- 172.21.15.158:0/2852152736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7068004690 0x7f707c0bbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:17.181 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7081436700 1 -- 172.21.15.158:0/2852152736 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c152c00 con 0x7f707c0bc2a0 2023-10-18T17:24:17.181 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7081436700 1 --2- 172.21.15.158:0/2852152736 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f707c0bc2a0 0x7f707c0ba050 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f706800bdd0 tx=0x7f706c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:17.181 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7071ffb700 1 -- 172.21.15.158:0/2852152736 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c005730 con 0x7f707c0bc2a0 2023-10-18T17:24:17.181 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7071ffb700 1 -- 172.21.15.158:0/2852152736 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c019070 con 0x7f707c0bc2a0 2023-10-18T17:24:17.181 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7083e9b700 1 -- 172.21.15.158:0/2852152736 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707c152ee0 con 0x7f707c0bc2a0 2023-10-18T17:24:17.182 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7071ffb700 1 -- 172.21.15.158:0/2852152736 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c005b10 con 0x7f707c0bc2a0 2023-10-18T17:24:17.182 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.167+0000 7f7083e9b700 1 -- 172.21.15.158:0/2852152736 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707c1534a0 con 0x7f707c0bc2a0 2023-10-18T17:24:17.182 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.171+0000 7f7083e9b700 1 -- 172.21.15.158:0/2852152736 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707c0b9d00 con 0x7f707c0bc2a0 2023-10-18T17:24:17.183 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.171+0000 7f7071ffb700 1 -- 172.21.15.158:0/2852152736 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f706c015410 con 0x7f707c0bc2a0 2023-10-18T17:24:17.183 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.171+0000 7f7071ffb700 1 --2- 172.21.15.158:0/2852152736 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f706005a510 0x7f706005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:17.183 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.171+0000 7f7071ffb700 1 -- 172.21.15.158:0/2852152736 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f706c0760b0 con 0x7f707c0bc2a0 2023-10-18T17:24:17.183 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.175+0000 7f7081c37700 1 --2- 172.21.15.158:0/2852152736 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f706005a510 0x7f706005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:17.184 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.175+0000 7f7081c37700 1 --2- 172.21.15.158:0/2852152736 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f706005a510 0x7f706005c9d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f7078000c00 tx=0x7f7078007b90).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:17.184 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.179+0000 7f7071ffb700 1 -- 172.21.15.158:0/2852152736 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f706c049820 con 0x7f707c0bc2a0 2023-10-18T17:24:17.346 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.339+0000 7f7083e9b700 1 -- 172.21.15.158:0/2852152736 --> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f707c06c190 con 0x7f706005a510 2023-10-18T17:24:17.366 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.359+0000 7f7071ffb700 1 -- 172.21.15.158:0/2852152736 <== mgr.4100 v2:172.21.15.183:6832/33555 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336098 (secure 0 0 0) 0x7f707c06c190 con 0x7f706005a510 2023-10-18T17:24:17.372 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:17.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.367+0000 7f7083e9b700 1 -- 172.21.15.158:0/2852152736 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f706005a510 msgr2=0x7f706005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:17.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.367+0000 7f7083e9b700 1 --2- 172.21.15.158:0/2852152736 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f706005a510 0x7f706005c9d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f7078000c00 tx=0x7f7078007b90).stop 2023-10-18T17:24:17.376 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.367+0000 7f7083e9b700 1 -- 172.21.15.158:0/2852152736 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f707c0bc2a0 msgr2=0x7f707c0ba050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:17.376 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.367+0000 7f7083e9b700 1 --2- 172.21.15.158:0/2852152736 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f707c0bc2a0 0x7f707c0ba050 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f706800bdd0 tx=0x7f706c016000).stop 2023-10-18T17:24:17.376 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.367+0000 7f7083e9b700 1 -- 172.21.15.158:0/2852152736 shutdown_connections 2023-10-18T17:24:17.376 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.367+0000 7f7083e9b700 1 --2- 172.21.15.158:0/2852152736 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f706005a510 0x7f706005c9d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:17.376 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.367+0000 7f7083e9b700 1 --2- 172.21.15.158:0/2852152736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f707c0ba540 0x7f707c14f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:17.377 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.367+0000 7f7083e9b700 1 --2- 172.21.15.158:0/2852152736 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f707c0bc2a0 0x7f707c0ba050 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:17.377 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.367+0000 7f7083e9b700 1 --2- 172.21.15.158:0/2852152736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7068004690 0x7f707c0bbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:17.377 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.367+0000 7f7083e9b700 1 -- 172.21.15.158:0/2852152736 >> 172.21.15.158:0/2852152736 conn(0x7f707c0620d0 msgr2=0x7f707c0bf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:17.377 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.367+0000 7f7083e9b700 1 -- 172.21.15.158:0/2852152736 shutdown_connections 2023-10-18T17:24:17.377 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.367+0000 7f7083e9b700 1 -- 172.21.15.158:0/2852152736 wait complete. 2023-10-18T17:24:17.378 INFO:teuthology.orchestra.run.smithi158.stderr:dumped all 2023-10-18T17:24:17.395 INFO:teuthology.orchestra.run.smithi158.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-18T17:24:15.491544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378516,"kb_used_data":1748,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596204,"statfs":{"total":773094113280,"available":770658512896,"internally_reserved":0,"allocated":1789952,"data_stored":678853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.247609+0000","last_change":"2023-10-18T17:24:04.239274+0000","last_active":"2023-10-18T17:24:04.247609+0000","last_peered":"2023-10-18T17:24:04.247609+0000","last_clean":"2023-10-18T17:24:04.247609+0000","last_became_active":"2023-10-18T17:24:04.238910+0000","last_became_peered":"2023-10-18T17:24:04.238910+0000","last_unstale":"2023-10-18T17:24:04.247609+0000","last_undegraded":"2023-10-18T17:24:04.247609+0000","last_fullsized":"2023-10-18T17:24:04.247609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.226011+0000","last_change":"2023-10-18T17:24:03.748169+0000","last_active":"2023-10-18T17:24:04.226011+0000","last_peered":"2023-10-18T17:24:04.226011+0000","last_clean":"2023-10-18T17:24:04.226011+0000","last_became_active":"2023-10-18T17:24:03.747891+0000","last_became_peered":"2023-10-18T17:24:03.747891+0000","last_unstale":"2023-10-18T17:24:04.226011+0000","last_undegraded":"2023-10-18T17:24:04.226011+0000","last_fullsized":"2023-10-18T17:24:04.226011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.260959+0000","last_change":"2023-10-18T17:24:04.259514+0000","last_active":"2023-10-18T17:24:04.260959+0000","last_peered":"2023-10-18T17:24:04.260959+0000","last_clean":"2023-10-18T17:24:04.260959+0000","last_became_active":"2023-10-18T17:24:04.253467+0000","last_became_peered":"2023-10-18T17:24:04.253467+0000","last_unstale":"2023-10-18T17:24:04.260959+0000","last_undegraded":"2023-10-18T17:24:04.260959+0000","last_fullsized":"2023-10-18T17:24:04.260959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230173+0000","last_change":"2023-10-18T17:24:03.746790+0000","last_active":"2023-10-18T17:24:04.230173+0000","last_peered":"2023-10-18T17:24:04.230173+0000","last_clean":"2023-10-18T17:24:04.230173+0000","last_became_active":"2023-10-18T17:24:03.746453+0000","last_became_peered":"2023-10-18T17:24:03.746453+0000","last_unstale":"2023-10-18T17:24:04.230173+0000","last_undegraded":"2023-10-18T17:24:04.230173+0000","last_fullsized":"2023-10-18T17:24:04.230173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.232414+0000","last_change":"2023-10-18T17:24:03.741477+0000","last_active":"2023-10-18T17:24:04.232414+0000","last_peered":"2023-10-18T17:24:04.232414+0000","last_clean":"2023-10-18T17:24:04.232414+0000","last_became_active":"2023-10-18T17:24:03.741171+0000","last_became_peered":"2023-10-18T17:24:03.741171+0000","last_unstale":"2023-10-18T17:24:04.232414+0000","last_undegraded":"2023-10-18T17:24:04.232414+0000","last_fullsized":"2023-10-18T17:24:04.232414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.268474+0000","last_change":"2023-10-18T17:24:04.267322+0000","last_active":"2023-10-18T17:24:04.268474+0000","last_peered":"2023-10-18T17:24:04.268474+0000","last_clean":"2023-10-18T17:24:04.268474+0000","last_became_active":"2023-10-18T17:24:04.266792+0000","last_became_peered":"2023-10-18T17:24:04.266792+0000","last_unstale":"2023-10-18T17:24:04.268474+0000","last_undegraded":"2023-10-18T17:24:04.268474+0000","last_fullsized":"2023-10-18T17:24:04.268474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.244754+0000","last_change":"2023-10-18T17:24:03.740595+0000","last_active":"2023-10-18T17:24:04.244754+0000","last_peered":"2023-10-18T17:24:04.244754+0000","last_clean":"2023-10-18T17:24:04.244754+0000","last_became_active":"2023-10-18T17:24:03.738983+0000","last_became_peered":"2023-10-18T17:24:03.738983+0000","last_unstale":"2023-10-18T17:24:04.244754+0000","last_undegraded":"2023-10-18T17:24:04.244754+0000","last_fullsized":"2023-10-18T17:24:04.244754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.261525+0000","last_change":"2023-10-18T17:24:04.252476+0000","last_active":"2023-10-18T17:24:04.261525+0000","last_peered":"2023-10-18T17:24:04.261525+0000","last_clean":"2023-10-18T17:24:04.261525+0000","last_became_active":"2023-10-18T17:24:04.252105+0000","last_became_peered":"2023-10-18T17:24:04.252105+0000","last_unstale":"2023-10-18T17:24:04.261525+0000","last_undegraded":"2023-10-18T17:24:04.261525+0000","last_fullsized":"2023-10-18T17:24:04.261525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.239066+0000","last_change":"2023-10-18T17:24:03.743161+0000","last_active":"2023-10-18T17:24:04.239066+0000","last_peered":"2023-10-18T17:24:04.239066+0000","last_clean":"2023-10-18T17:24:04.239066+0000","last_became_active":"2023-10-18T17:24:03.742829+0000","last_became_peered":"2023-10-18T17:24:03.742829+0000","last_unstale":"2023-10-18T17:24:04.239066+0000","last_undegraded":"2023-10-18T17:24:04.239066+0000","last_fullsized":"2023-10-18T17:24:04.239066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.241446+0000","last_change":"2023-10-18T17:24:04.236924+0000","last_active":"2023-10-18T17:24:04.241446+0000","last_peered":"2023-10-18T17:24:04.241446+0000","last_clean":"2023-10-18T17:24:04.241446+0000","last_became_active":"2023-10-18T17:24:04.236665+0000","last_became_peered":"2023-10-18T17:24:04.236665+0000","last_unstale":"2023-10-18T17:24:04.241446+0000","last_undegraded":"2023-10-18T17:24:04.241446+0000","last_fullsized":"2023-10-18T17:24:04.241446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.236924+0000","last_change":"2023-10-18T17:24:03.751587+0000","last_active":"2023-10-18T17:24:04.236924+0000","last_peered":"2023-10-18T17:24:04.236924+0000","last_clean":"2023-10-18T17:24:04.236924+0000","last_became_active":"2023-10-18T17:24:03.750569+0000","last_became_peered":"2023-10-18T17:24:03.750569+0000","last_unstale":"2023-10-18T17:24:04.236924+0000","last_undegraded":"2023-10-18T17:24:04.236924+0000","last_fullsized":"2023-10-18T17:24:04.236924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.261491+0000","last_change":"2023-10-18T17:24:04.256918+0000","last_active":"2023-10-18T17:24:04.261491+0000","last_peered":"2023-10-18T17:24:04.261491+0000","last_clean":"2023-10-18T17:24:04.261491+0000","last_became_active":"2023-10-18T17:24:04.256613+0000","last_became_peered":"2023-10-18T17:24:04.256613+0000","last_unstale":"2023-10-18T17:24:04.261491+0000","last_undegraded":"2023-10-18T17:24:04.261491+0000","last_fullsized":"2023-10-18T17:24:04.261491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.234112+0000","last_change":"2023-10-18T17:24:03.746467+0000","last_active":"2023-10-18T17:24:04.234112+0000","last_peered":"2023-10-18T17:24:04.234112+0000","last_clean":"2023-10-18T17:24:04.234112+0000","last_became_active":"2023-10-18T17:24:03.746097+0000","last_became_peered":"2023-10-18T17:24:03.746097+0000","last_unstale":"2023-10-18T17:24:04.234112+0000","last_undegraded":"2023-10-18T17:24:04.234112+0000","last_fullsized":"2023-10-18T17:24:04.234112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258932+0000","last_change":"2023-10-18T17:24:04.250040+0000","last_active":"2023-10-18T17:24:04.258932+0000","last_peered":"2023-10-18T17:24:04.258932+0000","last_clean":"2023-10-18T17:24:04.258932+0000","last_became_active":"2023-10-18T17:24:04.249714+0000","last_became_peered":"2023-10-18T17:24:04.249714+0000","last_unstale":"2023-10-18T17:24:04.258932+0000","last_undegraded":"2023-10-18T17:24:04.258932+0000","last_fullsized":"2023-10-18T17:24:04.258932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230946+0000","last_change":"2023-10-18T17:24:03.747229+0000","last_active":"2023-10-18T17:24:04.230946+0000","last_peered":"2023-10-18T17:24:04.230946+0000","last_clean":"2023-10-18T17:24:04.230946+0000","last_became_active":"2023-10-18T17:24:03.746616+0000","last_became_peered":"2023-10-18T17:24:03.746616+0000","last_unstale":"2023-10-18T17:24:04.230946+0000","last_undegraded":"2023-10-18T17:24:04.230946+0000","last_fullsized":"2023-10-18T17:24:04.230946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.247394+0000","last_change":"2023-10-18T17:24:04.245726+0000","last_active":"2023-10-18T17:24:04.247394+0000","last_peered":"2023-10-18T17:24:04.247394+0000","last_clean":"2023-10-18T17:24:04.247394+0000","last_became_active":"2023-10-18T17:24:04.245359+0000","last_became_peered":"2023-10-18T17:24:04.245359+0000","last_unstale":"2023-10-18T17:24:04.247394+0000","last_undegraded":"2023-10-18T17:24:04.247394+0000","last_fullsized":"2023-10-18T17:24:04.247394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.242895+0000","last_change":"2023-10-18T17:24:03.750446+0000","last_active":"2023-10-18T17:24:04.242895+0000","last_peered":"2023-10-18T17:24:04.242895+0000","last_clean":"2023-10-18T17:24:04.242895+0000","last_became_active":"2023-10-18T17:24:03.750168+0000","last_became_peered":"2023-10-18T17:24:03.750168+0000","last_unstale":"2023-10-18T17:24:04.242895+0000","last_undegraded":"2023-10-18T17:24:04.242895+0000","last_fullsized":"2023-10-18T17:24:04.242895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253696+0000","last_change":"2023-10-18T17:24:04.248487+0000","last_active":"2023-10-18T17:24:04.253696+0000","last_peered":"2023-10-18T17:24:04.253696+0000","last_clean":"2023-10-18T17:24:04.253696+0000","last_became_active":"2023-10-18T17:24:04.248084+0000","last_became_peered":"2023-10-18T17:24:04.248084+0000","last_unstale":"2023-10-18T17:24:04.253696+0000","last_undegraded":"2023-10-18T17:24:04.253696+0000","last_fullsized":"2023-10-18T17:24:04.253696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230132+0000","last_change":"2023-10-18T17:24:03.762411+0000","last_active":"2023-10-18T17:24:04.230132+0000","last_peered":"2023-10-18T17:24:04.230132+0000","last_clean":"2023-10-18T17:24:04.230132+0000","last_became_active":"2023-10-18T17:24:03.762048+0000","last_became_peered":"2023-10-18T17:24:03.762048+0000","last_unstale":"2023-10-18T17:24:04.230132+0000","last_undegraded":"2023-10-18T17:24:04.230132+0000","last_fullsized":"2023-10-18T17:24:04.230132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258720+0000","last_change":"2023-10-18T17:24:04.255411+0000","last_active":"2023-10-18T17:24:04.258720+0000","last_peered":"2023-10-18T17:24:04.258720+0000","last_clean":"2023-10-18T17:24:04.258720+0000","last_became_active":"2023-10-18T17:24:04.253124+0000","last_became_peered":"2023-10-18T17:24:04.253124+0000","last_unstale":"2023-10-18T17:24:04.258720+0000","last_undegraded":"2023-10-18T17:24:04.258720+0000","last_fullsized":"2023-10-18T17:24:04.258720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250604+0000","last_change":"2023-10-18T17:24:03.753682+0000","last_active":"2023-10-18T17:24:04.250604+0000","last_peered":"2023-10-18T17:24:04.250604+0000","last_clean":"2023-10-18T17:24:04.250604+0000","last_became_active":"2023-10-18T17:24:03.750732+0000","last_became_peered":"2023-10-18T17:24:03.750732+0000","last_unstale":"2023-10-18T17:24:04.250604+0000","last_undegraded":"2023-10-18T17:24:04.250604+0000","last_fullsized":"2023-10-18T17:24:04.250604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250927+0000","last_change":"2023-10-18T17:24:04.247389+0000","last_active":"2023-10-18T17:24:04.250927+0000","last_peered":"2023-10-18T17:24:04.250927+0000","last_clean":"2023-10-18T17:24:04.250927+0000","last_became_active":"2023-10-18T17:24:04.247045+0000","last_became_peered":"2023-10-18T17:24:04.247045+0000","last_unstale":"2023-10-18T17:24:04.250927+0000","last_undegraded":"2023-10-18T17:24:04.250927+0000","last_fullsized":"2023-10-18T17:24:04.250927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.237438+0000","last_change":"2023-10-18T17:24:03.742205+0000","last_active":"2023-10-18T17:24:04.237438+0000","last_peered":"2023-10-18T17:24:04.237438+0000","last_clean":"2023-10-18T17:24:04.237438+0000","last_became_active":"2023-10-18T17:24:03.741881+0000","last_became_peered":"2023-10-18T17:24:03.741881+0000","last_unstale":"2023-10-18T17:24:04.237438+0000","last_undegraded":"2023-10-18T17:24:04.237438+0000","last_fullsized":"2023-10-18T17:24:04.237438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.256041+0000","last_change":"2023-10-18T17:24:04.251859+0000","last_active":"2023-10-18T17:24:04.256041+0000","last_peered":"2023-10-18T17:24:04.256041+0000","last_clean":"2023-10-18T17:24:04.256041+0000","last_became_active":"2023-10-18T17:24:04.251431+0000","last_became_peered":"2023-10-18T17:24:04.251431+0000","last_unstale":"2023-10-18T17:24:04.256041+0000","last_undegraded":"2023-10-18T17:24:04.256041+0000","last_fullsized":"2023-10-18T17:24:04.256041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.225479+0000","last_change":"2023-10-18T17:24:03.761606+0000","last_active":"2023-10-18T17:24:04.225479+0000","last_peered":"2023-10-18T17:24:04.225479+0000","last_clean":"2023-10-18T17:24:04.225479+0000","last_became_active":"2023-10-18T17:24:03.759066+0000","last_became_peered":"2023-10-18T17:24:03.759066+0000","last_unstale":"2023-10-18T17:24:04.225479+0000","last_undegraded":"2023-10-18T17:24:04.225479+0000","last_fullsized":"2023-10-18T17:24:04.225479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253478+0000","last_change":"2023-10-18T17:24:04.242517+0000","last_active":"2023-10-18T17:24:04.253478+0000","last_peered":"2023-10-18T17:24:04.253478+0000","last_clean":"2023-10-18T17:24:04.253478+0000","last_became_active":"2023-10-18T17:24:04.242198+0000","last_became_peered":"2023-10-18T17:24:04.242198+0000","last_unstale":"2023-10-18T17:24:04.253478+0000","last_undegraded":"2023-10-18T17:24:04.253478+0000","last_fullsized":"2023-10-18T17:24:04.253478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250063+0000","last_change":"2023-10-18T17:24:03.751375+0000","last_active":"2023-10-18T17:24:04.250063+0000","last_peered":"2023-10-18T17:24:04.250063+0000","last_clean":"2023-10-18T17:24:04.250063+0000","last_became_active":"2023-10-18T17:24:03.751112+0000","last_became_peered":"2023-10-18T17:24:03.751112+0000","last_unstale":"2023-10-18T17:24:04.250063+0000","last_undegraded":"2023-10-18T17:24:04.250063+0000","last_fullsized":"2023-10-18T17:24:04.250063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.262744+0000","last_change":"2023-10-18T17:24:04.253973+0000","last_active":"2023-10-18T17:24:04.262744+0000","last_peered":"2023-10-18T17:24:04.262744+0000","last_clean":"2023-10-18T17:24:04.262744+0000","last_became_active":"2023-10-18T17:24:04.253669+0000","last_became_peered":"2023-10-18T17:24:04.253669+0000","last_unstale":"2023-10-18T17:24:04.262744+0000","last_undegraded":"2023-10-18T17:24:04.262744+0000","last_fullsized":"2023-10-18T17:24:04.262744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.234227+0000","last_change":"2023-10-18T17:24:03.762548+0000","last_active":"2023-10-18T17:24:04.234227+0000","last_peered":"2023-10-18T17:24:04.234227+0000","last_clean":"2023-10-18T17:24:04.234227+0000","last_became_active":"2023-10-18T17:24:03.762215+0000","last_became_peered":"2023-10-18T17:24:03.762215+0000","last_unstale":"2023-10-18T17:24:04.234227+0000","last_undegraded":"2023-10-18T17:24:04.234227+0000","last_fullsized":"2023-10-18T17:24:04.234227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.255941+0000","last_change":"2023-10-18T17:24:04.244220+0000","last_active":"2023-10-18T17:24:04.255941+0000","last_peered":"2023-10-18T17:24:04.255941+0000","last_clean":"2023-10-18T17:24:04.255941+0000","last_became_active":"2023-10-18T17:24:04.243840+0000","last_became_peered":"2023-10-18T17:24:04.243840+0000","last_unstale":"2023-10-18T17:24:04.255941+0000","last_undegraded":"2023-10-18T17:24:04.255941+0000","last_fullsized":"2023-10-18T17:24:04.255941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.231035+0000","last_change":"2023-10-18T17:24:03.761832+0000","last_active":"2023-10-18T17:24:04.231035+0000","last_peered":"2023-10-18T17:24:04.231035+0000","last_clean":"2023-10-18T17:24:04.231035+0000","last_became_active":"2023-10-18T17:24:03.761474+0000","last_became_peered":"2023-10-18T17:24:03.761474+0000","last_unstale":"2023-10-18T17:24:04.231035+0000","last_undegraded":"2023-10-18T17:24:04.231035+0000","last_fullsized":"2023-10-18T17:24:04.231035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.248697+0000","last_change":"2023-10-18T17:24:04.242877+0000","last_active":"2023-10-18T17:24:04.248697+0000","last_peered":"2023-10-18T17:24:04.248697+0000","last_clean":"2023-10-18T17:24:04.248697+0000","last_became_active":"2023-10-18T17:24:04.242155+0000","last_became_peered":"2023-10-18T17:24:04.242155+0000","last_unstale":"2023-10-18T17:24:04.248697+0000","last_undegraded":"2023-10-18T17:24:04.248697+0000","last_fullsized":"2023-10-18T17:24:04.248697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.236784+0000","last_change":"2023-10-18T17:24:03.750350+0000","last_active":"2023-10-18T17:24:04.236784+0000","last_peered":"2023-10-18T17:24:04.236784+0000","last_clean":"2023-10-18T17:24:04.236784+0000","last_became_active":"2023-10-18T17:24:03.750080+0000","last_became_peered":"2023-10-18T17:24:03.750080+0000","last_unstale":"2023-10-18T17:24:04.236784+0000","last_undegraded":"2023-10-18T17:24:04.236784+0000","last_fullsized":"2023-10-18T17:24:04.236784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.257049+0000","last_change":"2023-10-18T17:24:04.246950+0000","last_active":"2023-10-18T17:24:04.257049+0000","last_peered":"2023-10-18T17:24:04.257049+0000","last_clean":"2023-10-18T17:24:04.257049+0000","last_became_active":"2023-10-18T17:24:04.246377+0000","last_became_peered":"2023-10-18T17:24:04.246377+0000","last_unstale":"2023-10-18T17:24:04.257049+0000","last_undegraded":"2023-10-18T17:24:04.257049+0000","last_fullsized":"2023-10-18T17:24:04.257049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.236736+0000","last_change":"2023-10-18T17:24:03.754668+0000","last_active":"2023-10-18T17:24:04.236736+0000","last_peered":"2023-10-18T17:24:04.236736+0000","last_clean":"2023-10-18T17:24:04.236736+0000","last_became_active":"2023-10-18T17:24:03.754167+0000","last_became_peered":"2023-10-18T17:24:03.754167+0000","last_unstale":"2023-10-18T17:24:04.236736+0000","last_undegraded":"2023-10-18T17:24:04.236736+0000","last_fullsized":"2023-10-18T17:24:04.236736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250784+0000","last_change":"2023-10-18T17:24:04.239937+0000","last_active":"2023-10-18T17:24:04.250784+0000","last_peered":"2023-10-18T17:24:04.250784+0000","last_clean":"2023-10-18T17:24:04.250784+0000","last_became_active":"2023-10-18T17:24:04.239632+0000","last_became_peered":"2023-10-18T17:24:04.239632+0000","last_unstale":"2023-10-18T17:24:04.250784+0000","last_undegraded":"2023-10-18T17:24:04.250784+0000","last_fullsized":"2023-10-18T17:24:04.250784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.235445+0000","last_change":"2023-10-18T17:24:03.752082+0000","last_active":"2023-10-18T17:24:04.235445+0000","last_peered":"2023-10-18T17:24:04.235445+0000","last_clean":"2023-10-18T17:24:04.235445+0000","last_became_active":"2023-10-18T17:24:03.751789+0000","last_became_peered":"2023-10-18T17:24:03.751789+0000","last_unstale":"2023-10-18T17:24:04.235445+0000","last_undegraded":"2023-10-18T17:24:04.235445+0000","last_fullsized":"2023-10-18T17:24:04.235445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258595+0000","last_change":"2023-10-18T17:24:04.249928+0000","last_active":"2023-10-18T17:24:04.258595+0000","last_peered":"2023-10-18T17:24:04.258595+0000","last_clean":"2023-10-18T17:24:04.258595+0000","last_became_active":"2023-10-18T17:24:04.249624+0000","last_became_peered":"2023-10-18T17:24:04.249624+0000","last_unstale":"2023-10-18T17:24:04.258595+0000","last_undegraded":"2023-10-18T17:24:04.258595+0000","last_fullsized":"2023-10-18T17:24:04.258595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.248249+0000","last_change":"2023-10-18T17:24:03.750481+0000","last_active":"2023-10-18T17:24:04.248249+0000","last_peered":"2023-10-18T17:24:04.248249+0000","last_clean":"2023-10-18T17:24:04.248249+0000","last_became_active":"2023-10-18T17:24:03.748182+0000","last_became_peered":"2023-10-18T17:24:03.748182+0000","last_unstale":"2023-10-18T17:24:04.248249+0000","last_undegraded":"2023-10-18T17:24:04.248249+0000","last_fullsized":"2023-10-18T17:24:04.248249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.255364+0000","last_change":"2023-10-18T17:24:04.251380+0000","last_active":"2023-10-18T17:24:04.255364+0000","last_peered":"2023-10-18T17:24:04.255364+0000","last_clean":"2023-10-18T17:24:04.255364+0000","last_became_active":"2023-10-18T17:24:04.251078+0000","last_became_peered":"2023-10-18T17:24:04.251078+0000","last_unstale":"2023-10-18T17:24:04.255364+0000","last_undegraded":"2023-10-18T17:24:04.255364+0000","last_fullsized":"2023-10-18T17:24:04.255364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230353+0000","last_change":"2023-10-18T17:24:03.742352+0000","last_active":"2023-10-18T17:24:04.230353+0000","last_peered":"2023-10-18T17:24:04.230353+0000","last_clean":"2023-10-18T17:24:04.230353+0000","last_became_active":"2023-10-18T17:24:03.742052+0000","last_became_peered":"2023-10-18T17:24:03.742052+0000","last_unstale":"2023-10-18T17:24:04.230353+0000","last_undegraded":"2023-10-18T17:24:04.230353+0000","last_fullsized":"2023-10-18T17:24:04.230353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.259270+0000","last_change":"2023-10-18T17:24:04.254657+0000","last_active":"2023-10-18T17:24:04.259270+0000","last_peered":"2023-10-18T17:24:04.259270+0000","last_clean":"2023-10-18T17:24:04.259270+0000","last_became_active":"2023-10-18T17:24:04.254373+0000","last_became_peered":"2023-10-18T17:24:04.254373+0000","last_unstale":"2023-10-18T17:24:04.259270+0000","last_undegraded":"2023-10-18T17:24:04.259270+0000","last_fullsized":"2023-10-18T17:24:04.259270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.229358+0000","last_change":"2023-10-18T17:24:03.746763+0000","last_active":"2023-10-18T17:24:04.229358+0000","last_peered":"2023-10-18T17:24:04.229358+0000","last_clean":"2023-10-18T17:24:04.229358+0000","last_became_active":"2023-10-18T17:24:03.746461+0000","last_became_peered":"2023-10-18T17:24:03.746461+0000","last_unstale":"2023-10-18T17:24:04.229358+0000","last_undegraded":"2023-10-18T17:24:04.229358+0000","last_fullsized":"2023-10-18T17:24:04.229358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.263765+0000","last_change":"2023-10-18T17:24:04.258875+0000","last_active":"2023-10-18T17:24:04.263765+0000","last_peered":"2023-10-18T17:24:04.263765+0000","last_clean":"2023-10-18T17:24:04.263765+0000","last_became_active":"2023-10-18T17:24:04.258617+0000","last_became_peered":"2023-10-18T17:24:04.258617+0000","last_unstale":"2023-10-18T17:24:04.263765+0000","last_undegraded":"2023-10-18T17:24:04.263765+0000","last_fullsized":"2023-10-18T17:24:04.263765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.234335+0000","last_change":"2023-10-18T17:24:03.749937+0000","last_active":"2023-10-18T17:24:04.234335+0000","last_peered":"2023-10-18T17:24:04.234335+0000","last_clean":"2023-10-18T17:24:04.234335+0000","last_became_active":"2023-10-18T17:24:03.749625+0000","last_became_peered":"2023-10-18T17:24:03.749625+0000","last_unstale":"2023-10-18T17:24:04.234335+0000","last_undegraded":"2023-10-18T17:24:04.234335+0000","last_fullsized":"2023-10-18T17:24:04.234335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.244522+0000","last_change":"2023-10-18T17:24:04.237303+0000","last_active":"2023-10-18T17:24:04.244522+0000","last_peered":"2023-10-18T17:24:04.244522+0000","last_clean":"2023-10-18T17:24:04.244522+0000","last_became_active":"2023-10-18T17:24:04.237016+0000","last_became_peered":"2023-10-18T17:24:04.237016+0000","last_unstale":"2023-10-18T17:24:04.244522+0000","last_undegraded":"2023-10-18T17:24:04.244522+0000","last_fullsized":"2023-10-18T17:24:04.244522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.235302+0000","last_change":"2023-10-18T17:24:03.745317+0000","last_active":"2023-10-18T17:24:04.235302+0000","last_peered":"2023-10-18T17:24:04.235302+0000","last_clean":"2023-10-18T17:24:04.235302+0000","last_became_active":"2023-10-18T17:24:03.745016+0000","last_became_peered":"2023-10-18T17:24:03.745016+0000","last_unstale":"2023-10-18T17:24:04.235302+0000","last_undegraded":"2023-10-18T17:24:04.235302+0000","last_fullsized":"2023-10-18T17:24:04.235302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.264701+0000","last_change":"2023-10-18T17:24:04.262322+0000","last_active":"2023-10-18T17:24:04.264701+0000","last_peered":"2023-10-18T17:24:04.264701+0000","last_clean":"2023-10-18T17:24:04.264701+0000","last_became_active":"2023-10-18T17:24:04.262039+0000","last_became_peered":"2023-10-18T17:24:04.262039+0000","last_unstale":"2023-10-18T17:24:04.264701+0000","last_undegraded":"2023-10-18T17:24:04.264701+0000","last_fullsized":"2023-10-18T17:24:04.264701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.228078+0000","last_change":"2023-10-18T17:24:03.756377+0000","last_active":"2023-10-18T17:24:04.228078+0000","last_peered":"2023-10-18T17:24:04.228078+0000","last_clean":"2023-10-18T17:24:04.228078+0000","last_became_active":"2023-10-18T17:24:03.756048+0000","last_became_peered":"2023-10-18T17:24:03.756048+0000","last_unstale":"2023-10-18T17:24:04.228078+0000","last_undegraded":"2023-10-18T17:24:04.228078+0000","last_fullsized":"2023-10-18T17:24:04.228078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.256537+0000","last_change":"2023-10-18T17:24:04.248165+0000","last_active":"2023-10-18T17:24:04.256537+0000","last_peered":"2023-10-18T17:24:04.256537+0000","last_clean":"2023-10-18T17:24:04.256537+0000","last_became_active":"2023-10-18T17:24:04.247888+0000","last_became_peered":"2023-10-18T17:24:04.247888+0000","last_unstale":"2023-10-18T17:24:04.256537+0000","last_undegraded":"2023-10-18T17:24:04.256537+0000","last_fullsized":"2023-10-18T17:24:04.256537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.242223+0000","last_change":"2023-10-18T17:24:03.756703+0000","last_active":"2023-10-18T17:24:04.242223+0000","last_peered":"2023-10-18T17:24:04.242223+0000","last_clean":"2023-10-18T17:24:04.242223+0000","last_became_active":"2023-10-18T17:24:03.755543+0000","last_became_peered":"2023-10-18T17:24:03.755543+0000","last_unstale":"2023-10-18T17:24:04.242223+0000","last_undegraded":"2023-10-18T17:24:04.242223+0000","last_fullsized":"2023-10-18T17:24:04.242223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250758+0000","last_change":"2023-10-18T17:24:04.248435+0000","last_active":"2023-10-18T17:24:04.250758+0000","last_peered":"2023-10-18T17:24:04.250758+0000","last_clean":"2023-10-18T17:24:04.250758+0000","last_became_active":"2023-10-18T17:24:04.248150+0000","last_became_peered":"2023-10-18T17:24:04.248150+0000","last_unstale":"2023-10-18T17:24:04.250758+0000","last_undegraded":"2023-10-18T17:24:04.250758+0000","last_fullsized":"2023-10-18T17:24:04.250758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.235444+0000","last_change":"2023-10-18T17:24:03.751813+0000","last_active":"2023-10-18T17:24:04.235444+0000","last_peered":"2023-10-18T17:24:04.235444+0000","last_clean":"2023-10-18T17:24:04.235444+0000","last_became_active":"2023-10-18T17:24:03.751468+0000","last_became_peered":"2023-10-18T17:24:03.751468+0000","last_unstale":"2023-10-18T17:24:04.235444+0000","last_undegraded":"2023-10-18T17:24:04.235444+0000","last_fullsized":"2023-10-18T17:24:04.235444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.264737+0000","last_change":"2023-10-18T17:24:04.258693+0000","last_active":"2023-10-18T17:24:04.264737+0000","last_peered":"2023-10-18T17:24:04.264737+0000","last_clean":"2023-10-18T17:24:04.264737+0000","last_became_active":"2023-10-18T17:24:04.258420+0000","last_became_peered":"2023-10-18T17:24:04.258420+0000","last_unstale":"2023-10-18T17:24:04.264737+0000","last_undegraded":"2023-10-18T17:24:04.264737+0000","last_fullsized":"2023-10-18T17:24:04.264737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.231275+0000","last_change":"2023-10-18T17:24:03.741061+0000","last_active":"2023-10-18T17:24:04.231275+0000","last_peered":"2023-10-18T17:24:04.231275+0000","last_clean":"2023-10-18T17:24:04.231275+0000","last_became_active":"2023-10-18T17:24:03.740773+0000","last_became_peered":"2023-10-18T17:24:03.740773+0000","last_unstale":"2023-10-18T17:24:04.231275+0000","last_undegraded":"2023-10-18T17:24:04.231275+0000","last_fullsized":"2023-10-18T17:24:04.231275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.261550+0000","last_change":"2023-10-18T17:24:04.255651+0000","last_active":"2023-10-18T17:24:04.261550+0000","last_peered":"2023-10-18T17:24:04.261550+0000","last_clean":"2023-10-18T17:24:04.261550+0000","last_became_active":"2023-10-18T17:24:04.255377+0000","last_became_peered":"2023-10-18T17:24:04.255377+0000","last_unstale":"2023-10-18T17:24:04.261550+0000","last_undegraded":"2023-10-18T17:24:04.261550+0000","last_fullsized":"2023-10-18T17:24:04.261550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.238835+0000","last_change":"2023-10-18T17:24:03.762674+0000","last_active":"2023-10-18T17:24:04.238835+0000","last_peered":"2023-10-18T17:24:04.238835+0000","last_clean":"2023-10-18T17:24:04.238835+0000","last_became_active":"2023-10-18T17:24:03.762293+0000","last_became_peered":"2023-10-18T17:24:03.762293+0000","last_unstale":"2023-10-18T17:24:04.238835+0000","last_undegraded":"2023-10-18T17:24:04.238835+0000","last_fullsized":"2023-10-18T17:24:04.238835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.249093+0000","last_change":"2023-10-18T17:24:04.240811+0000","last_active":"2023-10-18T17:24:04.249093+0000","last_peered":"2023-10-18T17:24:04.249093+0000","last_clean":"2023-10-18T17:24:04.249093+0000","last_became_active":"2023-10-18T17:24:04.240514+0000","last_became_peered":"2023-10-18T17:24:04.240514+0000","last_unstale":"2023-10-18T17:24:04.249093+0000","last_undegraded":"2023-10-18T17:24:04.249093+0000","last_fullsized":"2023-10-18T17:24:04.249093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.241156+0000","last_change":"2023-10-18T17:24:03.744676+0000","last_active":"2023-10-18T17:24:04.241156+0000","last_peered":"2023-10-18T17:24:04.241156+0000","last_clean":"2023-10-18T17:24:04.241156+0000","last_became_active":"2023-10-18T17:24:03.744318+0000","last_became_peered":"2023-10-18T17:24:03.744318+0000","last_unstale":"2023-10-18T17:24:04.241156+0000","last_undegraded":"2023-10-18T17:24:04.241156+0000","last_fullsized":"2023-10-18T17:24:04.241156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253760+0000","last_change":"2023-10-18T17:24:04.242434+0000","last_active":"2023-10-18T17:24:04.253760+0000","last_peered":"2023-10-18T17:24:04.253760+0000","last_clean":"2023-10-18T17:24:04.253760+0000","last_became_active":"2023-10-18T17:24:04.242125+0000","last_became_peered":"2023-10-18T17:24:04.242125+0000","last_unstale":"2023-10-18T17:24:04.253760+0000","last_undegraded":"2023-10-18T17:24:04.253760+0000","last_fullsized":"2023-10-18T17:24:04.253760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.237328+0000","last_change":"2023-10-18T17:23:58.684395+0000","last_active":"2023-10-18T17:24:04.237328+0000","last_peered":"2023-10-18T17:24:04.237328+0000","last_clean":"2023-10-18T17:24:04.237328+0000","last_became_active":"2023-10-18T17:23:58.683958+0000","last_became_peered":"2023-10-18T17:23:58.683958+0000","last_unstale":"2023-10-18T17:24:04.237328+0000","last_undegraded":"2023-10-18T17:24:04.237328+0000","last_fullsized":"2023-10-18T17:24:04.237328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.231926+0000","last_change":"2023-10-18T17:24:03.753111+0000","last_active":"2023-10-18T17:24:04.231926+0000","last_peered":"2023-10-18T17:24:04.231926+0000","last_clean":"2023-10-18T17:24:04.231926+0000","last_became_active":"2023-10-18T17:24:03.752548+0000","last_became_peered":"2023-10-18T17:24:03.752548+0000","last_unstale":"2023-10-18T17:24:04.231926+0000","last_undegraded":"2023-10-18T17:24:04.231926+0000","last_fullsized":"2023-10-18T17:24:04.231926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253728+0000","last_change":"2023-10-18T17:24:04.244386+0000","last_active":"2023-10-18T17:24:04.253728+0000","last_peered":"2023-10-18T17:24:04.253728+0000","last_clean":"2023-10-18T17:24:04.253728+0000","last_became_active":"2023-10-18T17:24:04.244041+0000","last_became_peered":"2023-10-18T17:24:04.244041+0000","last_unstale":"2023-10-18T17:24:04.253728+0000","last_undegraded":"2023-10-18T17:24:04.253728+0000","last_fullsized":"2023-10-18T17:24:04.253728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.228377+0000","last_change":"2023-10-18T17:23:58.682697+0000","last_active":"2023-10-18T17:24:04.228377+0000","last_peered":"2023-10-18T17:24:04.228377+0000","last_clean":"2023-10-18T17:24:04.228377+0000","last_became_active":"2023-10-18T17:23:58.682294+0000","last_became_peered":"2023-10-18T17:23:58.682294+0000","last_unstale":"2023-10-18T17:24:04.228377+0000","last_undegraded":"2023-10-18T17:24:04.228377+0000","last_fullsized":"2023-10-18T17:24:04.228377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250659+0000","last_change":"2023-10-18T17:24:03.749017+0000","last_active":"2023-10-18T17:24:04.250659+0000","last_peered":"2023-10-18T17:24:04.250659+0000","last_clean":"2023-10-18T17:24:04.250659+0000","last_became_active":"2023-10-18T17:24:03.748740+0000","last_became_peered":"2023-10-18T17:24:03.748740+0000","last_unstale":"2023-10-18T17:24:04.250659+0000","last_undegraded":"2023-10-18T17:24:04.250659+0000","last_fullsized":"2023-10-18T17:24:04.250659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.262438+0000","last_change":"2023-10-18T17:24:04.257504+0000","last_active":"2023-10-18T17:24:04.262438+0000","last_peered":"2023-10-18T17:24:04.262438+0000","last_clean":"2023-10-18T17:24:04.262438+0000","last_became_active":"2023-10-18T17:24:04.255752+0000","last_became_peered":"2023-10-18T17:24:04.255752+0000","last_unstale":"2023-10-18T17:24:04.262438+0000","last_undegraded":"2023-10-18T17:24:04.262438+0000","last_fullsized":"2023-10-18T17:24:04.262438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.239151+0000","last_change":"2023-10-18T17:23:58.853499+0000","last_active":"2023-10-18T17:24:04.239151+0000","last_peered":"2023-10-18T17:24:04.239151+0000","last_clean":"2023-10-18T17:24:04.239151+0000","last_became_active":"2023-10-18T17:23:58.852960+0000","last_became_peered":"2023-10-18T17:23:58.852960+0000","last_unstale":"2023-10-18T17:24:04.239151+0000","last_undegraded":"2023-10-18T17:24:04.239151+0000","last_fullsized":"2023-10-18T17:24:04.239151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.227303+0000","last_change":"2023-10-18T17:24:03.739032+0000","last_active":"2023-10-18T17:24:04.227303+0000","last_peered":"2023-10-18T17:24:04.227303+0000","last_clean":"2023-10-18T17:24:04.227303+0000","last_became_active":"2023-10-18T17:24:03.738439+0000","last_became_peered":"2023-10-18T17:24:03.738439+0000","last_unstale":"2023-10-18T17:24:04.227303+0000","last_undegraded":"2023-10-18T17:24:04.227303+0000","last_fullsized":"2023-10-18T17:24:04.227303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.246665+0000","last_change":"2023-10-18T17:24:04.245021+0000","last_active":"2023-10-18T17:24:04.246665+0000","last_peered":"2023-10-18T17:24:04.246665+0000","last_clean":"2023-10-18T17:24:04.246665+0000","last_became_active":"2023-10-18T17:24:04.244567+0000","last_became_peered":"2023-10-18T17:24:04.244567+0000","last_unstale":"2023-10-18T17:24:04.246665+0000","last_undegraded":"2023-10-18T17:24:04.246665+0000","last_fullsized":"2023-10-18T17:24:04.246665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.227863+0000","last_change":"2023-10-18T17:23:58.851971+0000","last_active":"2023-10-18T17:24:04.227863+0000","last_peered":"2023-10-18T17:24:04.227863+0000","last_clean":"2023-10-18T17:24:04.227863+0000","last_became_active":"2023-10-18T17:23:58.851505+0000","last_became_peered":"2023-10-18T17:23:58.851505+0000","last_unstale":"2023-10-18T17:24:04.227863+0000","last_undegraded":"2023-10-18T17:24:04.227863+0000","last_fullsized":"2023-10-18T17:24:04.227863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230449+0000","last_change":"2023-10-18T17:24:03.761669+0000","last_active":"2023-10-18T17:24:04.230449+0000","last_peered":"2023-10-18T17:24:04.230449+0000","last_clean":"2023-10-18T17:24:04.230449+0000","last_became_active":"2023-10-18T17:24:03.761358+0000","last_became_peered":"2023-10-18T17:24:03.761358+0000","last_unstale":"2023-10-18T17:24:04.230449+0000","last_undegraded":"2023-10-18T17:24:04.230449+0000","last_fullsized":"2023-10-18T17:24:04.230449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.255925+0000","last_change":"2023-10-18T17:24:04.243705+0000","last_active":"2023-10-18T17:24:04.255925+0000","last_peered":"2023-10-18T17:24:04.255925+0000","last_clean":"2023-10-18T17:24:04.255925+0000","last_became_active":"2023-10-18T17:24:04.243438+0000","last_became_peered":"2023-10-18T17:24:04.243438+0000","last_unstale":"2023-10-18T17:24:04.255925+0000","last_undegraded":"2023-10-18T17:24:04.255925+0000","last_fullsized":"2023-10-18T17:24:04.255925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.234833+0000","last_change":"2023-10-18T17:24:03.754253+0000","last_active":"2023-10-18T17:24:04.234833+0000","last_peered":"2023-10-18T17:24:04.234833+0000","last_clean":"2023-10-18T17:24:04.234833+0000","last_became_active":"2023-10-18T17:24:03.753384+0000","last_became_peered":"2023-10-18T17:24:03.753384+0000","last_unstale":"2023-10-18T17:24:04.234833+0000","last_undegraded":"2023-10-18T17:24:04.234833+0000","last_fullsized":"2023-10-18T17:24:04.234833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.232464+0000","last_change":"2023-10-18T17:23:58.682309+0000","last_active":"2023-10-18T17:24:04.232464+0000","last_peered":"2023-10-18T17:24:04.232464+0000","last_clean":"2023-10-18T17:24:04.232464+0000","last_became_active":"2023-10-18T17:23:58.681978+0000","last_became_peered":"2023-10-18T17:23:58.681978+0000","last_unstale":"2023-10-18T17:24:04.232464+0000","last_undegraded":"2023-10-18T17:24:04.232464+0000","last_fullsized":"2023-10-18T17:24:04.232464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.255921+0000","last_change":"2023-10-18T17:24:04.244101+0000","last_active":"2023-10-18T17:24:04.255921+0000","last_peered":"2023-10-18T17:24:04.255921+0000","last_clean":"2023-10-18T17:24:04.255921+0000","last_became_active":"2023-10-18T17:24:04.243455+0000","last_became_peered":"2023-10-18T17:24:04.243455+0000","last_unstale":"2023-10-18T17:24:04.255921+0000","last_undegraded":"2023-10-18T17:24:04.255921+0000","last_fullsized":"2023-10-18T17:24:04.255921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.224950+0000","last_change":"2023-10-18T17:24:03.743003+0000","last_active":"2023-10-18T17:24:04.224950+0000","last_peered":"2023-10-18T17:24:04.224950+0000","last_clean":"2023-10-18T17:24:04.224950+0000","last_became_active":"2023-10-18T17:24:03.742629+0000","last_became_peered":"2023-10-18T17:24:03.742629+0000","last_unstale":"2023-10-18T17:24:04.224950+0000","last_undegraded":"2023-10-18T17:24:04.224950+0000","last_fullsized":"2023-10-18T17:24:04.224950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.236706+0000","last_change":"2023-10-18T17:23:58.678572+0000","last_active":"2023-10-18T17:24:04.236706+0000","last_peered":"2023-10-18T17:24:04.236706+0000","last_clean":"2023-10-18T17:24:04.236706+0000","last_became_active":"2023-10-18T17:23:58.677813+0000","last_became_peered":"2023-10-18T17:23:58.677813+0000","last_unstale":"2023-10-18T17:24:04.236706+0000","last_undegraded":"2023-10-18T17:24:04.236706+0000","last_fullsized":"2023-10-18T17:24:04.236706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250762+0000","last_change":"2023-10-18T17:24:04.239298+0000","last_active":"2023-10-18T17:24:04.250762+0000","last_peered":"2023-10-18T17:24:04.250762+0000","last_clean":"2023-10-18T17:24:04.250762+0000","last_became_active":"2023-10-18T17:24:04.239025+0000","last_became_peered":"2023-10-18T17:24:04.239025+0000","last_unstale":"2023-10-18T17:24:04.250762+0000","last_undegraded":"2023-10-18T17:24:04.250762+0000","last_fullsized":"2023-10-18T17:24:04.250762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230729+0000","last_change":"2023-10-18T17:24:03.750194+0000","last_active":"2023-10-18T17:24:04.230729+0000","last_peered":"2023-10-18T17:24:04.230729+0000","last_clean":"2023-10-18T17:24:04.230729+0000","last_became_active":"2023-10-18T17:24:03.749909+0000","last_became_peered":"2023-10-18T17:24:03.749909+0000","last_unstale":"2023-10-18T17:24:04.230729+0000","last_undegraded":"2023-10-18T17:24:04.230729+0000","last_fullsized":"2023-10-18T17:24:04.230729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.235102+0000","last_change":"2023-10-18T17:23:58.679941+0000","last_active":"2023-10-18T17:24:04.235102+0000","last_peered":"2023-10-18T17:24:04.235102+0000","last_clean":"2023-10-18T17:24:04.235102+0000","last_became_active":"2023-10-18T17:23:58.679210+0000","last_became_peered":"2023-10-18T17:23:58.679210+0000","last_unstale":"2023-10-18T17:24:04.235102+0000","last_undegraded":"2023-10-18T17:24:04.235102+0000","last_fullsized":"2023-10-18T17:24:04.235102+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.256726+0000","last_change":"2023-10-18T17:24:04.252056+0000","last_active":"2023-10-18T17:24:04.256726+0000","last_peered":"2023-10-18T17:24:04.256726+0000","last_clean":"2023-10-18T17:24:04.256726+0000","last_became_active":"2023-10-18T17:24:04.251812+0000","last_became_peered":"2023-10-18T17:24:04.251812+0000","last_unstale":"2023-10-18T17:24:04.256726+0000","last_undegraded":"2023-10-18T17:24:04.256726+0000","last_fullsized":"2023-10-18T17:24:04.256726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.247816+0000","last_change":"2023-10-18T17:24:03.750606+0000","last_active":"2023-10-18T17:24:04.247816+0000","last_peered":"2023-10-18T17:24:04.247816+0000","last_clean":"2023-10-18T17:24:04.247816+0000","last_became_active":"2023-10-18T17:24:03.750308+0000","last_became_peered":"2023-10-18T17:24:03.750308+0000","last_unstale":"2023-10-18T17:24:04.247816+0000","last_undegraded":"2023-10-18T17:24:04.247816+0000","last_fullsized":"2023-10-18T17:24:04.247816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.229157+0000","last_change":"2023-10-18T17:23:58.683196+0000","last_active":"2023-10-18T17:24:04.229157+0000","last_peered":"2023-10-18T17:24:04.229157+0000","last_clean":"2023-10-18T17:24:04.229157+0000","last_became_active":"2023-10-18T17:23:58.682724+0000","last_became_peered":"2023-10-18T17:23:58.682724+0000","last_unstale":"2023-10-18T17:24:04.229157+0000","last_undegraded":"2023-10-18T17:24:04.229157+0000","last_fullsized":"2023-10-18T17:24:04.229157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.235276+0000","last_change":"2023-10-18T17:23:56.753692+0000","last_active":"2023-10-18T17:24:04.235276+0000","last_peered":"2023-10-18T17:24:04.235276+0000","last_clean":"2023-10-18T17:24:04.235276+0000","last_became_active":"2023-10-18T17:23:56.752884+0000","last_became_peered":"2023-10-18T17:23:56.752884+0000","last_unstale":"2023-10-18T17:24:04.235276+0000","last_undegraded":"2023-10-18T17:24:04.235276+0000","last_fullsized":"2023-10-18T17:24:04.235276+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:55.617219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:55.617219+0000","last_clean_scrub_stamp":"2023-10-18T17:23:55.617219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.255995+0000","last_change":"2023-10-18T17:24:04.251396+0000","last_active":"2023-10-18T17:24:04.255995+0000","last_peered":"2023-10-18T17:24:04.255995+0000","last_clean":"2023-10-18T17:24:04.255995+0000","last_became_active":"2023-10-18T17:24:04.251099+0000","last_became_peered":"2023-10-18T17:24:04.251099+0000","last_unstale":"2023-10-18T17:24:04.255995+0000","last_undegraded":"2023-10-18T17:24:04.255995+0000","last_fullsized":"2023-10-18T17:24:04.255995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.242315+0000","last_change":"2023-10-18T17:24:03.749558+0000","last_active":"2023-10-18T17:24:04.242315+0000","last_peered":"2023-10-18T17:24:04.242315+0000","last_clean":"2023-10-18T17:24:04.242315+0000","last_became_active":"2023-10-18T17:24:03.749236+0000","last_became_peered":"2023-10-18T17:24:03.749236+0000","last_unstale":"2023-10-18T17:24:04.242315+0000","last_undegraded":"2023-10-18T17:24:04.242315+0000","last_fullsized":"2023-10-18T17:24:04.242315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.264438+0000","last_change":"2023-10-18T17:24:04.260098+0000","last_active":"2023-10-18T17:24:04.264438+0000","last_peered":"2023-10-18T17:24:04.264438+0000","last_clean":"2023-10-18T17:24:04.264438+0000","last_became_active":"2023-10-18T17:24:04.259824+0000","last_became_peered":"2023-10-18T17:24:04.259824+0000","last_unstale":"2023-10-18T17:24:04.264438+0000","last_undegraded":"2023-10-18T17:24:04.264438+0000","last_fullsized":"2023-10-18T17:24:04.264438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.236722+0000","last_change":"2023-10-18T17:24:03.744238+0000","last_active":"2023-10-18T17:24:04.236722+0000","last_peered":"2023-10-18T17:24:04.236722+0000","last_clean":"2023-10-18T17:24:04.236722+0000","last_became_active":"2023-10-18T17:24:03.743842+0000","last_became_peered":"2023-10-18T17:24:03.743842+0000","last_unstale":"2023-10-18T17:24:04.236722+0000","last_undegraded":"2023-10-18T17:24:04.236722+0000","last_fullsized":"2023-10-18T17:24:04.236722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253546+0000","last_change":"2023-10-18T17:24:04.243386+0000","last_active":"2023-10-18T17:24:04.253546+0000","last_peered":"2023-10-18T17:24:04.253546+0000","last_clean":"2023-10-18T17:24:04.253546+0000","last_became_active":"2023-10-18T17:24:04.242822+0000","last_became_peered":"2023-10-18T17:24:04.242822+0000","last_unstale":"2023-10-18T17:24:04.253546+0000","last_undegraded":"2023-10-18T17:24:04.253546+0000","last_fullsized":"2023-10-18T17:24:04.253546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.237212+0000","last_change":"2023-10-18T17:24:03.749376+0000","last_active":"2023-10-18T17:24:04.237212+0000","last_peered":"2023-10-18T17:24:04.237212+0000","last_clean":"2023-10-18T17:24:04.237212+0000","last_became_active":"2023-10-18T17:24:03.749063+0000","last_became_peered":"2023-10-18T17:24:03.749063+0000","last_unstale":"2023-10-18T17:24:04.237212+0000","last_undegraded":"2023-10-18T17:24:04.237212+0000","last_fullsized":"2023-10-18T17:24:04.237212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258719+0000","last_change":"2023-10-18T17:24:04.248670+0000","last_active":"2023-10-18T17:24:04.258719+0000","last_peered":"2023-10-18T17:24:04.258719+0000","last_clean":"2023-10-18T17:24:04.258719+0000","last_became_active":"2023-10-18T17:24:04.248116+0000","last_became_peered":"2023-10-18T17:24:04.248116+0000","last_unstale":"2023-10-18T17:24:04.258719+0000","last_undegraded":"2023-10-18T17:24:04.258719+0000","last_fullsized":"2023-10-18T17:24:04.258719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.249782+0000","last_change":"2023-10-18T17:24:03.756276+0000","last_active":"2023-10-18T17:24:04.249782+0000","last_peered":"2023-10-18T17:24:04.249782+0000","last_clean":"2023-10-18T17:24:04.249782+0000","last_became_active":"2023-10-18T17:24:03.755989+0000","last_became_peered":"2023-10-18T17:24:03.755989+0000","last_unstale":"2023-10-18T17:24:04.249782+0000","last_undegraded":"2023-10-18T17:24:04.249782+0000","last_fullsized":"2023-10-18T17:24:04.249782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.263775+0000","last_change":"2023-10-18T17:24:04.259017+0000","last_active":"2023-10-18T17:24:04.263775+0000","last_peered":"2023-10-18T17:24:04.263775+0000","last_clean":"2023-10-18T17:24:04.263775+0000","last_became_active":"2023-10-18T17:24:04.258654+0000","last_became_peered":"2023-10-18T17:24:04.258654+0000","last_unstale":"2023-10-18T17:24:04.263775+0000","last_undegraded":"2023-10-18T17:24:04.263775+0000","last_fullsized":"2023-10-18T17:24:04.263775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.229598+0000","last_change":"2023-10-18T17:24:03.761885+0000","last_active":"2023-10-18T17:24:04.229598+0000","last_peered":"2023-10-18T17:24:04.229598+0000","last_clean":"2023-10-18T17:24:04.229598+0000","last_became_active":"2023-10-18T17:24:03.761516+0000","last_became_peered":"2023-10-18T17:24:03.761516+0000","last_unstale":"2023-10-18T17:24:04.229598+0000","last_undegraded":"2023-10-18T17:24:04.229598+0000","last_fullsized":"2023-10-18T17:24:04.229598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.246649+0000","last_change":"2023-10-18T17:24:04.244813+0000","last_active":"2023-10-18T17:24:04.246649+0000","last_peered":"2023-10-18T17:24:04.246649+0000","last_clean":"2023-10-18T17:24:04.246649+0000","last_became_active":"2023-10-18T17:24:04.244199+0000","last_became_peered":"2023-10-18T17:24:04.244199+0000","last_unstale":"2023-10-18T17:24:04.246649+0000","last_undegraded":"2023-10-18T17:24:04.246649+0000","last_fullsized":"2023-10-18T17:24:04.246649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.238947+0000","last_change":"2023-10-18T17:24:03.751418+0000","last_active":"2023-10-18T17:24:04.238947+0000","last_peered":"2023-10-18T17:24:04.238947+0000","last_clean":"2023-10-18T17:24:04.238947+0000","last_became_active":"2023-10-18T17:24:03.751122+0000","last_became_peered":"2023-10-18T17:24:03.751122+0000","last_unstale":"2023-10-18T17:24:04.238947+0000","last_undegraded":"2023-10-18T17:24:04.238947+0000","last_fullsized":"2023-10-18T17:24:04.238947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.251731+0000","last_change":"2023-10-18T17:24:04.250253+0000","last_active":"2023-10-18T17:24:04.251731+0000","last_peered":"2023-10-18T17:24:04.251731+0000","last_clean":"2023-10-18T17:24:04.251731+0000","last_became_active":"2023-10-18T17:24:04.249929+0000","last_became_peered":"2023-10-18T17:24:04.249929+0000","last_unstale":"2023-10-18T17:24:04.251731+0000","last_undegraded":"2023-10-18T17:24:04.251731+0000","last_fullsized":"2023-10-18T17:24:04.251731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.241025+0000","last_change":"2023-10-18T17:24:03.747106+0000","last_active":"2023-10-18T17:24:04.241025+0000","last_peered":"2023-10-18T17:24:04.241025+0000","last_clean":"2023-10-18T17:24:04.241025+0000","last_became_active":"2023-10-18T17:24:03.746799+0000","last_became_peered":"2023-10-18T17:24:03.746799+0000","last_unstale":"2023-10-18T17:24:04.241025+0000","last_undegraded":"2023-10-18T17:24:04.241025+0000","last_fullsized":"2023-10-18T17:24:04.241025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253710+0000","last_change":"2023-10-18T17:24:04.243248+0000","last_active":"2023-10-18T17:24:04.253710+0000","last_peered":"2023-10-18T17:24:04.253710+0000","last_clean":"2023-10-18T17:24:04.253710+0000","last_became_active":"2023-10-18T17:24:04.242922+0000","last_became_peered":"2023-10-18T17:24:04.242922+0000","last_unstale":"2023-10-18T17:24:04.253710+0000","last_undegraded":"2023-10-18T17:24:04.253710+0000","last_fullsized":"2023-10-18T17:24:04.253710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.241757+0000","last_change":"2023-10-18T17:24:03.749039+0000","last_active":"2023-10-18T17:24:04.241757+0000","last_peered":"2023-10-18T17:24:04.241757+0000","last_clean":"2023-10-18T17:24:04.241757+0000","last_became_active":"2023-10-18T17:24:03.748569+0000","last_became_peered":"2023-10-18T17:24:03.748569+0000","last_unstale":"2023-10-18T17:24:04.241757+0000","last_undegraded":"2023-10-18T17:24:04.241757+0000","last_fullsized":"2023-10-18T17:24:04.241757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.247669+0000","last_change":"2023-10-18T17:24:04.241433+0000","last_active":"2023-10-18T17:24:04.247669+0000","last_peered":"2023-10-18T17:24:04.247669+0000","last_clean":"2023-10-18T17:24:04.247669+0000","last_became_active":"2023-10-18T17:24:04.241106+0000","last_became_peered":"2023-10-18T17:24:04.241106+0000","last_unstale":"2023-10-18T17:24:04.247669+0000","last_undegraded":"2023-10-18T17:24:04.247669+0000","last_fullsized":"2023-10-18T17:24:04.247669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.236834+0000","last_change":"2023-10-18T17:24:03.754340+0000","last_active":"2023-10-18T17:24:04.236834+0000","last_peered":"2023-10-18T17:24:04.236834+0000","last_clean":"2023-10-18T17:24:04.236834+0000","last_became_active":"2023-10-18T17:24:03.753704+0000","last_became_peered":"2023-10-18T17:24:03.753704+0000","last_unstale":"2023-10-18T17:24:04.236834+0000","last_undegraded":"2023-10-18T17:24:04.236834+0000","last_fullsized":"2023-10-18T17:24:04.236834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.257849+0000","last_change":"2023-10-18T17:24:04.253968+0000","last_active":"2023-10-18T17:24:04.257849+0000","last_peered":"2023-10-18T17:24:04.257849+0000","last_clean":"2023-10-18T17:24:04.257849+0000","last_became_active":"2023-10-18T17:24:04.253657+0000","last_became_peered":"2023-10-18T17:24:04.253657+0000","last_unstale":"2023-10-18T17:24:04.257849+0000","last_undegraded":"2023-10-18T17:24:04.257849+0000","last_fullsized":"2023-10-18T17:24:04.257849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.235231+0000","last_change":"2023-10-18T17:24:03.747407+0000","last_active":"2023-10-18T17:24:04.235231+0000","last_peered":"2023-10-18T17:24:04.235231+0000","last_clean":"2023-10-18T17:24:04.235231+0000","last_became_active":"2023-10-18T17:24:03.746910+0000","last_became_peered":"2023-10-18T17:24:03.746910+0000","last_unstale":"2023-10-18T17:24:04.235231+0000","last_undegraded":"2023-10-18T17:24:04.235231+0000","last_fullsized":"2023-10-18T17:24:04.235231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.256873+0000","last_change":"2023-10-18T17:24:04.253275+0000","last_active":"2023-10-18T17:24:04.256873+0000","last_peered":"2023-10-18T17:24:04.256873+0000","last_clean":"2023-10-18T17:24:04.256873+0000","last_became_active":"2023-10-18T17:24:04.252982+0000","last_became_peered":"2023-10-18T17:24:04.252982+0000","last_unstale":"2023-10-18T17:24:04.256873+0000","last_undegraded":"2023-10-18T17:24:04.256873+0000","last_fullsized":"2023-10-18T17:24:04.256873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230811+0000","last_change":"2023-10-18T17:24:03.741950+0000","last_active":"2023-10-18T17:24:04.230811+0000","last_peered":"2023-10-18T17:24:04.230811+0000","last_clean":"2023-10-18T17:24:04.230811+0000","last_became_active":"2023-10-18T17:24:03.740801+0000","last_became_peered":"2023-10-18T17:24:03.740801+0000","last_unstale":"2023-10-18T17:24:04.230811+0000","last_undegraded":"2023-10-18T17:24:04.230811+0000","last_fullsized":"2023-10-18T17:24:04.230811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.248716+0000","last_change":"2023-10-18T17:24:04.243107+0000","last_active":"2023-10-18T17:24:04.248716+0000","last_peered":"2023-10-18T17:24:04.248716+0000","last_clean":"2023-10-18T17:24:04.248716+0000","last_became_active":"2023-10-18T17:24:04.242584+0000","last_became_peered":"2023-10-18T17:24:04.242584+0000","last_unstale":"2023-10-18T17:24:04.248716+0000","last_undegraded":"2023-10-18T17:24:04.248716+0000","last_fullsized":"2023-10-18T17:24:04.248716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.237203+0000","last_change":"2023-10-18T17:24:03.747950+0000","last_active":"2023-10-18T17:24:04.237203+0000","last_peered":"2023-10-18T17:24:04.237203+0000","last_clean":"2023-10-18T17:24:04.237203+0000","last_became_active":"2023-10-18T17:24:03.747647+0000","last_became_peered":"2023-10-18T17:24:03.747647+0000","last_unstale":"2023-10-18T17:24:04.237203+0000","last_undegraded":"2023-10-18T17:24:04.237203+0000","last_fullsized":"2023-10-18T17:24:04.237203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.263014+0000","last_change":"2023-10-18T17:24:04.258930+0000","last_active":"2023-10-18T17:24:04.263014+0000","last_peered":"2023-10-18T17:24:04.263014+0000","last_clean":"2023-10-18T17:24:04.263014+0000","last_became_active":"2023-10-18T17:24:04.258630+0000","last_became_peered":"2023-10-18T17:24:04.258630+0000","last_unstale":"2023-10-18T17:24:04.263014+0000","last_undegraded":"2023-10-18T17:24:04.263014+0000","last_fullsized":"2023-10-18T17:24:04.263014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230691+0000","last_change":"2023-10-18T17:24:03.755043+0000","last_active":"2023-10-18T17:24:04.230691+0000","last_peered":"2023-10-18T17:24:04.230691+0000","last_clean":"2023-10-18T17:24:04.230691+0000","last_became_active":"2023-10-18T17:24:03.754677+0000","last_became_peered":"2023-10-18T17:24:03.754677+0000","last_unstale":"2023-10-18T17:24:04.230691+0000","last_undegraded":"2023-10-18T17:24:04.230691+0000","last_fullsized":"2023-10-18T17:24:04.230691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258695+0000","last_change":"2023-10-18T17:24:04.249183+0000","last_active":"2023-10-18T17:24:04.258695+0000","last_peered":"2023-10-18T17:24:04.258695+0000","last_clean":"2023-10-18T17:24:04.258695+0000","last_became_active":"2023-10-18T17:24:04.248236+0000","last_became_peered":"2023-10-18T17:24:04.248236+0000","last_unstale":"2023-10-18T17:24:04.258695+0000","last_undegraded":"2023-10-18T17:24:04.258695+0000","last_fullsized":"2023-10-18T17:24:04.258695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250217+0000","last_change":"2023-10-18T17:24:03.761178+0000","last_active":"2023-10-18T17:24:04.250217+0000","last_peered":"2023-10-18T17:24:04.250217+0000","last_clean":"2023-10-18T17:24:04.250217+0000","last_became_active":"2023-10-18T17:24:03.760202+0000","last_became_peered":"2023-10-18T17:24:03.760202+0000","last_unstale":"2023-10-18T17:24:04.250217+0000","last_undegraded":"2023-10-18T17:24:04.250217+0000","last_fullsized":"2023-10-18T17:24:04.250217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.252873+0000","last_change":"2023-10-18T17:24:04.248750+0000","last_active":"2023-10-18T17:24:04.252873+0000","last_peered":"2023-10-18T17:24:04.252873+0000","last_clean":"2023-10-18T17:24:04.252873+0000","last_became_active":"2023-10-18T17:24:04.248498+0000","last_became_peered":"2023-10-18T17:24:04.248498+0000","last_unstale":"2023-10-18T17:24:04.252873+0000","last_undegraded":"2023-10-18T17:24:04.252873+0000","last_fullsized":"2023-10-18T17:24:04.252873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.241109+0000","last_change":"2023-10-18T17:24:03.748064+0000","last_active":"2023-10-18T17:24:04.241109+0000","last_peered":"2023-10-18T17:24:04.241109+0000","last_clean":"2023-10-18T17:24:04.241109+0000","last_became_active":"2023-10-18T17:24:03.747784+0000","last_became_peered":"2023-10-18T17:24:03.747784+0000","last_unstale":"2023-10-18T17:24:04.241109+0000","last_undegraded":"2023-10-18T17:24:04.241109+0000","last_fullsized":"2023-10-18T17:24:04.241109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.260398+0000","last_change":"2023-10-18T17:24:04.257096+0000","last_active":"2023-10-18T17:24:04.260398+0000","last_peered":"2023-10-18T17:24:04.260398+0000","last_clean":"2023-10-18T17:24:04.260398+0000","last_became_active":"2023-10-18T17:24:04.256815+0000","last_became_peered":"2023-10-18T17:24:04.256815+0000","last_unstale":"2023-10-18T17:24:04.260398+0000","last_undegraded":"2023-10-18T17:24:04.260398+0000","last_fullsized":"2023-10-18T17:24:04.260398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.237620+0000","last_change":"2023-10-18T17:24:03.751468+0000","last_active":"2023-10-18T17:24:04.237620+0000","last_peered":"2023-10-18T17:24:04.237620+0000","last_clean":"2023-10-18T17:24:04.237620+0000","last_became_active":"2023-10-18T17:24:03.751166+0000","last_became_peered":"2023-10-18T17:24:03.751166+0000","last_unstale":"2023-10-18T17:24:04.237620+0000","last_undegraded":"2023-10-18T17:24:04.237620+0000","last_fullsized":"2023-10-18T17:24:04.237620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.247821+0000","last_change":"2023-10-18T17:24:04.242079+0000","last_active":"2023-10-18T17:24:04.247821+0000","last_peered":"2023-10-18T17:24:04.247821+0000","last_clean":"2023-10-18T17:24:04.247821+0000","last_became_active":"2023-10-18T17:24:04.241342+0000","last_became_peered":"2023-10-18T17:24:04.241342+0000","last_unstale":"2023-10-18T17:24:04.247821+0000","last_undegraded":"2023-10-18T17:24:04.247821+0000","last_fullsized":"2023-10-18T17:24:04.247821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.237418+0000","last_change":"2023-10-18T17:24:03.751419+0000","last_active":"2023-10-18T17:24:04.237418+0000","last_peered":"2023-10-18T17:24:04.237418+0000","last_clean":"2023-10-18T17:24:04.237418+0000","last_became_active":"2023-10-18T17:24:03.751118+0000","last_became_peered":"2023-10-18T17:24:03.751118+0000","last_unstale":"2023-10-18T17:24:04.237418+0000","last_undegraded":"2023-10-18T17:24:04.237418+0000","last_fullsized":"2023-10-18T17:24:04.237418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.256009+0000","last_change":"2023-10-18T17:24:04.250969+0000","last_active":"2023-10-18T17:24:04.256009+0000","last_peered":"2023-10-18T17:24:04.256009+0000","last_clean":"2023-10-18T17:24:04.256009+0000","last_became_active":"2023-10-18T17:24:04.250659+0000","last_became_peered":"2023-10-18T17:24:04.250659+0000","last_unstale":"2023-10-18T17:24:04.256009+0000","last_undegraded":"2023-10-18T17:24:04.256009+0000","last_fullsized":"2023-10-18T17:24:04.256009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.241459+0000","last_change":"2023-10-18T17:24:03.752559+0000","last_active":"2023-10-18T17:24:04.241459+0000","last_peered":"2023-10-18T17:24:04.241459+0000","last_clean":"2023-10-18T17:24:04.241459+0000","last_became_active":"2023-10-18T17:24:03.752277+0000","last_became_peered":"2023-10-18T17:24:03.752277+0000","last_unstale":"2023-10-18T17:24:04.241459+0000","last_undegraded":"2023-10-18T17:24:04.241459+0000","last_fullsized":"2023-10-18T17:24:04.241459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253690+0000","last_change":"2023-10-18T17:24:04.248464+0000","last_active":"2023-10-18T17:24:04.253690+0000","last_peered":"2023-10-18T17:24:04.253690+0000","last_clean":"2023-10-18T17:24:04.253690+0000","last_became_active":"2023-10-18T17:24:04.248166+0000","last_became_peered":"2023-10-18T17:24:04.248166+0000","last_unstale":"2023-10-18T17:24:04.253690+0000","last_undegraded":"2023-10-18T17:24:04.253690+0000","last_fullsized":"2023-10-18T17:24:04.253690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.263341+0000","last_change":"2023-10-18T17:24:04.261758+0000","last_active":"2023-10-18T17:24:04.263341+0000","last_peered":"2023-10-18T17:24:04.263341+0000","last_clean":"2023-10-18T17:24:04.263341+0000","last_became_active":"2023-10-18T17:24:04.259803+0000","last_became_peered":"2023-10-18T17:24:04.259803+0000","last_unstale":"2023-10-18T17:24:04.263341+0000","last_undegraded":"2023-10-18T17:24:04.263341+0000","last_fullsized":"2023-10-18T17:24:04.263341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.242129+0000","last_change":"2023-10-18T17:24:03.760642+0000","last_active":"2023-10-18T17:24:04.242129+0000","last_peered":"2023-10-18T17:24:04.242129+0000","last_clean":"2023-10-18T17:24:04.242129+0000","last_became_active":"2023-10-18T17:24:03.759676+0000","last_became_peered":"2023-10-18T17:24:03.759676+0000","last_unstale":"2023-10-18T17:24:04.242129+0000","last_undegraded":"2023-10-18T17:24:04.242129+0000","last_fullsized":"2023-10-18T17:24:04.242129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.247633+0000","last_change":"2023-10-18T17:24:04.239822+0000","last_active":"2023-10-18T17:24:04.247633+0000","last_peered":"2023-10-18T17:24:04.247633+0000","last_clean":"2023-10-18T17:24:04.247633+0000","last_became_active":"2023-10-18T17:24:04.239546+0000","last_became_peered":"2023-10-18T17:24:04.239546+0000","last_unstale":"2023-10-18T17:24:04.247633+0000","last_undegraded":"2023-10-18T17:24:04.247633+0000","last_fullsized":"2023-10-18T17:24:04.247633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.235052+0000","last_change":"2023-10-18T17:24:03.753621+0000","last_active":"2023-10-18T17:24:04.235052+0000","last_peered":"2023-10-18T17:24:04.235052+0000","last_clean":"2023-10-18T17:24:04.235052+0000","last_became_active":"2023-10-18T17:24:03.753297+0000","last_became_peered":"2023-10-18T17:24:03.753297+0000","last_unstale":"2023-10-18T17:24:04.235052+0000","last_undegraded":"2023-10-18T17:24:04.235052+0000","last_fullsized":"2023-10-18T17:24:04.235052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258710+0000","last_change":"2023-10-18T17:24:04.249371+0000","last_active":"2023-10-18T17:24:04.258710+0000","last_peered":"2023-10-18T17:24:04.258710+0000","last_clean":"2023-10-18T17:24:04.258710+0000","last_became_active":"2023-10-18T17:24:04.248843+0000","last_became_peered":"2023-10-18T17:24:04.248843+0000","last_unstale":"2023-10-18T17:24:04.258710+0000","last_undegraded":"2023-10-18T17:24:04.258710+0000","last_fullsized":"2023-10-18T17:24:04.258710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230958+0000","last_change":"2023-10-18T17:24:03.749421+0000","last_active":"2023-10-18T17:24:04.230958+0000","last_peered":"2023-10-18T17:24:04.230958+0000","last_clean":"2023-10-18T17:24:04.230958+0000","last_became_active":"2023-10-18T17:24:03.749120+0000","last_became_peered":"2023-10-18T17:24:03.749120+0000","last_unstale":"2023-10-18T17:24:04.230958+0000","last_undegraded":"2023-10-18T17:24:04.230958+0000","last_fullsized":"2023-10-18T17:24:04.230958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.244602+0000","last_change":"2023-10-18T17:24:04.239958+0000","last_active":"2023-10-18T17:24:04.244602+0000","last_peered":"2023-10-18T17:24:04.244602+0000","last_clean":"2023-10-18T17:24:04.244602+0000","last_became_active":"2023-10-18T17:24:04.239673+0000","last_became_peered":"2023-10-18T17:24:04.239673+0000","last_unstale":"2023-10-18T17:24:04.244602+0000","last_undegraded":"2023-10-18T17:24:04.244602+0000","last_fullsized":"2023-10-18T17:24:04.244602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.237011+0000","last_change":"2023-10-18T17:24:03.745601+0000","last_active":"2023-10-18T17:24:04.237011+0000","last_peered":"2023-10-18T17:24:04.237011+0000","last_clean":"2023-10-18T17:24:04.237011+0000","last_became_active":"2023-10-18T17:24:03.745287+0000","last_became_peered":"2023-10-18T17:24:03.745287+0000","last_unstale":"2023-10-18T17:24:04.237011+0000","last_undegraded":"2023-10-18T17:24:04.237011+0000","last_fullsized":"2023-10-18T17:24:04.237011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.261032+0000","last_change":"2023-10-18T17:24:04.259706+0000","last_active":"2023-10-18T17:24:04.261032+0000","last_peered":"2023-10-18T17:24:04.261032+0000","last_clean":"2023-10-18T17:24:04.261032+0000","last_became_active":"2023-10-18T17:24:04.259232+0000","last_became_peered":"2023-10-18T17:24:04.259232+0000","last_unstale":"2023-10-18T17:24:04.261032+0000","last_undegraded":"2023-10-18T17:24:04.261032+0000","last_fullsized":"2023-10-18T17:24:04.261032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.229099+0000","last_change":"2023-10-18T17:24:03.760958+0000","last_active":"2023-10-18T17:24:04.229099+0000","last_peered":"2023-10-18T17:24:04.229099+0000","last_clean":"2023-10-18T17:24:04.229099+0000","last_became_active":"2023-10-18T17:24:03.760640+0000","last_became_peered":"2023-10-18T17:24:03.760640+0000","last_unstale":"2023-10-18T17:24:04.229099+0000","last_undegraded":"2023-10-18T17:24:04.229099+0000","last_fullsized":"2023-10-18T17:24:04.229099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253551+0000","last_change":"2023-10-18T17:24:04.243907+0000","last_active":"2023-10-18T17:24:04.253551+0000","last_peered":"2023-10-18T17:24:04.253551+0000","last_clean":"2023-10-18T17:24:04.253551+0000","last_became_active":"2023-10-18T17:24:04.243296+0000","last_became_peered":"2023-10-18T17:24:04.243296+0000","last_unstale":"2023-10-18T17:24:04.253551+0000","last_undegraded":"2023-10-18T17:24:04.253551+0000","last_fullsized":"2023-10-18T17:24:04.253551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230713+0000","last_change":"2023-10-18T17:24:03.745470+0000","last_active":"2023-10-18T17:24:04.230713+0000","last_peered":"2023-10-18T17:24:04.230713+0000","last_clean":"2023-10-18T17:24:04.230713+0000","last_became_active":"2023-10-18T17:24:03.744361+0000","last_became_peered":"2023-10-18T17:24:03.744361+0000","last_unstale":"2023-10-18T17:24:04.230713+0000","last_undegraded":"2023-10-18T17:24:04.230713+0000","last_fullsized":"2023-10-18T17:24:04.230713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250503+0000","last_change":"2023-10-18T17:24:04.244429+0000","last_active":"2023-10-18T17:24:04.250503+0000","last_peered":"2023-10-18T17:24:04.250503+0000","last_clean":"2023-10-18T17:24:04.250503+0000","last_became_active":"2023-10-18T17:24:04.244106+0000","last_became_peered":"2023-10-18T17:24:04.244106+0000","last_unstale":"2023-10-18T17:24:04.250503+0000","last_undegraded":"2023-10-18T17:24:04.250503+0000","last_fullsized":"2023-10-18T17:24:04.250503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.228250+0000","last_change":"2023-10-18T17:24:03.748814+0000","last_active":"2023-10-18T17:24:04.228250+0000","last_peered":"2023-10-18T17:24:04.228250+0000","last_clean":"2023-10-18T17:24:04.228250+0000","last_became_active":"2023-10-18T17:24:03.748507+0000","last_became_peered":"2023-10-18T17:24:03.748507+0000","last_unstale":"2023-10-18T17:24:04.228250+0000","last_undegraded":"2023-10-18T17:24:04.228250+0000","last_fullsized":"2023-10-18T17:24:04.228250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258584+0000","last_change":"2023-10-18T17:24:04.249830+0000","last_active":"2023-10-18T17:24:04.258584+0000","last_peered":"2023-10-18T17:24:04.258584+0000","last_clean":"2023-10-18T17:24:04.258584+0000","last_became_active":"2023-10-18T17:24:04.249500+0000","last_became_peered":"2023-10-18T17:24:04.249500+0000","last_unstale":"2023-10-18T17:24:04.258584+0000","last_undegraded":"2023-10-18T17:24:04.258584+0000","last_fullsized":"2023-10-18T17:24:04.258584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.241126+0000","last_change":"2023-10-18T17:24:03.748849+0000","last_active":"2023-10-18T17:24:04.241126+0000","last_peered":"2023-10-18T17:24:04.241126+0000","last_clean":"2023-10-18T17:24:04.241126+0000","last_became_active":"2023-10-18T17:24:03.748240+0000","last_became_peered":"2023-10-18T17:24:03.748240+0000","last_unstale":"2023-10-18T17:24:04.241126+0000","last_undegraded":"2023-10-18T17:24:04.241126+0000","last_fullsized":"2023-10-18T17:24:04.241126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.518}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4079999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]}]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":84256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":84256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":84256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T17:24:17.401 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T17:24:17.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.591+0000 7ff20e769700 1 Processor -- start 2023-10-18T17:24:17.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.595+0000 7ff20e769700 1 -- start start 2023-10-18T17:24:17.601 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.595+0000 7ff20e769700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff2080bbf10 0x7ff2080bb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:17.602 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.595+0000 7ff20e769700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2080bf700 0x7ff20814e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:17.602 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.595+0000 7ff20e769700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20814e450 con 0x7ff2080660c0 2023-10-18T17:24:17.602 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.595+0000 7ff20e769700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2080b95f0 con 0x7ff2080bbf10 2023-10-18T17:24:17.602 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.595+0000 7ff20e769700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20814de20 con 0x7ff2080bf700 2023-10-18T17:24:17.602 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.595+0000 7ff207fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff2080bbf10 0x7ff2080bb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:17.603 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.595+0000 7ff207fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff2080bbf10 0x7ff2080bb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56330/0 (socket says 172.21.15.158:56330) 2023-10-18T17:24:17.603 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.595+0000 7ff207fff700 1 -- 172.21.15.158:0/3708258192 learned_addr learned my addr 172.21.15.158:0/3708258192 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:17.603 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.595+0000 7ff2077fe700 1 --2- 172.21.15.158:0/3708258192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2080bf700 0x7ff20814e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:17.605 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.595+0000 7ff207fff700 1 -- 172.21.15.158:0/3708258192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2080bf700 msgr2=0x7ff20814e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:17.605 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.595+0000 7ff207fff700 1 --2- 172.21.15.158:0/3708258192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2080bf700 0x7ff20814e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:17.605 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.595+0000 7ff207fff700 1 -- 172.21.15.158:0/3708258192 >> v1:172.21.15.183:6789/0 conn(0x7ff2080660c0 legacy=0x7ff2080beb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:17.605 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.595+0000 7ff207fff700 1 -- 172.21.15.158:0/3708258192 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2080b9890 con 0x7ff2080bbf10 2023-10-18T17:24:17.606 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.595+0000 7ff207fff700 1 --2- 172.21.15.158:0/3708258192 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff2080bbf10 0x7ff2080bb310 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7ff1f8006fd0 tx=0x7ff1f80090f0).ready entity=mon.0 client_cookie=bc11df7582868691 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:17.606 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.595+0000 7ff206ffd700 1 -- 172.21.15.158:0/3708258192 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f800b580 con 0x7ff2080bbf10 2023-10-18T17:24:17.606 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.595+0000 7ff206ffd700 1 -- 172.21.15.158:0/3708258192 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f800b6e0 con 0x7ff2080bbf10 2023-10-18T17:24:17.606 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.595+0000 7ff206ffd700 1 -- 172.21.15.158:0/3708258192 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f800ba60 con 0x7ff2080bbf10 2023-10-18T17:24:17.607 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.599+0000 7ff20e769700 1 -- 172.21.15.158:0/3708258192 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff2080bbf10 msgr2=0x7ff2080bb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:17.607 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.599+0000 7ff20e769700 1 --2- 172.21.15.158:0/3708258192 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff2080bbf10 0x7ff2080bb310 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7ff1f8006fd0 tx=0x7ff1f80090f0).stop 2023-10-18T17:24:17.607 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.599+0000 7ff20e769700 1 -- 172.21.15.158:0/3708258192 shutdown_connections 2023-10-18T17:24:17.607 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.599+0000 7ff20e769700 1 --2- 172.21.15.158:0/3708258192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2080bf700 0x7ff20814e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:17.607 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.599+0000 7ff20e769700 1 --2- 172.21.15.158:0/3708258192 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff2080bbf10 0x7ff2080bb310 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:17.608 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.599+0000 7ff20e769700 1 -- 172.21.15.158:0/3708258192 >> 172.21.15.158:0/3708258192 conn(0x7ff2080620d0 msgr2=0x7ff2080624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:17.608 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.599+0000 7ff20e769700 1 -- 172.21.15.158:0/3708258192 shutdown_connections 2023-10-18T17:24:17.608 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.599+0000 7ff20e769700 1 -- 172.21.15.158:0/3708258192 wait complete. 2023-10-18T17:24:17.610 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.599+0000 7ff20e769700 1 Processor -- start 2023-10-18T17:24:17.610 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.599+0000 7ff20e769700 1 -- start start 2023-10-18T17:24:17.611 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff20e769700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff2080660c0 0x7ff208167aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:17.611 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff20e769700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2080bbf10 0x7ff208166340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:17.611 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff20e769700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff208167f90 0x7ff208166830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:17.611 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff20e769700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff208165eb0 con 0x7ff2080660c0 2023-10-18T17:24:17.611 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff20e769700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff208166d20 con 0x7ff2080bbf10 2023-10-18T17:24:17.612 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff20e769700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff208149130 con 0x7ff208167f90 2023-10-18T17:24:17.612 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff207fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff2080660c0 0x7ff208167aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:17.612 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff2077fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2080bbf10 0x7ff208166340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:17.612 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff2077fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2080bbf10 0x7ff208166340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:43932/0 (socket says 172.21.15.158:43932) 2023-10-18T17:24:17.612 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff207fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff2080660c0 0x7ff208167aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56338/0 (socket says 172.21.15.158:56338) 2023-10-18T17:24:17.613 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff2077fe700 1 -- 172.21.15.158:0/3467008313 learned_addr learned my addr 172.21.15.158:0/3467008313 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:17.613 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff20cd06700 1 --2- 172.21.15.158:0/3467008313 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff208167f90 0x7ff208166830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:17.613 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff207fff700 1 -- 172.21.15.158:0/3467008313 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff208167f90 msgr2=0x7ff208166830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:17.613 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff207fff700 1 --2- 172.21.15.158:0/3467008313 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff208167f90 0x7ff208166830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:17.613 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff207fff700 1 -- 172.21.15.158:0/3467008313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2080bbf10 msgr2=0x7ff208166340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:17.614 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff207fff700 1 --2- 172.21.15.158:0/3467008313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2080bbf10 0x7ff208166340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:17.614 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff207fff700 1 -- 172.21.15.158:0/3467008313 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f8009370 con 0x7ff2080660c0 2023-10-18T17:24:17.614 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff2077fe700 1 --2- 172.21.15.158:0/3467008313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2080bbf10 0x7ff208166340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:17.614 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff20cd06700 1 --2- 172.21.15.158:0/3467008313 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff208167f90 0x7ff208166830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:17.615 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff207fff700 1 --2- 172.21.15.158:0/3467008313 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff2080660c0 0x7ff208167aa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7ff1f8014000 tx=0x7ff1f8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:17.615 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff1fffff700 1 -- 172.21.15.158:0/3467008313 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8006d90 con 0x7ff2080660c0 2023-10-18T17:24:17.615 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff1fffff700 1 -- 172.21.15.158:0/3467008313 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f8000bc0 con 0x7ff2080660c0 2023-10-18T17:24:17.615 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff1fffff700 1 -- 172.21.15.158:0/3467008313 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f801c420 con 0x7ff2080660c0 2023-10-18T17:24:17.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff20e769700 1 -- 172.21.15.158:0/3467008313 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2081658a0 con 0x7ff2080660c0 2023-10-18T17:24:17.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.603+0000 7ff20e769700 1 -- 172.21.15.158:0/3467008313 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff208168440 con 0x7ff2080660c0 2023-10-18T17:24:17.617 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.607+0000 7ff20e769700 1 -- 172.21.15.158:0/3467008313 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20806c190 con 0x7ff2080660c0 2023-10-18T17:24:17.617 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.607+0000 7ff1fffff700 1 -- 172.21.15.158:0/3467008313 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff1f801c850 con 0x7ff2080660c0 2023-10-18T17:24:17.617 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.607+0000 7ff1fffff700 1 --2- 172.21.15.158:0/3467008313 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff1e805a540 0x7ff1e805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:17.617 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.607+0000 7ff1fffff700 1 -- 172.21.15.158:0/3467008313 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff1f8076220 con 0x7ff2080660c0 2023-10-18T17:24:17.618 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.607+0000 7ff2077fe700 1 --2- 172.21.15.158:0/3467008313 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff1e805a540 0x7ff1e805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:17.618 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.611+0000 7ff2077fe700 1 --2- 172.21.15.158:0/3467008313 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff1e805a540 0x7ff1e805ca00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7ff1f0009fd0 tx=0x7ff1f0009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:17.619 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.611+0000 7ff1fffff700 1 -- 172.21.15.158:0/3467008313 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7ff1f8049a00 con 0x7ff2080660c0 2023-10-18T17:24:17.778 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.771+0000 7ff20e769700 1 -- 172.21.15.158:0/3467008313 --> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff208165ff0 con 0x7ff1e805a540 2023-10-18T17:24:17.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.787+0000 7ff1fffff700 1 -- 172.21.15.158:0/3467008313 <== mgr.4100 v2:172.21.15.183:6832/33555 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336039 (secure 0 0 0) 0x7ff1f0009e50 con 0x7ff1e805a540 2023-10-18T17:24:17.802 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:17.805 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.795+0000 7ff20e769700 1 -- 172.21.15.158:0/3467008313 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff1e805a540 msgr2=0x7ff1e805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:17.805 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.795+0000 7ff20e769700 1 --2- 172.21.15.158:0/3467008313 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff1e805a540 0x7ff1e805ca00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7ff1f0009fd0 tx=0x7ff1f0009060).stop 2023-10-18T17:24:17.805 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.795+0000 7ff20e769700 1 -- 172.21.15.158:0/3467008313 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff2080660c0 msgr2=0x7ff208167aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:17.805 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.795+0000 7ff20e769700 1 --2- 172.21.15.158:0/3467008313 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff2080660c0 0x7ff208167aa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7ff1f8014000 tx=0x7ff1f8017000).stop 2023-10-18T17:24:17.805 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.799+0000 7ff20e769700 1 -- 172.21.15.158:0/3467008313 shutdown_connections 2023-10-18T17:24:17.806 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.799+0000 7ff20e769700 1 --2- 172.21.15.158:0/3467008313 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff1e805a540 0x7ff1e805ca00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:17.806 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.799+0000 7ff20e769700 1 --2- 172.21.15.158:0/3467008313 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff208167f90 0x7ff208166830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:17.806 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.799+0000 7ff20e769700 1 --2- 172.21.15.158:0/3467008313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2080bbf10 0x7ff208166340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:17.806 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.799+0000 7ff20e769700 1 --2- 172.21.15.158:0/3467008313 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff2080660c0 0x7ff208167aa0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:17.807 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.799+0000 7ff20e769700 1 -- 172.21.15.158:0/3467008313 >> 172.21.15.158:0/3467008313 conn(0x7ff2080620d0 msgr2=0x7ff208065590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:17.807 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.799+0000 7ff20e769700 1 -- 172.21.15.158:0/3467008313 shutdown_connections 2023-10-18T17:24:17.807 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:17.799+0000 7ff20e769700 1 -- 172.21.15.158:0/3467008313 wait complete. 2023-10-18T17:24:17.807 INFO:teuthology.orchestra.run.smithi158.stderr:dumped all 2023-10-18T17:24:17.827 INFO:teuthology.orchestra.run.smithi158.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-10-18T17:24:17.492484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378516,"kb_used_data":1748,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596204,"statfs":{"total":773094113280,"available":770658512896,"internally_reserved":0,"allocated":1789952,"data_stored":678853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.247609+0000","last_change":"2023-10-18T17:24:04.239274+0000","last_active":"2023-10-18T17:24:04.247609+0000","last_peered":"2023-10-18T17:24:04.247609+0000","last_clean":"2023-10-18T17:24:04.247609+0000","last_became_active":"2023-10-18T17:24:04.238910+0000","last_became_peered":"2023-10-18T17:24:04.238910+0000","last_unstale":"2023-10-18T17:24:04.247609+0000","last_undegraded":"2023-10-18T17:24:04.247609+0000","last_fullsized":"2023-10-18T17:24:04.247609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.226011+0000","last_change":"2023-10-18T17:24:03.748169+0000","last_active":"2023-10-18T17:24:04.226011+0000","last_peered":"2023-10-18T17:24:04.226011+0000","last_clean":"2023-10-18T17:24:04.226011+0000","last_became_active":"2023-10-18T17:24:03.747891+0000","last_became_peered":"2023-10-18T17:24:03.747891+0000","last_unstale":"2023-10-18T17:24:04.226011+0000","last_undegraded":"2023-10-18T17:24:04.226011+0000","last_fullsized":"2023-10-18T17:24:04.226011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.260959+0000","last_change":"2023-10-18T17:24:04.259514+0000","last_active":"2023-10-18T17:24:04.260959+0000","last_peered":"2023-10-18T17:24:04.260959+0000","last_clean":"2023-10-18T17:24:04.260959+0000","last_became_active":"2023-10-18T17:24:04.253467+0000","last_became_peered":"2023-10-18T17:24:04.253467+0000","last_unstale":"2023-10-18T17:24:04.260959+0000","last_undegraded":"2023-10-18T17:24:04.260959+0000","last_fullsized":"2023-10-18T17:24:04.260959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230173+0000","last_change":"2023-10-18T17:24:03.746790+0000","last_active":"2023-10-18T17:24:04.230173+0000","last_peered":"2023-10-18T17:24:04.230173+0000","last_clean":"2023-10-18T17:24:04.230173+0000","last_became_active":"2023-10-18T17:24:03.746453+0000","last_became_peered":"2023-10-18T17:24:03.746453+0000","last_unstale":"2023-10-18T17:24:04.230173+0000","last_undegraded":"2023-10-18T17:24:04.230173+0000","last_fullsized":"2023-10-18T17:24:04.230173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.232414+0000","last_change":"2023-10-18T17:24:03.741477+0000","last_active":"2023-10-18T17:24:04.232414+0000","last_peered":"2023-10-18T17:24:04.232414+0000","last_clean":"2023-10-18T17:24:04.232414+0000","last_became_active":"2023-10-18T17:24:03.741171+0000","last_became_peered":"2023-10-18T17:24:03.741171+0000","last_unstale":"2023-10-18T17:24:04.232414+0000","last_undegraded":"2023-10-18T17:24:04.232414+0000","last_fullsized":"2023-10-18T17:24:04.232414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.268474+0000","last_change":"2023-10-18T17:24:04.267322+0000","last_active":"2023-10-18T17:24:04.268474+0000","last_peered":"2023-10-18T17:24:04.268474+0000","last_clean":"2023-10-18T17:24:04.268474+0000","last_became_active":"2023-10-18T17:24:04.266792+0000","last_became_peered":"2023-10-18T17:24:04.266792+0000","last_unstale":"2023-10-18T17:24:04.268474+0000","last_undegraded":"2023-10-18T17:24:04.268474+0000","last_fullsized":"2023-10-18T17:24:04.268474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.244754+0000","last_change":"2023-10-18T17:24:03.740595+0000","last_active":"2023-10-18T17:24:04.244754+0000","last_peered":"2023-10-18T17:24:04.244754+0000","last_clean":"2023-10-18T17:24:04.244754+0000","last_became_active":"2023-10-18T17:24:03.738983+0000","last_became_peered":"2023-10-18T17:24:03.738983+0000","last_unstale":"2023-10-18T17:24:04.244754+0000","last_undegraded":"2023-10-18T17:24:04.244754+0000","last_fullsized":"2023-10-18T17:24:04.244754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.261525+0000","last_change":"2023-10-18T17:24:04.252476+0000","last_active":"2023-10-18T17:24:04.261525+0000","last_peered":"2023-10-18T17:24:04.261525+0000","last_clean":"2023-10-18T17:24:04.261525+0000","last_became_active":"2023-10-18T17:24:04.252105+0000","last_became_peered":"2023-10-18T17:24:04.252105+0000","last_unstale":"2023-10-18T17:24:04.261525+0000","last_undegraded":"2023-10-18T17:24:04.261525+0000","last_fullsized":"2023-10-18T17:24:04.261525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.239066+0000","last_change":"2023-10-18T17:24:03.743161+0000","last_active":"2023-10-18T17:24:04.239066+0000","last_peered":"2023-10-18T17:24:04.239066+0000","last_clean":"2023-10-18T17:24:04.239066+0000","last_became_active":"2023-10-18T17:24:03.742829+0000","last_became_peered":"2023-10-18T17:24:03.742829+0000","last_unstale":"2023-10-18T17:24:04.239066+0000","last_undegraded":"2023-10-18T17:24:04.239066+0000","last_fullsized":"2023-10-18T17:24:04.239066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.241446+0000","last_change":"2023-10-18T17:24:04.236924+0000","last_active":"2023-10-18T17:24:04.241446+0000","last_peered":"2023-10-18T17:24:04.241446+0000","last_clean":"2023-10-18T17:24:04.241446+0000","last_became_active":"2023-10-18T17:24:04.236665+0000","last_became_peered":"2023-10-18T17:24:04.236665+0000","last_unstale":"2023-10-18T17:24:04.241446+0000","last_undegraded":"2023-10-18T17:24:04.241446+0000","last_fullsized":"2023-10-18T17:24:04.241446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.236924+0000","last_change":"2023-10-18T17:24:03.751587+0000","last_active":"2023-10-18T17:24:04.236924+0000","last_peered":"2023-10-18T17:24:04.236924+0000","last_clean":"2023-10-18T17:24:04.236924+0000","last_became_active":"2023-10-18T17:24:03.750569+0000","last_became_peered":"2023-10-18T17:24:03.750569+0000","last_unstale":"2023-10-18T17:24:04.236924+0000","last_undegraded":"2023-10-18T17:24:04.236924+0000","last_fullsized":"2023-10-18T17:24:04.236924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.261491+0000","last_change":"2023-10-18T17:24:04.256918+0000","last_active":"2023-10-18T17:24:04.261491+0000","last_peered":"2023-10-18T17:24:04.261491+0000","last_clean":"2023-10-18T17:24:04.261491+0000","last_became_active":"2023-10-18T17:24:04.256613+0000","last_became_peered":"2023-10-18T17:24:04.256613+0000","last_unstale":"2023-10-18T17:24:04.261491+0000","last_undegraded":"2023-10-18T17:24:04.261491+0000","last_fullsized":"2023-10-18T17:24:04.261491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.234112+0000","last_change":"2023-10-18T17:24:03.746467+0000","last_active":"2023-10-18T17:24:04.234112+0000","last_peered":"2023-10-18T17:24:04.234112+0000","last_clean":"2023-10-18T17:24:04.234112+0000","last_became_active":"2023-10-18T17:24:03.746097+0000","last_became_peered":"2023-10-18T17:24:03.746097+0000","last_unstale":"2023-10-18T17:24:04.234112+0000","last_undegraded":"2023-10-18T17:24:04.234112+0000","last_fullsized":"2023-10-18T17:24:04.234112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258932+0000","last_change":"2023-10-18T17:24:04.250040+0000","last_active":"2023-10-18T17:24:04.258932+0000","last_peered":"2023-10-18T17:24:04.258932+0000","last_clean":"2023-10-18T17:24:04.258932+0000","last_became_active":"2023-10-18T17:24:04.249714+0000","last_became_peered":"2023-10-18T17:24:04.249714+0000","last_unstale":"2023-10-18T17:24:04.258932+0000","last_undegraded":"2023-10-18T17:24:04.258932+0000","last_fullsized":"2023-10-18T17:24:04.258932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230946+0000","last_change":"2023-10-18T17:24:03.747229+0000","last_active":"2023-10-18T17:24:04.230946+0000","last_peered":"2023-10-18T17:24:04.230946+0000","last_clean":"2023-10-18T17:24:04.230946+0000","last_became_active":"2023-10-18T17:24:03.746616+0000","last_became_peered":"2023-10-18T17:24:03.746616+0000","last_unstale":"2023-10-18T17:24:04.230946+0000","last_undegraded":"2023-10-18T17:24:04.230946+0000","last_fullsized":"2023-10-18T17:24:04.230946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.247394+0000","last_change":"2023-10-18T17:24:04.245726+0000","last_active":"2023-10-18T17:24:04.247394+0000","last_peered":"2023-10-18T17:24:04.247394+0000","last_clean":"2023-10-18T17:24:04.247394+0000","last_became_active":"2023-10-18T17:24:04.245359+0000","last_became_peered":"2023-10-18T17:24:04.245359+0000","last_unstale":"2023-10-18T17:24:04.247394+0000","last_undegraded":"2023-10-18T17:24:04.247394+0000","last_fullsized":"2023-10-18T17:24:04.247394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.242895+0000","last_change":"2023-10-18T17:24:03.750446+0000","last_active":"2023-10-18T17:24:04.242895+0000","last_peered":"2023-10-18T17:24:04.242895+0000","last_clean":"2023-10-18T17:24:04.242895+0000","last_became_active":"2023-10-18T17:24:03.750168+0000","last_became_peered":"2023-10-18T17:24:03.750168+0000","last_unstale":"2023-10-18T17:24:04.242895+0000","last_undegraded":"2023-10-18T17:24:04.242895+0000","last_fullsized":"2023-10-18T17:24:04.242895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253696+0000","last_change":"2023-10-18T17:24:04.248487+0000","last_active":"2023-10-18T17:24:04.253696+0000","last_peered":"2023-10-18T17:24:04.253696+0000","last_clean":"2023-10-18T17:24:04.253696+0000","last_became_active":"2023-10-18T17:24:04.248084+0000","last_became_peered":"2023-10-18T17:24:04.248084+0000","last_unstale":"2023-10-18T17:24:04.253696+0000","last_undegraded":"2023-10-18T17:24:04.253696+0000","last_fullsized":"2023-10-18T17:24:04.253696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230132+0000","last_change":"2023-10-18T17:24:03.762411+0000","last_active":"2023-10-18T17:24:04.230132+0000","last_peered":"2023-10-18T17:24:04.230132+0000","last_clean":"2023-10-18T17:24:04.230132+0000","last_became_active":"2023-10-18T17:24:03.762048+0000","last_became_peered":"2023-10-18T17:24:03.762048+0000","last_unstale":"2023-10-18T17:24:04.230132+0000","last_undegraded":"2023-10-18T17:24:04.230132+0000","last_fullsized":"2023-10-18T17:24:04.230132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258720+0000","last_change":"2023-10-18T17:24:04.255411+0000","last_active":"2023-10-18T17:24:04.258720+0000","last_peered":"2023-10-18T17:24:04.258720+0000","last_clean":"2023-10-18T17:24:04.258720+0000","last_became_active":"2023-10-18T17:24:04.253124+0000","last_became_peered":"2023-10-18T17:24:04.253124+0000","last_unstale":"2023-10-18T17:24:04.258720+0000","last_undegraded":"2023-10-18T17:24:04.258720+0000","last_fullsized":"2023-10-18T17:24:04.258720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250604+0000","last_change":"2023-10-18T17:24:03.753682+0000","last_active":"2023-10-18T17:24:04.250604+0000","last_peered":"2023-10-18T17:24:04.250604+0000","last_clean":"2023-10-18T17:24:04.250604+0000","last_became_active":"2023-10-18T17:24:03.750732+0000","last_became_peered":"2023-10-18T17:24:03.750732+0000","last_unstale":"2023-10-18T17:24:04.250604+0000","last_undegraded":"2023-10-18T17:24:04.250604+0000","last_fullsized":"2023-10-18T17:24:04.250604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250927+0000","last_change":"2023-10-18T17:24:04.247389+0000","last_active":"2023-10-18T17:24:04.250927+0000","last_peered":"2023-10-18T17:24:04.250927+0000","last_clean":"2023-10-18T17:24:04.250927+0000","last_became_active":"2023-10-18T17:24:04.247045+0000","last_became_peered":"2023-10-18T17:24:04.247045+0000","last_unstale":"2023-10-18T17:24:04.250927+0000","last_undegraded":"2023-10-18T17:24:04.250927+0000","last_fullsized":"2023-10-18T17:24:04.250927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.237438+0000","last_change":"2023-10-18T17:24:03.742205+0000","last_active":"2023-10-18T17:24:04.237438+0000","last_peered":"2023-10-18T17:24:04.237438+0000","last_clean":"2023-10-18T17:24:04.237438+0000","last_became_active":"2023-10-18T17:24:03.741881+0000","last_became_peered":"2023-10-18T17:24:03.741881+0000","last_unstale":"2023-10-18T17:24:04.237438+0000","last_undegraded":"2023-10-18T17:24:04.237438+0000","last_fullsized":"2023-10-18T17:24:04.237438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.256041+0000","last_change":"2023-10-18T17:24:04.251859+0000","last_active":"2023-10-18T17:24:04.256041+0000","last_peered":"2023-10-18T17:24:04.256041+0000","last_clean":"2023-10-18T17:24:04.256041+0000","last_became_active":"2023-10-18T17:24:04.251431+0000","last_became_peered":"2023-10-18T17:24:04.251431+0000","last_unstale":"2023-10-18T17:24:04.256041+0000","last_undegraded":"2023-10-18T17:24:04.256041+0000","last_fullsized":"2023-10-18T17:24:04.256041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.225479+0000","last_change":"2023-10-18T17:24:03.761606+0000","last_active":"2023-10-18T17:24:04.225479+0000","last_peered":"2023-10-18T17:24:04.225479+0000","last_clean":"2023-10-18T17:24:04.225479+0000","last_became_active":"2023-10-18T17:24:03.759066+0000","last_became_peered":"2023-10-18T17:24:03.759066+0000","last_unstale":"2023-10-18T17:24:04.225479+0000","last_undegraded":"2023-10-18T17:24:04.225479+0000","last_fullsized":"2023-10-18T17:24:04.225479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253478+0000","last_change":"2023-10-18T17:24:04.242517+0000","last_active":"2023-10-18T17:24:04.253478+0000","last_peered":"2023-10-18T17:24:04.253478+0000","last_clean":"2023-10-18T17:24:04.253478+0000","last_became_active":"2023-10-18T17:24:04.242198+0000","last_became_peered":"2023-10-18T17:24:04.242198+0000","last_unstale":"2023-10-18T17:24:04.253478+0000","last_undegraded":"2023-10-18T17:24:04.253478+0000","last_fullsized":"2023-10-18T17:24:04.253478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250063+0000","last_change":"2023-10-18T17:24:03.751375+0000","last_active":"2023-10-18T17:24:04.250063+0000","last_peered":"2023-10-18T17:24:04.250063+0000","last_clean":"2023-10-18T17:24:04.250063+0000","last_became_active":"2023-10-18T17:24:03.751112+0000","last_became_peered":"2023-10-18T17:24:03.751112+0000","last_unstale":"2023-10-18T17:24:04.250063+0000","last_undegraded":"2023-10-18T17:24:04.250063+0000","last_fullsized":"2023-10-18T17:24:04.250063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.262744+0000","last_change":"2023-10-18T17:24:04.253973+0000","last_active":"2023-10-18T17:24:04.262744+0000","last_peered":"2023-10-18T17:24:04.262744+0000","last_clean":"2023-10-18T17:24:04.262744+0000","last_became_active":"2023-10-18T17:24:04.253669+0000","last_became_peered":"2023-10-18T17:24:04.253669+0000","last_unstale":"2023-10-18T17:24:04.262744+0000","last_undegraded":"2023-10-18T17:24:04.262744+0000","last_fullsized":"2023-10-18T17:24:04.262744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.234227+0000","last_change":"2023-10-18T17:24:03.762548+0000","last_active":"2023-10-18T17:24:04.234227+0000","last_peered":"2023-10-18T17:24:04.234227+0000","last_clean":"2023-10-18T17:24:04.234227+0000","last_became_active":"2023-10-18T17:24:03.762215+0000","last_became_peered":"2023-10-18T17:24:03.762215+0000","last_unstale":"2023-10-18T17:24:04.234227+0000","last_undegraded":"2023-10-18T17:24:04.234227+0000","last_fullsized":"2023-10-18T17:24:04.234227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.255941+0000","last_change":"2023-10-18T17:24:04.244220+0000","last_active":"2023-10-18T17:24:04.255941+0000","last_peered":"2023-10-18T17:24:04.255941+0000","last_clean":"2023-10-18T17:24:04.255941+0000","last_became_active":"2023-10-18T17:24:04.243840+0000","last_became_peered":"2023-10-18T17:24:04.243840+0000","last_unstale":"2023-10-18T17:24:04.255941+0000","last_undegraded":"2023-10-18T17:24:04.255941+0000","last_fullsized":"2023-10-18T17:24:04.255941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.231035+0000","last_change":"2023-10-18T17:24:03.761832+0000","last_active":"2023-10-18T17:24:04.231035+0000","last_peered":"2023-10-18T17:24:04.231035+0000","last_clean":"2023-10-18T17:24:04.231035+0000","last_became_active":"2023-10-18T17:24:03.761474+0000","last_became_peered":"2023-10-18T17:24:03.761474+0000","last_unstale":"2023-10-18T17:24:04.231035+0000","last_undegraded":"2023-10-18T17:24:04.231035+0000","last_fullsized":"2023-10-18T17:24:04.231035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.248697+0000","last_change":"2023-10-18T17:24:04.242877+0000","last_active":"2023-10-18T17:24:04.248697+0000","last_peered":"2023-10-18T17:24:04.248697+0000","last_clean":"2023-10-18T17:24:04.248697+0000","last_became_active":"2023-10-18T17:24:04.242155+0000","last_became_peered":"2023-10-18T17:24:04.242155+0000","last_unstale":"2023-10-18T17:24:04.248697+0000","last_undegraded":"2023-10-18T17:24:04.248697+0000","last_fullsized":"2023-10-18T17:24:04.248697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.236784+0000","last_change":"2023-10-18T17:24:03.750350+0000","last_active":"2023-10-18T17:24:04.236784+0000","last_peered":"2023-10-18T17:24:04.236784+0000","last_clean":"2023-10-18T17:24:04.236784+0000","last_became_active":"2023-10-18T17:24:03.750080+0000","last_became_peered":"2023-10-18T17:24:03.750080+0000","last_unstale":"2023-10-18T17:24:04.236784+0000","last_undegraded":"2023-10-18T17:24:04.236784+0000","last_fullsized":"2023-10-18T17:24:04.236784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.257049+0000","last_change":"2023-10-18T17:24:04.246950+0000","last_active":"2023-10-18T17:24:04.257049+0000","last_peered":"2023-10-18T17:24:04.257049+0000","last_clean":"2023-10-18T17:24:04.257049+0000","last_became_active":"2023-10-18T17:24:04.246377+0000","last_became_peered":"2023-10-18T17:24:04.246377+0000","last_unstale":"2023-10-18T17:24:04.257049+0000","last_undegraded":"2023-10-18T17:24:04.257049+0000","last_fullsized":"2023-10-18T17:24:04.257049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.236736+0000","last_change":"2023-10-18T17:24:03.754668+0000","last_active":"2023-10-18T17:24:04.236736+0000","last_peered":"2023-10-18T17:24:04.236736+0000","last_clean":"2023-10-18T17:24:04.236736+0000","last_became_active":"2023-10-18T17:24:03.754167+0000","last_became_peered":"2023-10-18T17:24:03.754167+0000","last_unstale":"2023-10-18T17:24:04.236736+0000","last_undegraded":"2023-10-18T17:24:04.236736+0000","last_fullsized":"2023-10-18T17:24:04.236736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250784+0000","last_change":"2023-10-18T17:24:04.239937+0000","last_active":"2023-10-18T17:24:04.250784+0000","last_peered":"2023-10-18T17:24:04.250784+0000","last_clean":"2023-10-18T17:24:04.250784+0000","last_became_active":"2023-10-18T17:24:04.239632+0000","last_became_peered":"2023-10-18T17:24:04.239632+0000","last_unstale":"2023-10-18T17:24:04.250784+0000","last_undegraded":"2023-10-18T17:24:04.250784+0000","last_fullsized":"2023-10-18T17:24:04.250784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.235445+0000","last_change":"2023-10-18T17:24:03.752082+0000","last_active":"2023-10-18T17:24:04.235445+0000","last_peered":"2023-10-18T17:24:04.235445+0000","last_clean":"2023-10-18T17:24:04.235445+0000","last_became_active":"2023-10-18T17:24:03.751789+0000","last_became_peered":"2023-10-18T17:24:03.751789+0000","last_unstale":"2023-10-18T17:24:04.235445+0000","last_undegraded":"2023-10-18T17:24:04.235445+0000","last_fullsized":"2023-10-18T17:24:04.235445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258595+0000","last_change":"2023-10-18T17:24:04.249928+0000","last_active":"2023-10-18T17:24:04.258595+0000","last_peered":"2023-10-18T17:24:04.258595+0000","last_clean":"2023-10-18T17:24:04.258595+0000","last_became_active":"2023-10-18T17:24:04.249624+0000","last_became_peered":"2023-10-18T17:24:04.249624+0000","last_unstale":"2023-10-18T17:24:04.258595+0000","last_undegraded":"2023-10-18T17:24:04.258595+0000","last_fullsized":"2023-10-18T17:24:04.258595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.248249+0000","last_change":"2023-10-18T17:24:03.750481+0000","last_active":"2023-10-18T17:24:04.248249+0000","last_peered":"2023-10-18T17:24:04.248249+0000","last_clean":"2023-10-18T17:24:04.248249+0000","last_became_active":"2023-10-18T17:24:03.748182+0000","last_became_peered":"2023-10-18T17:24:03.748182+0000","last_unstale":"2023-10-18T17:24:04.248249+0000","last_undegraded":"2023-10-18T17:24:04.248249+0000","last_fullsized":"2023-10-18T17:24:04.248249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.255364+0000","last_change":"2023-10-18T17:24:04.251380+0000","last_active":"2023-10-18T17:24:04.255364+0000","last_peered":"2023-10-18T17:24:04.255364+0000","last_clean":"2023-10-18T17:24:04.255364+0000","last_became_active":"2023-10-18T17:24:04.251078+0000","last_became_peered":"2023-10-18T17:24:04.251078+0000","last_unstale":"2023-10-18T17:24:04.255364+0000","last_undegraded":"2023-10-18T17:24:04.255364+0000","last_fullsized":"2023-10-18T17:24:04.255364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230353+0000","last_change":"2023-10-18T17:24:03.742352+0000","last_active":"2023-10-18T17:24:04.230353+0000","last_peered":"2023-10-18T17:24:04.230353+0000","last_clean":"2023-10-18T17:24:04.230353+0000","last_became_active":"2023-10-18T17:24:03.742052+0000","last_became_peered":"2023-10-18T17:24:03.742052+0000","last_unstale":"2023-10-18T17:24:04.230353+0000","last_undegraded":"2023-10-18T17:24:04.230353+0000","last_fullsized":"2023-10-18T17:24:04.230353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.259270+0000","last_change":"2023-10-18T17:24:04.254657+0000","last_active":"2023-10-18T17:24:04.259270+0000","last_peered":"2023-10-18T17:24:04.259270+0000","last_clean":"2023-10-18T17:24:04.259270+0000","last_became_active":"2023-10-18T17:24:04.254373+0000","last_became_peered":"2023-10-18T17:24:04.254373+0000","last_unstale":"2023-10-18T17:24:04.259270+0000","last_undegraded":"2023-10-18T17:24:04.259270+0000","last_fullsized":"2023-10-18T17:24:04.259270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.229358+0000","last_change":"2023-10-18T17:24:03.746763+0000","last_active":"2023-10-18T17:24:04.229358+0000","last_peered":"2023-10-18T17:24:04.229358+0000","last_clean":"2023-10-18T17:24:04.229358+0000","last_became_active":"2023-10-18T17:24:03.746461+0000","last_became_peered":"2023-10-18T17:24:03.746461+0000","last_unstale":"2023-10-18T17:24:04.229358+0000","last_undegraded":"2023-10-18T17:24:04.229358+0000","last_fullsized":"2023-10-18T17:24:04.229358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.263765+0000","last_change":"2023-10-18T17:24:04.258875+0000","last_active":"2023-10-18T17:24:04.263765+0000","last_peered":"2023-10-18T17:24:04.263765+0000","last_clean":"2023-10-18T17:24:04.263765+0000","last_became_active":"2023-10-18T17:24:04.258617+0000","last_became_peered":"2023-10-18T17:24:04.258617+0000","last_unstale":"2023-10-18T17:24:04.263765+0000","last_undegraded":"2023-10-18T17:24:04.263765+0000","last_fullsized":"2023-10-18T17:24:04.263765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.234335+0000","last_change":"2023-10-18T17:24:03.749937+0000","last_active":"2023-10-18T17:24:04.234335+0000","last_peered":"2023-10-18T17:24:04.234335+0000","last_clean":"2023-10-18T17:24:04.234335+0000","last_became_active":"2023-10-18T17:24:03.749625+0000","last_became_peered":"2023-10-18T17:24:03.749625+0000","last_unstale":"2023-10-18T17:24:04.234335+0000","last_undegraded":"2023-10-18T17:24:04.234335+0000","last_fullsized":"2023-10-18T17:24:04.234335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.244522+0000","last_change":"2023-10-18T17:24:04.237303+0000","last_active":"2023-10-18T17:24:04.244522+0000","last_peered":"2023-10-18T17:24:04.244522+0000","last_clean":"2023-10-18T17:24:04.244522+0000","last_became_active":"2023-10-18T17:24:04.237016+0000","last_became_peered":"2023-10-18T17:24:04.237016+0000","last_unstale":"2023-10-18T17:24:04.244522+0000","last_undegraded":"2023-10-18T17:24:04.244522+0000","last_fullsized":"2023-10-18T17:24:04.244522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.235302+0000","last_change":"2023-10-18T17:24:03.745317+0000","last_active":"2023-10-18T17:24:04.235302+0000","last_peered":"2023-10-18T17:24:04.235302+0000","last_clean":"2023-10-18T17:24:04.235302+0000","last_became_active":"2023-10-18T17:24:03.745016+0000","last_became_peered":"2023-10-18T17:24:03.745016+0000","last_unstale":"2023-10-18T17:24:04.235302+0000","last_undegraded":"2023-10-18T17:24:04.235302+0000","last_fullsized":"2023-10-18T17:24:04.235302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.264701+0000","last_change":"2023-10-18T17:24:04.262322+0000","last_active":"2023-10-18T17:24:04.264701+0000","last_peered":"2023-10-18T17:24:04.264701+0000","last_clean":"2023-10-18T17:24:04.264701+0000","last_became_active":"2023-10-18T17:24:04.262039+0000","last_became_peered":"2023-10-18T17:24:04.262039+0000","last_unstale":"2023-10-18T17:24:04.264701+0000","last_undegraded":"2023-10-18T17:24:04.264701+0000","last_fullsized":"2023-10-18T17:24:04.264701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.228078+0000","last_change":"2023-10-18T17:24:03.756377+0000","last_active":"2023-10-18T17:24:04.228078+0000","last_peered":"2023-10-18T17:24:04.228078+0000","last_clean":"2023-10-18T17:24:04.228078+0000","last_became_active":"2023-10-18T17:24:03.756048+0000","last_became_peered":"2023-10-18T17:24:03.756048+0000","last_unstale":"2023-10-18T17:24:04.228078+0000","last_undegraded":"2023-10-18T17:24:04.228078+0000","last_fullsized":"2023-10-18T17:24:04.228078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.256537+0000","last_change":"2023-10-18T17:24:04.248165+0000","last_active":"2023-10-18T17:24:04.256537+0000","last_peered":"2023-10-18T17:24:04.256537+0000","last_clean":"2023-10-18T17:24:04.256537+0000","last_became_active":"2023-10-18T17:24:04.247888+0000","last_became_peered":"2023-10-18T17:24:04.247888+0000","last_unstale":"2023-10-18T17:24:04.256537+0000","last_undegraded":"2023-10-18T17:24:04.256537+0000","last_fullsized":"2023-10-18T17:24:04.256537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.242223+0000","last_change":"2023-10-18T17:24:03.756703+0000","last_active":"2023-10-18T17:24:04.242223+0000","last_peered":"2023-10-18T17:24:04.242223+0000","last_clean":"2023-10-18T17:24:04.242223+0000","last_became_active":"2023-10-18T17:24:03.755543+0000","last_became_peered":"2023-10-18T17:24:03.755543+0000","last_unstale":"2023-10-18T17:24:04.242223+0000","last_undegraded":"2023-10-18T17:24:04.242223+0000","last_fullsized":"2023-10-18T17:24:04.242223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250758+0000","last_change":"2023-10-18T17:24:04.248435+0000","last_active":"2023-10-18T17:24:04.250758+0000","last_peered":"2023-10-18T17:24:04.250758+0000","last_clean":"2023-10-18T17:24:04.250758+0000","last_became_active":"2023-10-18T17:24:04.248150+0000","last_became_peered":"2023-10-18T17:24:04.248150+0000","last_unstale":"2023-10-18T17:24:04.250758+0000","last_undegraded":"2023-10-18T17:24:04.250758+0000","last_fullsized":"2023-10-18T17:24:04.250758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.235444+0000","last_change":"2023-10-18T17:24:03.751813+0000","last_active":"2023-10-18T17:24:04.235444+0000","last_peered":"2023-10-18T17:24:04.235444+0000","last_clean":"2023-10-18T17:24:04.235444+0000","last_became_active":"2023-10-18T17:24:03.751468+0000","last_became_peered":"2023-10-18T17:24:03.751468+0000","last_unstale":"2023-10-18T17:24:04.235444+0000","last_undegraded":"2023-10-18T17:24:04.235444+0000","last_fullsized":"2023-10-18T17:24:04.235444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.264737+0000","last_change":"2023-10-18T17:24:04.258693+0000","last_active":"2023-10-18T17:24:04.264737+0000","last_peered":"2023-10-18T17:24:04.264737+0000","last_clean":"2023-10-18T17:24:04.264737+0000","last_became_active":"2023-10-18T17:24:04.258420+0000","last_became_peered":"2023-10-18T17:24:04.258420+0000","last_unstale":"2023-10-18T17:24:04.264737+0000","last_undegraded":"2023-10-18T17:24:04.264737+0000","last_fullsized":"2023-10-18T17:24:04.264737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.231275+0000","last_change":"2023-10-18T17:24:03.741061+0000","last_active":"2023-10-18T17:24:04.231275+0000","last_peered":"2023-10-18T17:24:04.231275+0000","last_clean":"2023-10-18T17:24:04.231275+0000","last_became_active":"2023-10-18T17:24:03.740773+0000","last_became_peered":"2023-10-18T17:24:03.740773+0000","last_unstale":"2023-10-18T17:24:04.231275+0000","last_undegraded":"2023-10-18T17:24:04.231275+0000","last_fullsized":"2023-10-18T17:24:04.231275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.261550+0000","last_change":"2023-10-18T17:24:04.255651+0000","last_active":"2023-10-18T17:24:04.261550+0000","last_peered":"2023-10-18T17:24:04.261550+0000","last_clean":"2023-10-18T17:24:04.261550+0000","last_became_active":"2023-10-18T17:24:04.255377+0000","last_became_peered":"2023-10-18T17:24:04.255377+0000","last_unstale":"2023-10-18T17:24:04.261550+0000","last_undegraded":"2023-10-18T17:24:04.261550+0000","last_fullsized":"2023-10-18T17:24:04.261550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.238835+0000","last_change":"2023-10-18T17:24:03.762674+0000","last_active":"2023-10-18T17:24:04.238835+0000","last_peered":"2023-10-18T17:24:04.238835+0000","last_clean":"2023-10-18T17:24:04.238835+0000","last_became_active":"2023-10-18T17:24:03.762293+0000","last_became_peered":"2023-10-18T17:24:03.762293+0000","last_unstale":"2023-10-18T17:24:04.238835+0000","last_undegraded":"2023-10-18T17:24:04.238835+0000","last_fullsized":"2023-10-18T17:24:04.238835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.249093+0000","last_change":"2023-10-18T17:24:04.240811+0000","last_active":"2023-10-18T17:24:04.249093+0000","last_peered":"2023-10-18T17:24:04.249093+0000","last_clean":"2023-10-18T17:24:04.249093+0000","last_became_active":"2023-10-18T17:24:04.240514+0000","last_became_peered":"2023-10-18T17:24:04.240514+0000","last_unstale":"2023-10-18T17:24:04.249093+0000","last_undegraded":"2023-10-18T17:24:04.249093+0000","last_fullsized":"2023-10-18T17:24:04.249093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.241156+0000","last_change":"2023-10-18T17:24:03.744676+0000","last_active":"2023-10-18T17:24:04.241156+0000","last_peered":"2023-10-18T17:24:04.241156+0000","last_clean":"2023-10-18T17:24:04.241156+0000","last_became_active":"2023-10-18T17:24:03.744318+0000","last_became_peered":"2023-10-18T17:24:03.744318+0000","last_unstale":"2023-10-18T17:24:04.241156+0000","last_undegraded":"2023-10-18T17:24:04.241156+0000","last_fullsized":"2023-10-18T17:24:04.241156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253760+0000","last_change":"2023-10-18T17:24:04.242434+0000","last_active":"2023-10-18T17:24:04.253760+0000","last_peered":"2023-10-18T17:24:04.253760+0000","last_clean":"2023-10-18T17:24:04.253760+0000","last_became_active":"2023-10-18T17:24:04.242125+0000","last_became_peered":"2023-10-18T17:24:04.242125+0000","last_unstale":"2023-10-18T17:24:04.253760+0000","last_undegraded":"2023-10-18T17:24:04.253760+0000","last_fullsized":"2023-10-18T17:24:04.253760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.237328+0000","last_change":"2023-10-18T17:23:58.684395+0000","last_active":"2023-10-18T17:24:04.237328+0000","last_peered":"2023-10-18T17:24:04.237328+0000","last_clean":"2023-10-18T17:24:04.237328+0000","last_became_active":"2023-10-18T17:23:58.683958+0000","last_became_peered":"2023-10-18T17:23:58.683958+0000","last_unstale":"2023-10-18T17:24:04.237328+0000","last_undegraded":"2023-10-18T17:24:04.237328+0000","last_fullsized":"2023-10-18T17:24:04.237328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.231926+0000","last_change":"2023-10-18T17:24:03.753111+0000","last_active":"2023-10-18T17:24:04.231926+0000","last_peered":"2023-10-18T17:24:04.231926+0000","last_clean":"2023-10-18T17:24:04.231926+0000","last_became_active":"2023-10-18T17:24:03.752548+0000","last_became_peered":"2023-10-18T17:24:03.752548+0000","last_unstale":"2023-10-18T17:24:04.231926+0000","last_undegraded":"2023-10-18T17:24:04.231926+0000","last_fullsized":"2023-10-18T17:24:04.231926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253728+0000","last_change":"2023-10-18T17:24:04.244386+0000","last_active":"2023-10-18T17:24:04.253728+0000","last_peered":"2023-10-18T17:24:04.253728+0000","last_clean":"2023-10-18T17:24:04.253728+0000","last_became_active":"2023-10-18T17:24:04.244041+0000","last_became_peered":"2023-10-18T17:24:04.244041+0000","last_unstale":"2023-10-18T17:24:04.253728+0000","last_undegraded":"2023-10-18T17:24:04.253728+0000","last_fullsized":"2023-10-18T17:24:04.253728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.228377+0000","last_change":"2023-10-18T17:23:58.682697+0000","last_active":"2023-10-18T17:24:04.228377+0000","last_peered":"2023-10-18T17:24:04.228377+0000","last_clean":"2023-10-18T17:24:04.228377+0000","last_became_active":"2023-10-18T17:23:58.682294+0000","last_became_peered":"2023-10-18T17:23:58.682294+0000","last_unstale":"2023-10-18T17:24:04.228377+0000","last_undegraded":"2023-10-18T17:24:04.228377+0000","last_fullsized":"2023-10-18T17:24:04.228377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250659+0000","last_change":"2023-10-18T17:24:03.749017+0000","last_active":"2023-10-18T17:24:04.250659+0000","last_peered":"2023-10-18T17:24:04.250659+0000","last_clean":"2023-10-18T17:24:04.250659+0000","last_became_active":"2023-10-18T17:24:03.748740+0000","last_became_peered":"2023-10-18T17:24:03.748740+0000","last_unstale":"2023-10-18T17:24:04.250659+0000","last_undegraded":"2023-10-18T17:24:04.250659+0000","last_fullsized":"2023-10-18T17:24:04.250659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.262438+0000","last_change":"2023-10-18T17:24:04.257504+0000","last_active":"2023-10-18T17:24:04.262438+0000","last_peered":"2023-10-18T17:24:04.262438+0000","last_clean":"2023-10-18T17:24:04.262438+0000","last_became_active":"2023-10-18T17:24:04.255752+0000","last_became_peered":"2023-10-18T17:24:04.255752+0000","last_unstale":"2023-10-18T17:24:04.262438+0000","last_undegraded":"2023-10-18T17:24:04.262438+0000","last_fullsized":"2023-10-18T17:24:04.262438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.239151+0000","last_change":"2023-10-18T17:23:58.853499+0000","last_active":"2023-10-18T17:24:04.239151+0000","last_peered":"2023-10-18T17:24:04.239151+0000","last_clean":"2023-10-18T17:24:04.239151+0000","last_became_active":"2023-10-18T17:23:58.852960+0000","last_became_peered":"2023-10-18T17:23:58.852960+0000","last_unstale":"2023-10-18T17:24:04.239151+0000","last_undegraded":"2023-10-18T17:24:04.239151+0000","last_fullsized":"2023-10-18T17:24:04.239151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.227303+0000","last_change":"2023-10-18T17:24:03.739032+0000","last_active":"2023-10-18T17:24:04.227303+0000","last_peered":"2023-10-18T17:24:04.227303+0000","last_clean":"2023-10-18T17:24:04.227303+0000","last_became_active":"2023-10-18T17:24:03.738439+0000","last_became_peered":"2023-10-18T17:24:03.738439+0000","last_unstale":"2023-10-18T17:24:04.227303+0000","last_undegraded":"2023-10-18T17:24:04.227303+0000","last_fullsized":"2023-10-18T17:24:04.227303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.246665+0000","last_change":"2023-10-18T17:24:04.245021+0000","last_active":"2023-10-18T17:24:04.246665+0000","last_peered":"2023-10-18T17:24:04.246665+0000","last_clean":"2023-10-18T17:24:04.246665+0000","last_became_active":"2023-10-18T17:24:04.244567+0000","last_became_peered":"2023-10-18T17:24:04.244567+0000","last_unstale":"2023-10-18T17:24:04.246665+0000","last_undegraded":"2023-10-18T17:24:04.246665+0000","last_fullsized":"2023-10-18T17:24:04.246665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.227863+0000","last_change":"2023-10-18T17:23:58.851971+0000","last_active":"2023-10-18T17:24:04.227863+0000","last_peered":"2023-10-18T17:24:04.227863+0000","last_clean":"2023-10-18T17:24:04.227863+0000","last_became_active":"2023-10-18T17:23:58.851505+0000","last_became_peered":"2023-10-18T17:23:58.851505+0000","last_unstale":"2023-10-18T17:24:04.227863+0000","last_undegraded":"2023-10-18T17:24:04.227863+0000","last_fullsized":"2023-10-18T17:24:04.227863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230449+0000","last_change":"2023-10-18T17:24:03.761669+0000","last_active":"2023-10-18T17:24:04.230449+0000","last_peered":"2023-10-18T17:24:04.230449+0000","last_clean":"2023-10-18T17:24:04.230449+0000","last_became_active":"2023-10-18T17:24:03.761358+0000","last_became_peered":"2023-10-18T17:24:03.761358+0000","last_unstale":"2023-10-18T17:24:04.230449+0000","last_undegraded":"2023-10-18T17:24:04.230449+0000","last_fullsized":"2023-10-18T17:24:04.230449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.255925+0000","last_change":"2023-10-18T17:24:04.243705+0000","last_active":"2023-10-18T17:24:04.255925+0000","last_peered":"2023-10-18T17:24:04.255925+0000","last_clean":"2023-10-18T17:24:04.255925+0000","last_became_active":"2023-10-18T17:24:04.243438+0000","last_became_peered":"2023-10-18T17:24:04.243438+0000","last_unstale":"2023-10-18T17:24:04.255925+0000","last_undegraded":"2023-10-18T17:24:04.255925+0000","last_fullsized":"2023-10-18T17:24:04.255925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.234833+0000","last_change":"2023-10-18T17:24:03.754253+0000","last_active":"2023-10-18T17:24:04.234833+0000","last_peered":"2023-10-18T17:24:04.234833+0000","last_clean":"2023-10-18T17:24:04.234833+0000","last_became_active":"2023-10-18T17:24:03.753384+0000","last_became_peered":"2023-10-18T17:24:03.753384+0000","last_unstale":"2023-10-18T17:24:04.234833+0000","last_undegraded":"2023-10-18T17:24:04.234833+0000","last_fullsized":"2023-10-18T17:24:04.234833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.232464+0000","last_change":"2023-10-18T17:23:58.682309+0000","last_active":"2023-10-18T17:24:04.232464+0000","last_peered":"2023-10-18T17:24:04.232464+0000","last_clean":"2023-10-18T17:24:04.232464+0000","last_became_active":"2023-10-18T17:23:58.681978+0000","last_became_peered":"2023-10-18T17:23:58.681978+0000","last_unstale":"2023-10-18T17:24:04.232464+0000","last_undegraded":"2023-10-18T17:24:04.232464+0000","last_fullsized":"2023-10-18T17:24:04.232464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.255921+0000","last_change":"2023-10-18T17:24:04.244101+0000","last_active":"2023-10-18T17:24:04.255921+0000","last_peered":"2023-10-18T17:24:04.255921+0000","last_clean":"2023-10-18T17:24:04.255921+0000","last_became_active":"2023-10-18T17:24:04.243455+0000","last_became_peered":"2023-10-18T17:24:04.243455+0000","last_unstale":"2023-10-18T17:24:04.255921+0000","last_undegraded":"2023-10-18T17:24:04.255921+0000","last_fullsized":"2023-10-18T17:24:04.255921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.224950+0000","last_change":"2023-10-18T17:24:03.743003+0000","last_active":"2023-10-18T17:24:04.224950+0000","last_peered":"2023-10-18T17:24:04.224950+0000","last_clean":"2023-10-18T17:24:04.224950+0000","last_became_active":"2023-10-18T17:24:03.742629+0000","last_became_peered":"2023-10-18T17:24:03.742629+0000","last_unstale":"2023-10-18T17:24:04.224950+0000","last_undegraded":"2023-10-18T17:24:04.224950+0000","last_fullsized":"2023-10-18T17:24:04.224950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.236706+0000","last_change":"2023-10-18T17:23:58.678572+0000","last_active":"2023-10-18T17:24:04.236706+0000","last_peered":"2023-10-18T17:24:04.236706+0000","last_clean":"2023-10-18T17:24:04.236706+0000","last_became_active":"2023-10-18T17:23:58.677813+0000","last_became_peered":"2023-10-18T17:23:58.677813+0000","last_unstale":"2023-10-18T17:24:04.236706+0000","last_undegraded":"2023-10-18T17:24:04.236706+0000","last_fullsized":"2023-10-18T17:24:04.236706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250762+0000","last_change":"2023-10-18T17:24:04.239298+0000","last_active":"2023-10-18T17:24:04.250762+0000","last_peered":"2023-10-18T17:24:04.250762+0000","last_clean":"2023-10-18T17:24:04.250762+0000","last_became_active":"2023-10-18T17:24:04.239025+0000","last_became_peered":"2023-10-18T17:24:04.239025+0000","last_unstale":"2023-10-18T17:24:04.250762+0000","last_undegraded":"2023-10-18T17:24:04.250762+0000","last_fullsized":"2023-10-18T17:24:04.250762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230729+0000","last_change":"2023-10-18T17:24:03.750194+0000","last_active":"2023-10-18T17:24:04.230729+0000","last_peered":"2023-10-18T17:24:04.230729+0000","last_clean":"2023-10-18T17:24:04.230729+0000","last_became_active":"2023-10-18T17:24:03.749909+0000","last_became_peered":"2023-10-18T17:24:03.749909+0000","last_unstale":"2023-10-18T17:24:04.230729+0000","last_undegraded":"2023-10-18T17:24:04.230729+0000","last_fullsized":"2023-10-18T17:24:04.230729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.235102+0000","last_change":"2023-10-18T17:23:58.679941+0000","last_active":"2023-10-18T17:24:04.235102+0000","last_peered":"2023-10-18T17:24:04.235102+0000","last_clean":"2023-10-18T17:24:04.235102+0000","last_became_active":"2023-10-18T17:23:58.679210+0000","last_became_peered":"2023-10-18T17:23:58.679210+0000","last_unstale":"2023-10-18T17:24:04.235102+0000","last_undegraded":"2023-10-18T17:24:04.235102+0000","last_fullsized":"2023-10-18T17:24:04.235102+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.256726+0000","last_change":"2023-10-18T17:24:04.252056+0000","last_active":"2023-10-18T17:24:04.256726+0000","last_peered":"2023-10-18T17:24:04.256726+0000","last_clean":"2023-10-18T17:24:04.256726+0000","last_became_active":"2023-10-18T17:24:04.251812+0000","last_became_peered":"2023-10-18T17:24:04.251812+0000","last_unstale":"2023-10-18T17:24:04.256726+0000","last_undegraded":"2023-10-18T17:24:04.256726+0000","last_fullsized":"2023-10-18T17:24:04.256726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.247816+0000","last_change":"2023-10-18T17:24:03.750606+0000","last_active":"2023-10-18T17:24:04.247816+0000","last_peered":"2023-10-18T17:24:04.247816+0000","last_clean":"2023-10-18T17:24:04.247816+0000","last_became_active":"2023-10-18T17:24:03.750308+0000","last_became_peered":"2023-10-18T17:24:03.750308+0000","last_unstale":"2023-10-18T17:24:04.247816+0000","last_undegraded":"2023-10-18T17:24:04.247816+0000","last_fullsized":"2023-10-18T17:24:04.247816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.229157+0000","last_change":"2023-10-18T17:23:58.683196+0000","last_active":"2023-10-18T17:24:04.229157+0000","last_peered":"2023-10-18T17:24:04.229157+0000","last_clean":"2023-10-18T17:24:04.229157+0000","last_became_active":"2023-10-18T17:23:58.682724+0000","last_became_peered":"2023-10-18T17:23:58.682724+0000","last_unstale":"2023-10-18T17:24:04.229157+0000","last_undegraded":"2023-10-18T17:24:04.229157+0000","last_fullsized":"2023-10-18T17:24:04.229157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:57.643073+0000","last_clean_scrub_stamp":"2023-10-18T17:23:57.643073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.235276+0000","last_change":"2023-10-18T17:23:56.753692+0000","last_active":"2023-10-18T17:24:04.235276+0000","last_peered":"2023-10-18T17:24:04.235276+0000","last_clean":"2023-10-18T17:24:04.235276+0000","last_became_active":"2023-10-18T17:23:56.752884+0000","last_became_peered":"2023-10-18T17:23:56.752884+0000","last_unstale":"2023-10-18T17:24:04.235276+0000","last_undegraded":"2023-10-18T17:24:04.235276+0000","last_fullsized":"2023-10-18T17:24:04.235276+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:23:55.617219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:23:55.617219+0000","last_clean_scrub_stamp":"2023-10-18T17:23:55.617219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.255995+0000","last_change":"2023-10-18T17:24:04.251396+0000","last_active":"2023-10-18T17:24:04.255995+0000","last_peered":"2023-10-18T17:24:04.255995+0000","last_clean":"2023-10-18T17:24:04.255995+0000","last_became_active":"2023-10-18T17:24:04.251099+0000","last_became_peered":"2023-10-18T17:24:04.251099+0000","last_unstale":"2023-10-18T17:24:04.255995+0000","last_undegraded":"2023-10-18T17:24:04.255995+0000","last_fullsized":"2023-10-18T17:24:04.255995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.242315+0000","last_change":"2023-10-18T17:24:03.749558+0000","last_active":"2023-10-18T17:24:04.242315+0000","last_peered":"2023-10-18T17:24:04.242315+0000","last_clean":"2023-10-18T17:24:04.242315+0000","last_became_active":"2023-10-18T17:24:03.749236+0000","last_became_peered":"2023-10-18T17:24:03.749236+0000","last_unstale":"2023-10-18T17:24:04.242315+0000","last_undegraded":"2023-10-18T17:24:04.242315+0000","last_fullsized":"2023-10-18T17:24:04.242315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.264438+0000","last_change":"2023-10-18T17:24:04.260098+0000","last_active":"2023-10-18T17:24:04.264438+0000","last_peered":"2023-10-18T17:24:04.264438+0000","last_clean":"2023-10-18T17:24:04.264438+0000","last_became_active":"2023-10-18T17:24:04.259824+0000","last_became_peered":"2023-10-18T17:24:04.259824+0000","last_unstale":"2023-10-18T17:24:04.264438+0000","last_undegraded":"2023-10-18T17:24:04.264438+0000","last_fullsized":"2023-10-18T17:24:04.264438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.236722+0000","last_change":"2023-10-18T17:24:03.744238+0000","last_active":"2023-10-18T17:24:04.236722+0000","last_peered":"2023-10-18T17:24:04.236722+0000","last_clean":"2023-10-18T17:24:04.236722+0000","last_became_active":"2023-10-18T17:24:03.743842+0000","last_became_peered":"2023-10-18T17:24:03.743842+0000","last_unstale":"2023-10-18T17:24:04.236722+0000","last_undegraded":"2023-10-18T17:24:04.236722+0000","last_fullsized":"2023-10-18T17:24:04.236722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253546+0000","last_change":"2023-10-18T17:24:04.243386+0000","last_active":"2023-10-18T17:24:04.253546+0000","last_peered":"2023-10-18T17:24:04.253546+0000","last_clean":"2023-10-18T17:24:04.253546+0000","last_became_active":"2023-10-18T17:24:04.242822+0000","last_became_peered":"2023-10-18T17:24:04.242822+0000","last_unstale":"2023-10-18T17:24:04.253546+0000","last_undegraded":"2023-10-18T17:24:04.253546+0000","last_fullsized":"2023-10-18T17:24:04.253546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.237212+0000","last_change":"2023-10-18T17:24:03.749376+0000","last_active":"2023-10-18T17:24:04.237212+0000","last_peered":"2023-10-18T17:24:04.237212+0000","last_clean":"2023-10-18T17:24:04.237212+0000","last_became_active":"2023-10-18T17:24:03.749063+0000","last_became_peered":"2023-10-18T17:24:03.749063+0000","last_unstale":"2023-10-18T17:24:04.237212+0000","last_undegraded":"2023-10-18T17:24:04.237212+0000","last_fullsized":"2023-10-18T17:24:04.237212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258719+0000","last_change":"2023-10-18T17:24:04.248670+0000","last_active":"2023-10-18T17:24:04.258719+0000","last_peered":"2023-10-18T17:24:04.258719+0000","last_clean":"2023-10-18T17:24:04.258719+0000","last_became_active":"2023-10-18T17:24:04.248116+0000","last_became_peered":"2023-10-18T17:24:04.248116+0000","last_unstale":"2023-10-18T17:24:04.258719+0000","last_undegraded":"2023-10-18T17:24:04.258719+0000","last_fullsized":"2023-10-18T17:24:04.258719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.249782+0000","last_change":"2023-10-18T17:24:03.756276+0000","last_active":"2023-10-18T17:24:04.249782+0000","last_peered":"2023-10-18T17:24:04.249782+0000","last_clean":"2023-10-18T17:24:04.249782+0000","last_became_active":"2023-10-18T17:24:03.755989+0000","last_became_peered":"2023-10-18T17:24:03.755989+0000","last_unstale":"2023-10-18T17:24:04.249782+0000","last_undegraded":"2023-10-18T17:24:04.249782+0000","last_fullsized":"2023-10-18T17:24:04.249782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.263775+0000","last_change":"2023-10-18T17:24:04.259017+0000","last_active":"2023-10-18T17:24:04.263775+0000","last_peered":"2023-10-18T17:24:04.263775+0000","last_clean":"2023-10-18T17:24:04.263775+0000","last_became_active":"2023-10-18T17:24:04.258654+0000","last_became_peered":"2023-10-18T17:24:04.258654+0000","last_unstale":"2023-10-18T17:24:04.263775+0000","last_undegraded":"2023-10-18T17:24:04.263775+0000","last_fullsized":"2023-10-18T17:24:04.263775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.229598+0000","last_change":"2023-10-18T17:24:03.761885+0000","last_active":"2023-10-18T17:24:04.229598+0000","last_peered":"2023-10-18T17:24:04.229598+0000","last_clean":"2023-10-18T17:24:04.229598+0000","last_became_active":"2023-10-18T17:24:03.761516+0000","last_became_peered":"2023-10-18T17:24:03.761516+0000","last_unstale":"2023-10-18T17:24:04.229598+0000","last_undegraded":"2023-10-18T17:24:04.229598+0000","last_fullsized":"2023-10-18T17:24:04.229598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.246649+0000","last_change":"2023-10-18T17:24:04.244813+0000","last_active":"2023-10-18T17:24:04.246649+0000","last_peered":"2023-10-18T17:24:04.246649+0000","last_clean":"2023-10-18T17:24:04.246649+0000","last_became_active":"2023-10-18T17:24:04.244199+0000","last_became_peered":"2023-10-18T17:24:04.244199+0000","last_unstale":"2023-10-18T17:24:04.246649+0000","last_undegraded":"2023-10-18T17:24:04.246649+0000","last_fullsized":"2023-10-18T17:24:04.246649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.238947+0000","last_change":"2023-10-18T17:24:03.751418+0000","last_active":"2023-10-18T17:24:04.238947+0000","last_peered":"2023-10-18T17:24:04.238947+0000","last_clean":"2023-10-18T17:24:04.238947+0000","last_became_active":"2023-10-18T17:24:03.751122+0000","last_became_peered":"2023-10-18T17:24:03.751122+0000","last_unstale":"2023-10-18T17:24:04.238947+0000","last_undegraded":"2023-10-18T17:24:04.238947+0000","last_fullsized":"2023-10-18T17:24:04.238947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.251731+0000","last_change":"2023-10-18T17:24:04.250253+0000","last_active":"2023-10-18T17:24:04.251731+0000","last_peered":"2023-10-18T17:24:04.251731+0000","last_clean":"2023-10-18T17:24:04.251731+0000","last_became_active":"2023-10-18T17:24:04.249929+0000","last_became_peered":"2023-10-18T17:24:04.249929+0000","last_unstale":"2023-10-18T17:24:04.251731+0000","last_undegraded":"2023-10-18T17:24:04.251731+0000","last_fullsized":"2023-10-18T17:24:04.251731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.241025+0000","last_change":"2023-10-18T17:24:03.747106+0000","last_active":"2023-10-18T17:24:04.241025+0000","last_peered":"2023-10-18T17:24:04.241025+0000","last_clean":"2023-10-18T17:24:04.241025+0000","last_became_active":"2023-10-18T17:24:03.746799+0000","last_became_peered":"2023-10-18T17:24:03.746799+0000","last_unstale":"2023-10-18T17:24:04.241025+0000","last_undegraded":"2023-10-18T17:24:04.241025+0000","last_fullsized":"2023-10-18T17:24:04.241025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253710+0000","last_change":"2023-10-18T17:24:04.243248+0000","last_active":"2023-10-18T17:24:04.253710+0000","last_peered":"2023-10-18T17:24:04.253710+0000","last_clean":"2023-10-18T17:24:04.253710+0000","last_became_active":"2023-10-18T17:24:04.242922+0000","last_became_peered":"2023-10-18T17:24:04.242922+0000","last_unstale":"2023-10-18T17:24:04.253710+0000","last_undegraded":"2023-10-18T17:24:04.253710+0000","last_fullsized":"2023-10-18T17:24:04.253710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.241757+0000","last_change":"2023-10-18T17:24:03.749039+0000","last_active":"2023-10-18T17:24:04.241757+0000","last_peered":"2023-10-18T17:24:04.241757+0000","last_clean":"2023-10-18T17:24:04.241757+0000","last_became_active":"2023-10-18T17:24:03.748569+0000","last_became_peered":"2023-10-18T17:24:03.748569+0000","last_unstale":"2023-10-18T17:24:04.241757+0000","last_undegraded":"2023-10-18T17:24:04.241757+0000","last_fullsized":"2023-10-18T17:24:04.241757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.247669+0000","last_change":"2023-10-18T17:24:04.241433+0000","last_active":"2023-10-18T17:24:04.247669+0000","last_peered":"2023-10-18T17:24:04.247669+0000","last_clean":"2023-10-18T17:24:04.247669+0000","last_became_active":"2023-10-18T17:24:04.241106+0000","last_became_peered":"2023-10-18T17:24:04.241106+0000","last_unstale":"2023-10-18T17:24:04.247669+0000","last_undegraded":"2023-10-18T17:24:04.247669+0000","last_fullsized":"2023-10-18T17:24:04.247669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.236834+0000","last_change":"2023-10-18T17:24:03.754340+0000","last_active":"2023-10-18T17:24:04.236834+0000","last_peered":"2023-10-18T17:24:04.236834+0000","last_clean":"2023-10-18T17:24:04.236834+0000","last_became_active":"2023-10-18T17:24:03.753704+0000","last_became_peered":"2023-10-18T17:24:03.753704+0000","last_unstale":"2023-10-18T17:24:04.236834+0000","last_undegraded":"2023-10-18T17:24:04.236834+0000","last_fullsized":"2023-10-18T17:24:04.236834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.257849+0000","last_change":"2023-10-18T17:24:04.253968+0000","last_active":"2023-10-18T17:24:04.257849+0000","last_peered":"2023-10-18T17:24:04.257849+0000","last_clean":"2023-10-18T17:24:04.257849+0000","last_became_active":"2023-10-18T17:24:04.253657+0000","last_became_peered":"2023-10-18T17:24:04.253657+0000","last_unstale":"2023-10-18T17:24:04.257849+0000","last_undegraded":"2023-10-18T17:24:04.257849+0000","last_fullsized":"2023-10-18T17:24:04.257849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.235231+0000","last_change":"2023-10-18T17:24:03.747407+0000","last_active":"2023-10-18T17:24:04.235231+0000","last_peered":"2023-10-18T17:24:04.235231+0000","last_clean":"2023-10-18T17:24:04.235231+0000","last_became_active":"2023-10-18T17:24:03.746910+0000","last_became_peered":"2023-10-18T17:24:03.746910+0000","last_unstale":"2023-10-18T17:24:04.235231+0000","last_undegraded":"2023-10-18T17:24:04.235231+0000","last_fullsized":"2023-10-18T17:24:04.235231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.256873+0000","last_change":"2023-10-18T17:24:04.253275+0000","last_active":"2023-10-18T17:24:04.256873+0000","last_peered":"2023-10-18T17:24:04.256873+0000","last_clean":"2023-10-18T17:24:04.256873+0000","last_became_active":"2023-10-18T17:24:04.252982+0000","last_became_peered":"2023-10-18T17:24:04.252982+0000","last_unstale":"2023-10-18T17:24:04.256873+0000","last_undegraded":"2023-10-18T17:24:04.256873+0000","last_fullsized":"2023-10-18T17:24:04.256873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230811+0000","last_change":"2023-10-18T17:24:03.741950+0000","last_active":"2023-10-18T17:24:04.230811+0000","last_peered":"2023-10-18T17:24:04.230811+0000","last_clean":"2023-10-18T17:24:04.230811+0000","last_became_active":"2023-10-18T17:24:03.740801+0000","last_became_peered":"2023-10-18T17:24:03.740801+0000","last_unstale":"2023-10-18T17:24:04.230811+0000","last_undegraded":"2023-10-18T17:24:04.230811+0000","last_fullsized":"2023-10-18T17:24:04.230811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.248716+0000","last_change":"2023-10-18T17:24:04.243107+0000","last_active":"2023-10-18T17:24:04.248716+0000","last_peered":"2023-10-18T17:24:04.248716+0000","last_clean":"2023-10-18T17:24:04.248716+0000","last_became_active":"2023-10-18T17:24:04.242584+0000","last_became_peered":"2023-10-18T17:24:04.242584+0000","last_unstale":"2023-10-18T17:24:04.248716+0000","last_undegraded":"2023-10-18T17:24:04.248716+0000","last_fullsized":"2023-10-18T17:24:04.248716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.237203+0000","last_change":"2023-10-18T17:24:03.747950+0000","last_active":"2023-10-18T17:24:04.237203+0000","last_peered":"2023-10-18T17:24:04.237203+0000","last_clean":"2023-10-18T17:24:04.237203+0000","last_became_active":"2023-10-18T17:24:03.747647+0000","last_became_peered":"2023-10-18T17:24:03.747647+0000","last_unstale":"2023-10-18T17:24:04.237203+0000","last_undegraded":"2023-10-18T17:24:04.237203+0000","last_fullsized":"2023-10-18T17:24:04.237203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.263014+0000","last_change":"2023-10-18T17:24:04.258930+0000","last_active":"2023-10-18T17:24:04.263014+0000","last_peered":"2023-10-18T17:24:04.263014+0000","last_clean":"2023-10-18T17:24:04.263014+0000","last_became_active":"2023-10-18T17:24:04.258630+0000","last_became_peered":"2023-10-18T17:24:04.258630+0000","last_unstale":"2023-10-18T17:24:04.263014+0000","last_undegraded":"2023-10-18T17:24:04.263014+0000","last_fullsized":"2023-10-18T17:24:04.263014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230691+0000","last_change":"2023-10-18T17:24:03.755043+0000","last_active":"2023-10-18T17:24:04.230691+0000","last_peered":"2023-10-18T17:24:04.230691+0000","last_clean":"2023-10-18T17:24:04.230691+0000","last_became_active":"2023-10-18T17:24:03.754677+0000","last_became_peered":"2023-10-18T17:24:03.754677+0000","last_unstale":"2023-10-18T17:24:04.230691+0000","last_undegraded":"2023-10-18T17:24:04.230691+0000","last_fullsized":"2023-10-18T17:24:04.230691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258695+0000","last_change":"2023-10-18T17:24:04.249183+0000","last_active":"2023-10-18T17:24:04.258695+0000","last_peered":"2023-10-18T17:24:04.258695+0000","last_clean":"2023-10-18T17:24:04.258695+0000","last_became_active":"2023-10-18T17:24:04.248236+0000","last_became_peered":"2023-10-18T17:24:04.248236+0000","last_unstale":"2023-10-18T17:24:04.258695+0000","last_undegraded":"2023-10-18T17:24:04.258695+0000","last_fullsized":"2023-10-18T17:24:04.258695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250217+0000","last_change":"2023-10-18T17:24:03.761178+0000","last_active":"2023-10-18T17:24:04.250217+0000","last_peered":"2023-10-18T17:24:04.250217+0000","last_clean":"2023-10-18T17:24:04.250217+0000","last_became_active":"2023-10-18T17:24:03.760202+0000","last_became_peered":"2023-10-18T17:24:03.760202+0000","last_unstale":"2023-10-18T17:24:04.250217+0000","last_undegraded":"2023-10-18T17:24:04.250217+0000","last_fullsized":"2023-10-18T17:24:04.250217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.252873+0000","last_change":"2023-10-18T17:24:04.248750+0000","last_active":"2023-10-18T17:24:04.252873+0000","last_peered":"2023-10-18T17:24:04.252873+0000","last_clean":"2023-10-18T17:24:04.252873+0000","last_became_active":"2023-10-18T17:24:04.248498+0000","last_became_peered":"2023-10-18T17:24:04.248498+0000","last_unstale":"2023-10-18T17:24:04.252873+0000","last_undegraded":"2023-10-18T17:24:04.252873+0000","last_fullsized":"2023-10-18T17:24:04.252873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.241109+0000","last_change":"2023-10-18T17:24:03.748064+0000","last_active":"2023-10-18T17:24:04.241109+0000","last_peered":"2023-10-18T17:24:04.241109+0000","last_clean":"2023-10-18T17:24:04.241109+0000","last_became_active":"2023-10-18T17:24:03.747784+0000","last_became_peered":"2023-10-18T17:24:03.747784+0000","last_unstale":"2023-10-18T17:24:04.241109+0000","last_undegraded":"2023-10-18T17:24:04.241109+0000","last_fullsized":"2023-10-18T17:24:04.241109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.260398+0000","last_change":"2023-10-18T17:24:04.257096+0000","last_active":"2023-10-18T17:24:04.260398+0000","last_peered":"2023-10-18T17:24:04.260398+0000","last_clean":"2023-10-18T17:24:04.260398+0000","last_became_active":"2023-10-18T17:24:04.256815+0000","last_became_peered":"2023-10-18T17:24:04.256815+0000","last_unstale":"2023-10-18T17:24:04.260398+0000","last_undegraded":"2023-10-18T17:24:04.260398+0000","last_fullsized":"2023-10-18T17:24:04.260398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.237620+0000","last_change":"2023-10-18T17:24:03.751468+0000","last_active":"2023-10-18T17:24:04.237620+0000","last_peered":"2023-10-18T17:24:04.237620+0000","last_clean":"2023-10-18T17:24:04.237620+0000","last_became_active":"2023-10-18T17:24:03.751166+0000","last_became_peered":"2023-10-18T17:24:03.751166+0000","last_unstale":"2023-10-18T17:24:04.237620+0000","last_undegraded":"2023-10-18T17:24:04.237620+0000","last_fullsized":"2023-10-18T17:24:04.237620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.247821+0000","last_change":"2023-10-18T17:24:04.242079+0000","last_active":"2023-10-18T17:24:04.247821+0000","last_peered":"2023-10-18T17:24:04.247821+0000","last_clean":"2023-10-18T17:24:04.247821+0000","last_became_active":"2023-10-18T17:24:04.241342+0000","last_became_peered":"2023-10-18T17:24:04.241342+0000","last_unstale":"2023-10-18T17:24:04.247821+0000","last_undegraded":"2023-10-18T17:24:04.247821+0000","last_fullsized":"2023-10-18T17:24:04.247821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.237418+0000","last_change":"2023-10-18T17:24:03.751419+0000","last_active":"2023-10-18T17:24:04.237418+0000","last_peered":"2023-10-18T17:24:04.237418+0000","last_clean":"2023-10-18T17:24:04.237418+0000","last_became_active":"2023-10-18T17:24:03.751118+0000","last_became_peered":"2023-10-18T17:24:03.751118+0000","last_unstale":"2023-10-18T17:24:04.237418+0000","last_undegraded":"2023-10-18T17:24:04.237418+0000","last_fullsized":"2023-10-18T17:24:04.237418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.256009+0000","last_change":"2023-10-18T17:24:04.250969+0000","last_active":"2023-10-18T17:24:04.256009+0000","last_peered":"2023-10-18T17:24:04.256009+0000","last_clean":"2023-10-18T17:24:04.256009+0000","last_became_active":"2023-10-18T17:24:04.250659+0000","last_became_peered":"2023-10-18T17:24:04.250659+0000","last_unstale":"2023-10-18T17:24:04.256009+0000","last_undegraded":"2023-10-18T17:24:04.256009+0000","last_fullsized":"2023-10-18T17:24:04.256009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.241459+0000","last_change":"2023-10-18T17:24:03.752559+0000","last_active":"2023-10-18T17:24:04.241459+0000","last_peered":"2023-10-18T17:24:04.241459+0000","last_clean":"2023-10-18T17:24:04.241459+0000","last_became_active":"2023-10-18T17:24:03.752277+0000","last_became_peered":"2023-10-18T17:24:03.752277+0000","last_unstale":"2023-10-18T17:24:04.241459+0000","last_undegraded":"2023-10-18T17:24:04.241459+0000","last_fullsized":"2023-10-18T17:24:04.241459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253690+0000","last_change":"2023-10-18T17:24:04.248464+0000","last_active":"2023-10-18T17:24:04.253690+0000","last_peered":"2023-10-18T17:24:04.253690+0000","last_clean":"2023-10-18T17:24:04.253690+0000","last_became_active":"2023-10-18T17:24:04.248166+0000","last_became_peered":"2023-10-18T17:24:04.248166+0000","last_unstale":"2023-10-18T17:24:04.253690+0000","last_undegraded":"2023-10-18T17:24:04.253690+0000","last_fullsized":"2023-10-18T17:24:04.253690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.263341+0000","last_change":"2023-10-18T17:24:04.261758+0000","last_active":"2023-10-18T17:24:04.263341+0000","last_peered":"2023-10-18T17:24:04.263341+0000","last_clean":"2023-10-18T17:24:04.263341+0000","last_became_active":"2023-10-18T17:24:04.259803+0000","last_became_peered":"2023-10-18T17:24:04.259803+0000","last_unstale":"2023-10-18T17:24:04.263341+0000","last_undegraded":"2023-10-18T17:24:04.263341+0000","last_fullsized":"2023-10-18T17:24:04.263341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.242129+0000","last_change":"2023-10-18T17:24:03.760642+0000","last_active":"2023-10-18T17:24:04.242129+0000","last_peered":"2023-10-18T17:24:04.242129+0000","last_clean":"2023-10-18T17:24:04.242129+0000","last_became_active":"2023-10-18T17:24:03.759676+0000","last_became_peered":"2023-10-18T17:24:03.759676+0000","last_unstale":"2023-10-18T17:24:04.242129+0000","last_undegraded":"2023-10-18T17:24:04.242129+0000","last_fullsized":"2023-10-18T17:24:04.242129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.247633+0000","last_change":"2023-10-18T17:24:04.239822+0000","last_active":"2023-10-18T17:24:04.247633+0000","last_peered":"2023-10-18T17:24:04.247633+0000","last_clean":"2023-10-18T17:24:04.247633+0000","last_became_active":"2023-10-18T17:24:04.239546+0000","last_became_peered":"2023-10-18T17:24:04.239546+0000","last_unstale":"2023-10-18T17:24:04.247633+0000","last_undegraded":"2023-10-18T17:24:04.247633+0000","last_fullsized":"2023-10-18T17:24:04.247633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.235052+0000","last_change":"2023-10-18T17:24:03.753621+0000","last_active":"2023-10-18T17:24:04.235052+0000","last_peered":"2023-10-18T17:24:04.235052+0000","last_clean":"2023-10-18T17:24:04.235052+0000","last_became_active":"2023-10-18T17:24:03.753297+0000","last_became_peered":"2023-10-18T17:24:03.753297+0000","last_unstale":"2023-10-18T17:24:04.235052+0000","last_undegraded":"2023-10-18T17:24:04.235052+0000","last_fullsized":"2023-10-18T17:24:04.235052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258710+0000","last_change":"2023-10-18T17:24:04.249371+0000","last_active":"2023-10-18T17:24:04.258710+0000","last_peered":"2023-10-18T17:24:04.258710+0000","last_clean":"2023-10-18T17:24:04.258710+0000","last_became_active":"2023-10-18T17:24:04.248843+0000","last_became_peered":"2023-10-18T17:24:04.248843+0000","last_unstale":"2023-10-18T17:24:04.258710+0000","last_undegraded":"2023-10-18T17:24:04.258710+0000","last_fullsized":"2023-10-18T17:24:04.258710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230958+0000","last_change":"2023-10-18T17:24:03.749421+0000","last_active":"2023-10-18T17:24:04.230958+0000","last_peered":"2023-10-18T17:24:04.230958+0000","last_clean":"2023-10-18T17:24:04.230958+0000","last_became_active":"2023-10-18T17:24:03.749120+0000","last_became_peered":"2023-10-18T17:24:03.749120+0000","last_unstale":"2023-10-18T17:24:04.230958+0000","last_undegraded":"2023-10-18T17:24:04.230958+0000","last_fullsized":"2023-10-18T17:24:04.230958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.244602+0000","last_change":"2023-10-18T17:24:04.239958+0000","last_active":"2023-10-18T17:24:04.244602+0000","last_peered":"2023-10-18T17:24:04.244602+0000","last_clean":"2023-10-18T17:24:04.244602+0000","last_became_active":"2023-10-18T17:24:04.239673+0000","last_became_peered":"2023-10-18T17:24:04.239673+0000","last_unstale":"2023-10-18T17:24:04.244602+0000","last_undegraded":"2023-10-18T17:24:04.244602+0000","last_fullsized":"2023-10-18T17:24:04.244602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.237011+0000","last_change":"2023-10-18T17:24:03.745601+0000","last_active":"2023-10-18T17:24:04.237011+0000","last_peered":"2023-10-18T17:24:04.237011+0000","last_clean":"2023-10-18T17:24:04.237011+0000","last_became_active":"2023-10-18T17:24:03.745287+0000","last_became_peered":"2023-10-18T17:24:03.745287+0000","last_unstale":"2023-10-18T17:24:04.237011+0000","last_undegraded":"2023-10-18T17:24:04.237011+0000","last_fullsized":"2023-10-18T17:24:04.237011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.261032+0000","last_change":"2023-10-18T17:24:04.259706+0000","last_active":"2023-10-18T17:24:04.261032+0000","last_peered":"2023-10-18T17:24:04.261032+0000","last_clean":"2023-10-18T17:24:04.261032+0000","last_became_active":"2023-10-18T17:24:04.259232+0000","last_became_peered":"2023-10-18T17:24:04.259232+0000","last_unstale":"2023-10-18T17:24:04.261032+0000","last_undegraded":"2023-10-18T17:24:04.261032+0000","last_fullsized":"2023-10-18T17:24:04.261032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.229099+0000","last_change":"2023-10-18T17:24:03.760958+0000","last_active":"2023-10-18T17:24:04.229099+0000","last_peered":"2023-10-18T17:24:04.229099+0000","last_clean":"2023-10-18T17:24:04.229099+0000","last_became_active":"2023-10-18T17:24:03.760640+0000","last_became_peered":"2023-10-18T17:24:03.760640+0000","last_unstale":"2023-10-18T17:24:04.229099+0000","last_undegraded":"2023-10-18T17:24:04.229099+0000","last_fullsized":"2023-10-18T17:24:04.229099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.253551+0000","last_change":"2023-10-18T17:24:04.243907+0000","last_active":"2023-10-18T17:24:04.253551+0000","last_peered":"2023-10-18T17:24:04.253551+0000","last_clean":"2023-10-18T17:24:04.253551+0000","last_became_active":"2023-10-18T17:24:04.243296+0000","last_became_peered":"2023-10-18T17:24:04.243296+0000","last_unstale":"2023-10-18T17:24:04.253551+0000","last_undegraded":"2023-10-18T17:24:04.253551+0000","last_fullsized":"2023-10-18T17:24:04.253551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.230713+0000","last_change":"2023-10-18T17:24:03.745470+0000","last_active":"2023-10-18T17:24:04.230713+0000","last_peered":"2023-10-18T17:24:04.230713+0000","last_clean":"2023-10-18T17:24:04.230713+0000","last_became_active":"2023-10-18T17:24:03.744361+0000","last_became_peered":"2023-10-18T17:24:03.744361+0000","last_unstale":"2023-10-18T17:24:04.230713+0000","last_undegraded":"2023-10-18T17:24:04.230713+0000","last_fullsized":"2023-10-18T17:24:04.230713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.250503+0000","last_change":"2023-10-18T17:24:04.244429+0000","last_active":"2023-10-18T17:24:04.250503+0000","last_peered":"2023-10-18T17:24:04.250503+0000","last_clean":"2023-10-18T17:24:04.250503+0000","last_became_active":"2023-10-18T17:24:04.244106+0000","last_became_peered":"2023-10-18T17:24:04.244106+0000","last_unstale":"2023-10-18T17:24:04.250503+0000","last_undegraded":"2023-10-18T17:24:04.250503+0000","last_fullsized":"2023-10-18T17:24:04.250503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.228250+0000","last_change":"2023-10-18T17:24:03.748814+0000","last_active":"2023-10-18T17:24:04.228250+0000","last_peered":"2023-10-18T17:24:04.228250+0000","last_clean":"2023-10-18T17:24:04.228250+0000","last_became_active":"2023-10-18T17:24:03.748507+0000","last_became_peered":"2023-10-18T17:24:03.748507+0000","last_unstale":"2023-10-18T17:24:04.228250+0000","last_undegraded":"2023-10-18T17:24:04.228250+0000","last_fullsized":"2023-10-18T17:24:04.228250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.258584+0000","last_change":"2023-10-18T17:24:04.249830+0000","last_active":"2023-10-18T17:24:04.258584+0000","last_peered":"2023-10-18T17:24:04.258584+0000","last_clean":"2023-10-18T17:24:04.258584+0000","last_became_active":"2023-10-18T17:24:04.249500+0000","last_became_peered":"2023-10-18T17:24:04.249500+0000","last_unstale":"2023-10-18T17:24:04.258584+0000","last_undegraded":"2023-10-18T17:24:04.258584+0000","last_fullsized":"2023-10-18T17:24:04.258584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:03.703999+0000","last_clean_scrub_stamp":"2023-10-18T17:24:03.703999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-18T17:24:04.241126+0000","last_change":"2023-10-18T17:24:03.748849+0000","last_active":"2023-10-18T17:24:04.241126+0000","last_peered":"2023-10-18T17:24:04.241126+0000","last_clean":"2023-10-18T17:24:04.241126+0000","last_became_active":"2023-10-18T17:24:03.748240+0000","last_became_peered":"2023-10-18T17:24:03.748240+0000","last_unstale":"2023-10-18T17:24:04.241126+0000","last_undegraded":"2023-10-18T17:24:04.241126+0000","last_fullsized":"2023-10-18T17:24:04.241126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T17:24:02.692740+0000","last_clean_scrub_stamp":"2023-10-18T17:24:02.692740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6120000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.47}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]}]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":84256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":84256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":84256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T17:24:17.834 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-18T17:24:17.834 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-18T17:24:17.834 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-18T17:24:17.835 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:24:18.034 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.027+0000 7f31c0d07700 1 Processor -- start 2023-10-18T17:24:18.035 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.027+0000 7f31c0d07700 1 -- start start 2023-10-18T17:24:18.036 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.031+0000 7f31c0d07700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31bc0658a0 0x7f31bc065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:18.036 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.031+0000 7f31c0d07700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f31bc0c2bf0 0x7f31bc0630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:18.037 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.031+0000 7f31c0d07700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31bc0be2e0 con 0x7f31bc0635d0 2023-10-18T17:24:18.037 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.031+0000 7f31c0d07700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31bc0bda80 con 0x7f31bc0c2bf0 2023-10-18T17:24:18.038 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.031+0000 7f31c0d07700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc06a7c0 con 0x7f31bc0658a0 2023-10-18T17:24:18.039 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.031+0000 7f31bb7fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31bc0658a0 0x7f31bc065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:18.039 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.031+0000 7f31b2ffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f31bc0c2bf0 0x7f31bc0630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:18.040 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.031+0000 7f31bb7fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31bc0658a0 0x7f31bc065c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:32958/0 (socket says 172.21.15.158:32958) 2023-10-18T17:24:18.040 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.031+0000 7f31bb7fe700 1 -- 172.21.15.158:0/2277460786 learned_addr learned my addr 172.21.15.158:0/2277460786 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:18.040 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.031+0000 7f31baffd700 1 -- 172.21.15.158:0/2277460786 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235296093 0 0) 0x7f31bc0be2e0 con 0x7f31bc0635d0 2023-10-18T17:24:18.040 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.031+0000 7f31baffd700 1 -- 172.21.15.158:0/2277460786 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31a80033f0 con 0x7f31bc0635d0 2023-10-18T17:24:18.040 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.031+0000 7f31bb7fe700 1 -- 172.21.15.158:0/2277460786 >> v2:172.21.15.158:3300/0 conn(0x7f31bc0c2bf0 msgr2=0x7f31bc0630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:18.041 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.031+0000 7f31bb7fe700 1 --2- 172.21.15.158:0/2277460786 >> v2:172.21.15.158:3300/0 conn(0x7f31bc0c2bf0 0x7f31bc0630e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:18.041 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.031+0000 7f31bb7fe700 1 -- 172.21.15.158:0/2277460786 >> v1:172.21.15.158:6789/0 conn(0x7f31bc0635d0 legacy=0x7f31bc151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:18.041 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.031+0000 7f31bb7fe700 1 -- 172.21.15.158:0/2277460786 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31bc0be770 con 0x7f31bc0658a0 2023-10-18T17:24:18.042 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.031+0000 7f31bb7fe700 1 --2- 172.21.15.158:0/2277460786 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31bc0658a0 0x7f31bc065c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f31ac006fd0 tx=0x7f31ac0090f0).ready entity=mon.2 client_cookie=79f70f10ae21d344 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:18.042 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.031+0000 7f31baffd700 1 -- 172.21.15.158:0/2277460786 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00f510 con 0x7f31bc0658a0 2023-10-18T17:24:18.042 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.031+0000 7f31baffd700 1 -- 172.21.15.158:0/2277460786 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac00f670 con 0x7f31bc0658a0 2023-10-18T17:24:18.042 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.031+0000 7f31baffd700 1 -- 172.21.15.158:0/2277460786 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00f9f0 con 0x7f31bc0658a0 2023-10-18T17:24:18.043 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.035+0000 7f31c0d07700 1 -- 172.21.15.158:0/2277460786 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31bc0658a0 msgr2=0x7f31bc065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:18.043 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.035+0000 7f31c0d07700 1 --2- 172.21.15.158:0/2277460786 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31bc0658a0 0x7f31bc065c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f31ac006fd0 tx=0x7f31ac0090f0).stop 2023-10-18T17:24:18.044 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.035+0000 7f31c0d07700 1 -- 172.21.15.158:0/2277460786 shutdown_connections 2023-10-18T17:24:18.044 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.035+0000 7f31c0d07700 1 --2- 172.21.15.158:0/2277460786 >> v2:172.21.15.158:3300/0 conn(0x7f31bc0c2bf0 0x7f31bc0630e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:18.044 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.035+0000 7f31c0d07700 1 --2- 172.21.15.158:0/2277460786 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31bc0658a0 0x7f31bc065c80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:18.045 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.035+0000 7f31c0d07700 1 -- 172.21.15.158:0/2277460786 >> 172.21.15.158:0/2277460786 conn(0x7f31bc062ba0 msgr2=0x7f31bc0c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:18.045 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.035+0000 7f31c0d07700 1 -- 172.21.15.158:0/2277460786 shutdown_connections 2023-10-18T17:24:18.045 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.035+0000 7f31c0d07700 1 -- 172.21.15.158:0/2277460786 wait complete. 2023-10-18T17:24:18.045 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.035+0000 7f31c0d07700 1 Processor -- start 2023-10-18T17:24:18.045 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.035+0000 7f31c0d07700 1 -- start start 2023-10-18T17:24:18.047 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31c0d07700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31bc0635d0 0x7f31bc15dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:18.048 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31c0d07700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31bc0658a0 0x7f31bc15f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:18.048 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31c0d07700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31bc0c2bf0 0x7f31bc0c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:18.048 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31c0d07700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc152350 con 0x7f31bc0635d0 2023-10-18T17:24:18.048 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31c0d07700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc0b6210 con 0x7f31bc0658a0 2023-10-18T17:24:18.048 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31c0d07700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc151460 con 0x7f31bc0c2bf0 2023-10-18T17:24:18.049 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31bb7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31bc0635d0 0x7f31bc15dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:18.049 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31bb7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31bc0635d0 0x7f31bc15dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:56358/0 (socket says 172.21.15.158:56358) 2023-10-18T17:24:18.049 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31bb7fe700 1 -- 172.21.15.158:0/1461201727 learned_addr learned my addr 172.21.15.158:0/1461201727 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:18.049 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31b2ffd700 1 --2- 172.21.15.158:0/1461201727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31bc0658a0 0x7f31bc15f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:18.049 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31bbfff700 1 --2- 172.21.15.158:0/1461201727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31bc0c2bf0 0x7f31bc0c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:18.050 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31bb7fe700 1 -- 172.21.15.158:0/1461201727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31bc0c2bf0 msgr2=0x7f31bc0c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:18.050 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31bb7fe700 1 --2- 172.21.15.158:0/1461201727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31bc0c2bf0 0x7f31bc0c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:18.050 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31bb7fe700 1 -- 172.21.15.158:0/1461201727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31bc0658a0 msgr2=0x7f31bc15f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:18.050 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31bb7fe700 1 --2- 172.21.15.158:0/1461201727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31bc0658a0 0x7f31bc15f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:18.050 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31bb7fe700 1 -- 172.21.15.158:0/1461201727 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac009370 con 0x7f31bc0635d0 2023-10-18T17:24:18.051 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31b2ffd700 1 --2- 172.21.15.158:0/1461201727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31bc0658a0 0x7f31bc15f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:18.051 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31bb7fe700 1 --2- 172.21.15.158:0/1461201727 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31bc0635d0 0x7f31bc15dc30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f31bc0bdbc0 tx=0x7f31ac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:18.051 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31b3fff700 1 -- 172.21.15.158:0/1461201727 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00fe80 con 0x7f31bc0635d0 2023-10-18T17:24:18.051 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31b3fff700 1 -- 172.21.15.158:0/1461201727 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac00f7e0 con 0x7f31bc0635d0 2023-10-18T17:24:18.051 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31b3fff700 1 -- 172.21.15.158:0/1461201727 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac01c650 con 0x7f31bc0635d0 2023-10-18T17:24:18.052 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31c0d07700 1 -- 172.21.15.158:0/1461201727 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31bc151740 con 0x7f31bc0635d0 2023-10-18T17:24:18.052 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.039+0000 7f31c0d07700 1 -- 172.21.15.158:0/1461201727 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31bc151d00 con 0x7f31bc0635d0 2023-10-18T17:24:18.053 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.043+0000 7f31c0d07700 1 -- 172.21.15.158:0/1461201727 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31bc046f00 con 0x7f31bc0635d0 2023-10-18T17:24:18.053 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.043+0000 7f31b3fff700 1 -- 172.21.15.158:0/1461201727 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f31ac01ca00 con 0x7f31bc0635d0 2023-10-18T17:24:18.053 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.043+0000 7f31b3fff700 1 --2- 172.21.15.158:0/1461201727 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f319c05a540 0x7f319c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:18.053 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.043+0000 7f31b3fff700 1 -- 172.21.15.158:0/1461201727 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f31ac076400 con 0x7f31bc0635d0 2023-10-18T17:24:18.054 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.043+0000 7f31b2ffd700 1 --2- 172.21.15.158:0/1461201727 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f319c05a540 0x7f319c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:18.054 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.047+0000 7f31b2ffd700 1 --2- 172.21.15.158:0/1461201727 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f319c05a540 0x7f319c05ca00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f31bc0b6130 tx=0x7f31a400b040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:18.058 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.051+0000 7f31b3fff700 1 -- 172.21.15.158:0/1461201727 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f31ac049b20 con 0x7f31bc0635d0 2023-10-18T17:24:18.258 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.251+0000 7f31c0d07700 1 -- 172.21.15.158:0/1461201727 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f31bc05e770 con 0x7f31bc0635d0 2023-10-18T17:24:18.259 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.251+0000 7f31b3fff700 1 -- 172.21.15.158:0/1461201727 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f31ac02a080 con 0x7f31bc0635d0 2023-10-18T17:24:18.259 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:18.261 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.255+0000 7f31c0d07700 1 -- 172.21.15.158:0/1461201727 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f319c05a540 msgr2=0x7f319c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:18.262 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.255+0000 7f31c0d07700 1 --2- 172.21.15.158:0/1461201727 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f319c05a540 0x7f319c05ca00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f31bc0b6130 tx=0x7f31a400b040).stop 2023-10-18T17:24:18.262 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.255+0000 7f31c0d07700 1 -- 172.21.15.158:0/1461201727 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31bc0635d0 msgr2=0x7f31bc15dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:18.262 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.255+0000 7f31c0d07700 1 --2- 172.21.15.158:0/1461201727 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31bc0635d0 0x7f31bc15dc30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f31bc0bdbc0 tx=0x7f31ac017000).stop 2023-10-18T17:24:18.262 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.255+0000 7f31c0d07700 1 -- 172.21.15.158:0/1461201727 shutdown_connections 2023-10-18T17:24:18.263 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.255+0000 7f31c0d07700 1 --2- 172.21.15.158:0/1461201727 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f319c05a540 0x7f319c05ca00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:18.263 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.255+0000 7f31c0d07700 1 --2- 172.21.15.158:0/1461201727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31bc0c2bf0 0x7f31bc0c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:18.263 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.255+0000 7f31c0d07700 1 --2- 172.21.15.158:0/1461201727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31bc0658a0 0x7f31bc15f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:18.263 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.255+0000 7f31c0d07700 1 --2- 172.21.15.158:0/1461201727 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31bc0635d0 0x7f31bc15dc30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:18.263 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.255+0000 7f31c0d07700 1 -- 172.21.15.158:0/1461201727 >> 172.21.15.158:0/1461201727 conn(0x7f31bc062ba0 msgr2=0x7f31bc14e570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:18.264 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.255+0000 7f31c0d07700 1 -- 172.21.15.158:0/1461201727 shutdown_connections 2023-10-18T17:24:18.264 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:18.255+0000 7f31c0d07700 1 -- 172.21.15.158:0/1461201727 wait complete. 2023-10-18T17:24:18.281 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:24:19.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-10-18T17:24:21.282 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:24:21.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.435+0000 7ffb747a9700 1 Processor -- start 2023-10-18T17:24:21.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.439+0000 7ffb747a9700 1 -- start start 2023-10-18T17:24:21.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.439+0000 7ffb747a9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ffb6c065d30 0x7ffb6c0b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:21.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.439+0000 7ffb747a9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6c0bc480 con 0x7ffb6c0b9690 2023-10-18T17:24:21.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.439+0000 7ffb747a9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6c065190 con 0x7ffb6c0bca50 2023-10-18T17:24:21.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.439+0000 7ffb747a9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb6c0bb920 con 0x7ffb6c065d30 2023-10-18T17:24:21.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.439+0000 7ffb72545700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7ffb6c0b9690 0x7ffb6c065620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:34784/0 (socket says 172.21.15.158:34784) 2023-10-18T17:24:21.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.439+0000 7ffb72545700 1 -- 172.21.15.158:0/1060961929 learned_addr learned my addr 172.21.15.158:0/1060961929 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:21.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.439+0000 7ffb72d46700 1 --2- 172.21.15.158:0/1060961929 >> v2:172.21.15.158:3300/0 conn(0x7ffb6c065d30 0x7ffb6c0b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:21.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.439+0000 7ffb71543700 1 -- 172.21.15.158:0/1060961929 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147263054 0 0) 0x7ffb6c0bc480 con 0x7ffb6c0b9690 2023-10-18T17:24:21.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.439+0000 7ffb71543700 1 -- 172.21.15.158:0/1060961929 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb580033f0 con 0x7ffb6c0b9690 2023-10-18T17:24:21.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.439+0000 7ffb71543700 1 -- 172.21.15.158:0/1060961929 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793003668 0 0) 0x7ffb6c065190 con 0x7ffb6c0bca50 2023-10-18T17:24:21.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.439+0000 7ffb71543700 1 -- 172.21.15.158:0/1060961929 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb6c0bc480 con 0x7ffb6c0bca50 2023-10-18T17:24:21.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.439+0000 7ffb72d46700 1 -- 172.21.15.158:0/1060961929 >> v1:172.21.15.183:6789/0 conn(0x7ffb6c0bca50 legacy=0x7ffb6c0b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:21.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.439+0000 7ffb72d46700 1 -- 172.21.15.158:0/1060961929 >> v1:172.21.15.158:6789/0 conn(0x7ffb6c0b9690 legacy=0x7ffb6c065620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:21.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.439+0000 7ffb72d46700 1 -- 172.21.15.158:0/1060961929 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6c0bbbe0 con 0x7ffb6c065d30 2023-10-18T17:24:21.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.439+0000 7ffb72d46700 1 --2- 172.21.15.158:0/1060961929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb6c065d30 0x7ffb6c0b9a70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7ffb64009e60 tx=0x7ffb64009780).ready entity=mon.0 client_cookie=e98b91696dc4c6b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:21.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.443+0000 7ffb71543700 1 -- 172.21.15.158:0/1060961929 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6400e070 con 0x7ffb6c065d30 2023-10-18T17:24:21.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.443+0000 7ffb71543700 1 -- 172.21.15.158:0/1060961929 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6400bab0 con 0x7ffb6c065d30 2023-10-18T17:24:21.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.443+0000 7ffb71543700 1 -- 172.21.15.158:0/1060961929 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6400be30 con 0x7ffb6c065d30 2023-10-18T17:24:21.451 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.443+0000 7ffb747a9700 1 -- 172.21.15.158:0/1060961929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb6c065d30 msgr2=0x7ffb6c0b9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:21.451 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.443+0000 7ffb747a9700 1 --2- 172.21.15.158:0/1060961929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb6c065d30 0x7ffb6c0b9a70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7ffb64009e60 tx=0x7ffb64009780).stop 2023-10-18T17:24:21.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.443+0000 7ffb747a9700 1 -- 172.21.15.158:0/1060961929 shutdown_connections 2023-10-18T17:24:21.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.443+0000 7ffb747a9700 1 --2- 172.21.15.158:0/1060961929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb6c065d30 0x7ffb6c0b9a70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:21.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.443+0000 7ffb747a9700 1 -- 172.21.15.158:0/1060961929 >> 172.21.15.158:0/1060961929 conn(0x7ffb6c0620d0 msgr2=0x7ffb6c0624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:21.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.443+0000 7ffb747a9700 1 -- 172.21.15.158:0/1060961929 shutdown_connections 2023-10-18T17:24:21.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.443+0000 7ffb747a9700 1 -- 172.21.15.158:0/1060961929 wait complete. 2023-10-18T17:24:21.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.443+0000 7ffb747a9700 1 Processor -- start 2023-10-18T17:24:21.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.443+0000 7ffb747a9700 1 -- start start 2023-10-18T17:24:21.455 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb747a9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb6c065d30 0x7ffb6c0b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:21.455 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb747a9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb6c0b9690 0x7ffb6c069310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:21.455 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb747a9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb6c069800 0x7ffb6c14db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:21.455 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb747a9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c160070 con 0x7ffb6c0b9690 2023-10-18T17:24:21.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb747a9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c14f010 con 0x7ffb6c069800 2023-10-18T17:24:21.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb747a9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c160e90 con 0x7ffb6c065d30 2023-10-18T17:24:21.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb72545700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb6c065d30 0x7ffb6c0b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:21.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb72545700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb6c065d30 0x7ffb6c0b85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:41142/0 (socket says 172.21.15.158:41142) 2023-10-18T17:24:21.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb72545700 1 -- 172.21.15.158:0/3527576353 learned_addr learned my addr 172.21.15.158:0/3527576353 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:21.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb72d46700 1 --2- 172.21.15.158:0/3527576353 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb6c069800 0x7ffb6c14db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:21.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb71d44700 1 --2- 172.21.15.158:0/3527576353 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb6c0b9690 0x7ffb6c069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:21.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb71d44700 1 -- 172.21.15.158:0/3527576353 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb6c065d30 msgr2=0x7ffb6c0b85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:21.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb71d44700 1 --2- 172.21.15.158:0/3527576353 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb6c065d30 0x7ffb6c0b85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:21.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb71d44700 1 -- 172.21.15.158:0/3527576353 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb6c069800 msgr2=0x7ffb6c14db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:21.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb71d44700 1 --2- 172.21.15.158:0/3527576353 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb6c069800 0x7ffb6c14db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:21.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb71d44700 1 -- 172.21.15.158:0/3527576353 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb64009a20 con 0x7ffb6c0b9690 2023-10-18T17:24:21.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb72545700 1 --2- 172.21.15.158:0/3527576353 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb6c065d30 0x7ffb6c0b85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:21.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb71d44700 1 --2- 172.21.15.158:0/3527576353 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb6c0b9690 0x7ffb6c069310 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7ffb5c00c450 tx=0x7ffb5c007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:21.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb627fc700 1 -- 172.21.15.158:0/3527576353 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c012400 con 0x7ffb6c0b9690 2023-10-18T17:24:21.459 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb627fc700 1 -- 172.21.15.158:0/3527576353 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5c012560 con 0x7ffb6c0b9690 2023-10-18T17:24:21.459 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb627fc700 1 -- 172.21.15.158:0/3527576353 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c012920 con 0x7ffb6c0b9690 2023-10-18T17:24:21.459 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb747a9700 1 -- 172.21.15.158:0/3527576353 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6c0b8ef0 con 0x7ffb6c0b9690 2023-10-18T17:24:21.459 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.447+0000 7ffb747a9700 1 -- 172.21.15.158:0/3527576353 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6c160560 con 0x7ffb6c0b9690 2023-10-18T17:24:21.460 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.451+0000 7ffb747a9700 1 -- 172.21.15.158:0/3527576353 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb6c06c190 con 0x7ffb6c0b9690 2023-10-18T17:24:21.460 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.451+0000 7ffb627fc700 1 -- 172.21.15.158:0/3527576353 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ffb5c01b3b0 con 0x7ffb6c0b9690 2023-10-18T17:24:21.461 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.451+0000 7ffb627fc700 1 --2- 172.21.15.158:0/3527576353 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ffb5005a510 0x7ffb5005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:21.461 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.451+0000 7ffb627fc700 1 -- 172.21.15.158:0/3527576353 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ffb5c073cc0 con 0x7ffb6c0b9690 2023-10-18T17:24:21.461 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.451+0000 7ffb72545700 1 --2- 172.21.15.158:0/3527576353 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ffb5005a510 0x7ffb5005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:21.461 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.455+0000 7ffb72545700 1 --2- 172.21.15.158:0/3527576353 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ffb5005a510 0x7ffb5005c9d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ffb68005750 tx=0x7ffb68009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:21.466 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.459+0000 7ffb627fc700 1 -- 172.21.15.158:0/3527576353 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7ffb5c047440 con 0x7ffb6c0b9690 2023-10-18T17:24:21.668 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.663+0000 7ffb747a9700 1 -- 172.21.15.158:0/3527576353 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ffb6c0b8ef0 con 0x7ffb6c0b9690 2023-10-18T17:24:21.669 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.663+0000 7ffb627fc700 1 -- 172.21.15.158:0/3527576353 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7ffb6c0b8ef0 con 0x7ffb6c0b9690 2023-10-18T17:24:21.669 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:21.675 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.667+0000 7ffb747a9700 1 -- 172.21.15.158:0/3527576353 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ffb5005a510 msgr2=0x7ffb5005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:21.675 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.667+0000 7ffb747a9700 1 --2- 172.21.15.158:0/3527576353 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ffb5005a510 0x7ffb5005c9d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ffb68005750 tx=0x7ffb68009040).stop 2023-10-18T17:24:21.675 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.667+0000 7ffb747a9700 1 -- 172.21.15.158:0/3527576353 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb6c0b9690 msgr2=0x7ffb6c069310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:21.675 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.667+0000 7ffb747a9700 1 --2- 172.21.15.158:0/3527576353 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb6c0b9690 0x7ffb6c069310 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7ffb5c00c450 tx=0x7ffb5c007bd0).stop 2023-10-18T17:24:21.675 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.667+0000 7ffb747a9700 1 -- 172.21.15.158:0/3527576353 shutdown_connections 2023-10-18T17:24:21.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.667+0000 7ffb747a9700 1 --2- 172.21.15.158:0/3527576353 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ffb5005a510 0x7ffb5005c9d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:21.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.667+0000 7ffb747a9700 1 --2- 172.21.15.158:0/3527576353 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb6c069800 0x7ffb6c14db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:21.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.667+0000 7ffb747a9700 1 --2- 172.21.15.158:0/3527576353 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb6c0b9690 0x7ffb6c069310 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:21.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.667+0000 7ffb747a9700 1 --2- 172.21.15.158:0/3527576353 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb6c065d30 0x7ffb6c0b85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:21.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.667+0000 7ffb747a9700 1 -- 172.21.15.158:0/3527576353 >> 172.21.15.158:0/3527576353 conn(0x7ffb6c0620d0 msgr2=0x7ffb6c0624b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:21.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.667+0000 7ffb747a9700 1 -- 172.21.15.158:0/3527576353 shutdown_connections 2023-10-18T17:24:21.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:21.667+0000 7ffb747a9700 1 -- 172.21.15.158:0/3527576353 wait complete. 2023-10-18T17:24:21.697 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:24:24.699 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:24:24.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f09a55f9700 1 Processor -- start 2023-10-18T17:24:24.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f09a55f9700 1 -- start start 2023-10-18T17:24:24.861 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f09a55f9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f09a0069f20 0x7f09a0065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:24.861 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f09a55f9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a00630e0 0x7f09a014cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:24.861 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f09a55f9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a006a760 con 0x7f09a00658a0 2023-10-18T17:24:24.861 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f09a55f9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a00c2d40 con 0x7f09a0069f20 2023-10-18T17:24:24.862 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f09a55f9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a0150bf0 con 0x7f09a00630e0 2023-10-18T17:24:24.863 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f099f7fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f09a0069f20 0x7f09a0065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:24.863 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f099ffff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f09a00658a0 0x7f09a00c2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:34796/0 (socket says 172.21.15.158:34796) 2023-10-18T17:24:24.864 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f099f7fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f09a0069f20 0x7f09a0065c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:40442/0 (socket says 172.21.15.158:40442) 2023-10-18T17:24:24.864 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f099ffff700 1 -- 172.21.15.158:0/415745271 learned_addr learned my addr 172.21.15.158:0/415745271 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:24.864 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f09a4df8700 1 --2- 172.21.15.158:0/415745271 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a00630e0 0x7f09a014cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:24.864 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f099f7fe700 1 -- 172.21.15.158:0/415745271 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a00630e0 msgr2=0x7f09a014cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:24.864 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f099f7fe700 1 --2- 172.21.15.158:0/415745271 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a00630e0 0x7f09a014cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:24.865 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f099f7fe700 1 -- 172.21.15.158:0/415745271 >> v1:172.21.15.158:6789/0 conn(0x7f09a00658a0 legacy=0x7f09a00c2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:24.865 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f099f7fe700 1 -- 172.21.15.158:0/415745271 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a006a480 con 0x7f09a0069f20 2023-10-18T17:24:24.865 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f099effd700 1 -- 172.21.15.158:0/415745271 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731900482 0 0) 0x7f09a006a760 con 0x7f09a00658a0 2023-10-18T17:24:24.865 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f099f7fe700 1 --2- 172.21.15.158:0/415745271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09a0069f20 0x7f09a0065c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f0994009760 tx=0x7f0994009060).ready entity=mon.0 client_cookie=e3851846dfe8d364 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:24.865 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f099effd700 1 -- 172.21.15.158:0/415745271 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099400b590 con 0x7f09a0069f20 2023-10-18T17:24:24.866 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.855+0000 7f099effd700 1 -- 172.21.15.158:0/415745271 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099400b6f0 con 0x7f09a0069f20 2023-10-18T17:24:24.866 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.859+0000 7f099effd700 1 -- 172.21.15.158:0/415745271 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099400ba70 con 0x7f09a0069f20 2023-10-18T17:24:24.867 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.859+0000 7f09a55f9700 1 -- 172.21.15.158:0/415745271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09a0069f20 msgr2=0x7f09a0065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:24.867 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.859+0000 7f09a55f9700 1 --2- 172.21.15.158:0/415745271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09a0069f20 0x7f09a0065c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f0994009760 tx=0x7f0994009060).stop 2023-10-18T17:24:24.867 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.859+0000 7f09a55f9700 1 -- 172.21.15.158:0/415745271 shutdown_connections 2023-10-18T17:24:24.867 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.859+0000 7f09a55f9700 1 --2- 172.21.15.158:0/415745271 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a00630e0 0x7f09a014cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:24.868 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.859+0000 7f09a55f9700 1 --2- 172.21.15.158:0/415745271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09a0069f20 0x7f09a0065c80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:24.868 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.859+0000 7f09a55f9700 1 -- 172.21.15.158:0/415745271 >> 172.21.15.158:0/415745271 conn(0x7f09a0062ba0 msgr2=0x7f09a00c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:24.868 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.859+0000 7f09a55f9700 1 -- 172.21.15.158:0/415745271 shutdown_connections 2023-10-18T17:24:24.868 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.859+0000 7f09a55f9700 1 -- 172.21.15.158:0/415745271 wait complete. 2023-10-18T17:24:24.869 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.859+0000 7f09a55f9700 1 Processor -- start 2023-10-18T17:24:24.869 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.859+0000 7f09a55f9700 1 -- start start 2023-10-18T17:24:24.871 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f09a55f9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09a00630e0 0x7f09a00ba710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:24.871 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f09a55f9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a00658a0 0x7f09a00a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:24.871 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f09a55f9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09a0069f20 0x7f09a00a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:24.871 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f09a55f9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a01516a0 con 0x7f09a0069f20 2023-10-18T17:24:24.872 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f09a55f9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a014bf30 con 0x7f09a00630e0 2023-10-18T17:24:24.872 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f09a55f9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00bac00 con 0x7f09a00658a0 2023-10-18T17:24:24.872 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f09a4df8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09a0069f20 0x7f09a00a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:24.872 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f099ffff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09a00630e0 0x7f09a00ba710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:24.873 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f09a4df8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09a0069f20 0x7f09a00a53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:40452/0 (socket says 172.21.15.158:40452) 2023-10-18T17:24:24.873 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f099f7fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a00658a0 0x7f09a00a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:24.873 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f09a4df8700 1 -- 172.21.15.158:0/4152816256 learned_addr learned my addr 172.21.15.158:0/4152816256 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:24.873 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f09a4df8700 1 -- 172.21.15.158:0/4152816256 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a00658a0 msgr2=0x7f09a00a4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:24.873 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f09a4df8700 1 --2- 172.21.15.158:0/4152816256 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a00658a0 0x7f09a00a4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:24.874 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f09a4df8700 1 -- 172.21.15.158:0/4152816256 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09a00630e0 msgr2=0x7f09a00ba710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:24.874 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f09a4df8700 1 --2- 172.21.15.158:0/4152816256 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09a00630e0 0x7f09a00ba710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:24.874 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f09a4df8700 1 -- 172.21.15.158:0/4152816256 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09940092a0 con 0x7f09a0069f20 2023-10-18T17:24:24.874 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f09a4df8700 1 --2- 172.21.15.158:0/4152816256 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09a0069f20 0x7f09a00a53c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f099800e900 tx=0x7f0998009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:24.875 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f0987fff700 1 -- 172.21.15.158:0/4152816256 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0998012600 con 0x7f09a0069f20 2023-10-18T17:24:24.875 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f0987fff700 1 -- 172.21.15.158:0/4152816256 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0998012760 con 0x7f09a0069f20 2023-10-18T17:24:24.875 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f0987fff700 1 -- 172.21.15.158:0/4152816256 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0998012ae0 con 0x7f09a0069f20 2023-10-18T17:24:24.875 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f09a55f9700 1 -- 172.21.15.158:0/4152816256 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a0163010 con 0x7f09a0069f20 2023-10-18T17:24:24.875 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.863+0000 7f09a55f9700 1 -- 172.21.15.158:0/4152816256 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a01635d0 con 0x7f09a0069f20 2023-10-18T17:24:24.876 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.867+0000 7f09a55f9700 1 -- 172.21.15.158:0/4152816256 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a0046f00 con 0x7f09a0069f20 2023-10-18T17:24:24.877 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.867+0000 7f0987fff700 1 -- 172.21.15.158:0/4152816256 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f099801b400 con 0x7f09a0069f20 2023-10-18T17:24:24.877 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.867+0000 7f0987fff700 1 --2- 172.21.15.158:0/4152816256 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f098c05a510 0x7f098c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:24.877 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.867+0000 7f0987fff700 1 -- 172.21.15.158:0/4152816256 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0998074bf0 con 0x7f09a0069f20 2023-10-18T17:24:24.877 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.867+0000 7f099ffff700 1 --2- 172.21.15.158:0/4152816256 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f098c05a510 0x7f098c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:24.877 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.871+0000 7f099ffff700 1 --2- 172.21.15.158:0/4152816256 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f098c05a510 0x7f098c05c9d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f0990001a90 tx=0x7f09900014d0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:24.881 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:24.875+0000 7f0987fff700 1 -- 172.21.15.158:0/4152816256 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f09980482b0 con 0x7f09a0069f20 2023-10-18T17:24:25.073 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:25.067+0000 7f09a55f9700 1 -- 172.21.15.158:0/4152816256 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f09a00a8050 con 0x7f09a0069f20 2023-10-18T17:24:25.074 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:25.067+0000 7f0987fff700 1 -- 172.21.15.158:0/4152816256 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f0998016020 con 0x7f09a0069f20 2023-10-18T17:24:25.074 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:25.076 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:25.071+0000 7f09a55f9700 1 -- 172.21.15.158:0/4152816256 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f098c05a510 msgr2=0x7f098c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:25.076 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:25.071+0000 7f09a55f9700 1 --2- 172.21.15.158:0/4152816256 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f098c05a510 0x7f098c05c9d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f0990001a90 tx=0x7f09900014d0).stop 2023-10-18T17:24:25.077 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:25.071+0000 7f09a55f9700 1 -- 172.21.15.158:0/4152816256 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09a0069f20 msgr2=0x7f09a00a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:25.077 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:25.071+0000 7f09a55f9700 1 --2- 172.21.15.158:0/4152816256 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09a0069f20 0x7f09a00a53c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f099800e900 tx=0x7f0998009060).stop 2023-10-18T17:24:25.078 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:25.071+0000 7f09a55f9700 1 -- 172.21.15.158:0/4152816256 shutdown_connections 2023-10-18T17:24:25.078 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:25.071+0000 7f09a55f9700 1 --2- 172.21.15.158:0/4152816256 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f098c05a510 0x7f098c05c9d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:25.078 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:25.071+0000 7f09a55f9700 1 --2- 172.21.15.158:0/4152816256 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f09a0069f20 0x7f09a00a53c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:25.078 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:25.071+0000 7f09a55f9700 1 --2- 172.21.15.158:0/4152816256 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a00658a0 0x7f09a00a4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:25.078 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:25.071+0000 7f09a55f9700 1 --2- 172.21.15.158:0/4152816256 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09a00630e0 0x7f09a00ba710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:25.079 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:25.071+0000 7f09a55f9700 1 -- 172.21.15.158:0/4152816256 >> 172.21.15.158:0/4152816256 conn(0x7f09a0062ba0 msgr2=0x7f09a00c0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:25.079 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:25.071+0000 7f09a55f9700 1 -- 172.21.15.158:0/4152816256 shutdown_connections 2023-10-18T17:24:25.079 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:25.071+0000 7f09a55f9700 1 -- 172.21.15.158:0/4152816256 wait complete. 2023-10-18T17:24:25.098 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:24:26.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~14s 2023-10-18T17:24:28.099 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:24:28.264 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.260+0000 7fcc9d49b700 1 Processor -- start 2023-10-18T17:24:28.265 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.260+0000 7fcc9d49b700 1 -- start start 2023-10-18T17:24:28.267 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.260+0000 7fcc9d49b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcc98062270 0x7fcc98062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:28.267 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.260+0000 7fcc9d49b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcc980c2330 0x7fcc98062b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:28.268 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.260+0000 7fcc9d49b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc980c1790 con 0x7fcc980c0cf0 2023-10-18T17:24:28.268 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.260+0000 7fcc9d49b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc980634d0 con 0x7fcc98062270 2023-10-18T17:24:28.268 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.260+0000 7fcc9d49b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc98068ad0 con 0x7fcc980c2330 2023-10-18T17:24:28.268 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.260+0000 7fcc96ffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcc98062270 0x7fcc98062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:28.268 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.260+0000 7fcc967fc700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fcc980c0cf0 0x7fcc980c1c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:45002/0 (socket says 172.21.15.158:45002) 2023-10-18T17:24:28.269 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.260+0000 7fcc977fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcc980c2330 0x7fcc98062b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:28.269 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.260+0000 7fcc967fc700 1 -- 172.21.15.158:0/1362388720 learned_addr learned my addr 172.21.15.158:0/1362388720 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:28.269 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.260+0000 7fcc96ffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcc98062270 0x7fcc98062650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:40462/0 (socket says 172.21.15.158:40462) 2023-10-18T17:24:28.270 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.264+0000 7fcc95ffb700 1 -- 172.21.15.158:0/1362388720 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555474229 0 0) 0x7fcc980c1790 con 0x7fcc980c0cf0 2023-10-18T17:24:28.271 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.264+0000 7fcc95ffb700 1 -- 172.21.15.158:0/1362388720 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc800033f0 con 0x7fcc980c0cf0 2023-10-18T17:24:28.271 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.264+0000 7fcc977fe700 1 -- 172.21.15.158:0/1362388720 >> v2:172.21.15.158:3300/0 conn(0x7fcc98062270 msgr2=0x7fcc98062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:28.271 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.264+0000 7fcc977fe700 1 --2- 172.21.15.158:0/1362388720 >> v2:172.21.15.158:3300/0 conn(0x7fcc98062270 0x7fcc98062650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:28.271 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.264+0000 7fcc977fe700 1 -- 172.21.15.158:0/1362388720 >> v1:172.21.15.183:6789/0 conn(0x7fcc980c0cf0 legacy=0x7fcc980c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:28.272 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.264+0000 7fcc977fe700 1 -- 172.21.15.158:0/1362388720 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc98068db0 con 0x7fcc980c2330 2023-10-18T17:24:28.272 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.264+0000 7fcc977fe700 1 --2- 172.21.15.158:0/1362388720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc980c2330 0x7fcc98062b40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fcc980c4220 tx=0x7fcc90009780).ready entity=mon.1 client_cookie=8354a7ef486a2a57 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:28.272 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.264+0000 7fcc95ffb700 1 -- 172.21.15.158:0/1362388720 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9000e070 con 0x7fcc980c2330 2023-10-18T17:24:28.272 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.264+0000 7fcc95ffb700 1 -- 172.21.15.158:0/1362388720 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9000bab0 con 0x7fcc980c2330 2023-10-18T17:24:28.272 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.264+0000 7fcc95ffb700 1 -- 172.21.15.158:0/1362388720 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9000be30 con 0x7fcc980c2330 2023-10-18T17:24:28.273 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.264+0000 7fcc9d49b700 1 -- 172.21.15.158:0/1362388720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc980c2330 msgr2=0x7fcc98062b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:28.273 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.264+0000 7fcc9d49b700 1 --2- 172.21.15.158:0/1362388720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc980c2330 0x7fcc98062b40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fcc980c4220 tx=0x7fcc90009780).stop 2023-10-18T17:24:28.273 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.264+0000 7fcc9d49b700 1 -- 172.21.15.158:0/1362388720 shutdown_connections 2023-10-18T17:24:28.273 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.264+0000 7fcc9d49b700 1 --2- 172.21.15.158:0/1362388720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc980c2330 0x7fcc98062b40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:28.274 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.264+0000 7fcc9d49b700 1 --2- 172.21.15.158:0/1362388720 >> v2:172.21.15.158:3300/0 conn(0x7fcc98062270 0x7fcc98062650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:28.274 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.264+0000 7fcc9d49b700 1 -- 172.21.15.158:0/1362388720 >> 172.21.15.158:0/1362388720 conn(0x7fcc980658b0 msgr2=0x7fcc98065c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:28.274 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.264+0000 7fcc9d49b700 1 -- 172.21.15.158:0/1362388720 shutdown_connections 2023-10-18T17:24:28.274 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.264+0000 7fcc9d49b700 1 -- 172.21.15.158:0/1362388720 wait complete. 2023-10-18T17:24:28.276 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.268+0000 7fcc9d49b700 1 Processor -- start 2023-10-18T17:24:28.276 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.268+0000 7fcc9d49b700 1 -- start start 2023-10-18T17:24:28.277 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.268+0000 7fcc9d49b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc98062270 0x7fcc980a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:28.277 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.268+0000 7fcc9d49b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc980c0cf0 0x7fcc980c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:28.277 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.268+0000 7fcc9d49b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc980c2330 0x7fcc9815feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:28.277 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.268+0000 7fcc9d49b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc98163140 con 0x7fcc98062270 2023-10-18T17:24:28.277 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.268+0000 7fcc9d49b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc98163420 con 0x7fcc980c0cf0 2023-10-18T17:24:28.278 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.268+0000 7fcc9d49b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc98163700 con 0x7fcc980c2330 2023-10-18T17:24:28.278 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.268+0000 7fcc96ffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc98062270 0x7fcc980a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:28.278 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.268+0000 7fcc977fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc980c2330 0x7fcc9815feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:28.278 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.268+0000 7fcc977fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc980c2330 0x7fcc9815feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:41184/0 (socket says 172.21.15.158:41184) 2023-10-18T17:24:28.278 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.268+0000 7fcc977fe700 1 -- 172.21.15.158:0/3672040823 learned_addr learned my addr 172.21.15.158:0/3672040823 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:28.279 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.268+0000 7fcc967fc700 1 --2- 172.21.15.158:0/3672040823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc980c0cf0 0x7fcc980c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:28.279 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.268+0000 7fcc977fe700 1 -- 172.21.15.158:0/3672040823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc980c0cf0 msgr2=0x7fcc980c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:28.279 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.268+0000 7fcc977fe700 1 --2- 172.21.15.158:0/3672040823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc980c0cf0 0x7fcc980c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:28.279 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.268+0000 7fcc977fe700 1 -- 172.21.15.158:0/3672040823 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc98062270 msgr2=0x7fcc980a5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:28.279 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.268+0000 7fcc977fe700 1 --2- 172.21.15.158:0/3672040823 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc98062270 0x7fcc980a5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:28.280 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.268+0000 7fcc977fe700 1 -- 172.21.15.158:0/3672040823 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc90009a20 con 0x7fcc980c2330 2023-10-18T17:24:28.280 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.272+0000 7fcc977fe700 1 --2- 172.21.15.158:0/3672040823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc980c2330 0x7fcc9815feb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fcc9000b610 tx=0x7fcc90009780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:28.280 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.272+0000 7fcc7effd700 1 -- 172.21.15.158:0/3672040823 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9001d630 con 0x7fcc980c2330 2023-10-18T17:24:28.280 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.272+0000 7fcc7effd700 1 -- 172.21.15.158:0/3672040823 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9001d790 con 0x7fcc980c2330 2023-10-18T17:24:28.280 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.272+0000 7fcc9d49b700 1 -- 172.21.15.158:0/3672040823 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc981639e0 con 0x7fcc980c2330 2023-10-18T17:24:28.280 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.272+0000 7fcc7effd700 1 -- 172.21.15.158:0/3672040823 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9001db30 con 0x7fcc980c2330 2023-10-18T17:24:28.281 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.272+0000 7fcc9d49b700 1 -- 172.21.15.158:0/3672040823 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc980bd9a0 con 0x7fcc980c2330 2023-10-18T17:24:28.282 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.272+0000 7fcc9d49b700 1 -- 172.21.15.158:0/3672040823 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc98046f00 con 0x7fcc980c2330 2023-10-18T17:24:28.282 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.272+0000 7fcc7effd700 1 -- 172.21.15.158:0/3672040823 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcc90026410 con 0x7fcc980c2330 2023-10-18T17:24:28.282 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.276+0000 7fcc7effd700 1 --2- 172.21.15.158:0/3672040823 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcc8405a4e0 0x7fcc8405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:28.282 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.276+0000 7fcc7effd700 1 -- 172.21.15.158:0/3672040823 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcc90076590 con 0x7fcc980c2330 2023-10-18T17:24:28.282 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.276+0000 7fcc96ffd700 1 --2- 172.21.15.158:0/3672040823 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcc8405a4e0 0x7fcc8405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:28.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.276+0000 7fcc96ffd700 1 --2- 172.21.15.158:0/3672040823 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcc8405a4e0 0x7fcc8405c9a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fcc88009c30 tx=0x7fcc88009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:28.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.284+0000 7fcc7effd700 1 -- 172.21.15.158:0/3672040823 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fcc90049d10 con 0x7fcc980c2330 2023-10-18T17:24:28.488 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.484+0000 7fcc9d49b700 1 -- 172.21.15.158:0/3672040823 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcc98163840 con 0x7fcc980c2330 2023-10-18T17:24:28.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.484+0000 7fcc7effd700 1 -- 172.21.15.158:0/3672040823 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fcc98163840 con 0x7fcc980c2330 2023-10-18T17:24:28.489 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:28.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.488+0000 7fcc9d49b700 1 -- 172.21.15.158:0/3672040823 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcc8405a4e0 msgr2=0x7fcc8405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:28.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.488+0000 7fcc9d49b700 1 --2- 172.21.15.158:0/3672040823 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcc8405a4e0 0x7fcc8405c9a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fcc88009c30 tx=0x7fcc88009060).stop 2023-10-18T17:24:28.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.488+0000 7fcc9d49b700 1 -- 172.21.15.158:0/3672040823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc980c2330 msgr2=0x7fcc9815feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:28.494 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.488+0000 7fcc9d49b700 1 --2- 172.21.15.158:0/3672040823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc980c2330 0x7fcc9815feb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fcc9000b610 tx=0x7fcc90009780).stop 2023-10-18T17:24:28.494 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.488+0000 7fcc9d49b700 1 -- 172.21.15.158:0/3672040823 shutdown_connections 2023-10-18T17:24:28.494 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.488+0000 7fcc9d49b700 1 --2- 172.21.15.158:0/3672040823 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcc8405a4e0 0x7fcc8405c9a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:28.494 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.488+0000 7fcc9d49b700 1 --2- 172.21.15.158:0/3672040823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc980c2330 0x7fcc9815feb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:28.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.488+0000 7fcc9d49b700 1 --2- 172.21.15.158:0/3672040823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc980c0cf0 0x7fcc980c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:28.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.488+0000 7fcc9d49b700 1 --2- 172.21.15.158:0/3672040823 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc98062270 0x7fcc980a5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:28.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.488+0000 7fcc9d49b700 1 -- 172.21.15.158:0/3672040823 >> 172.21.15.158:0/3672040823 conn(0x7fcc980658b0 msgr2=0x7fcc98150e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:28.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.488+0000 7fcc9d49b700 1 -- 172.21.15.158:0/3672040823 shutdown_connections 2023-10-18T17:24:28.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:28.488+0000 7fcc9d49b700 1 -- 172.21.15.158:0/3672040823 wait complete. 2023-10-18T17:24:28.515 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:24:31.516 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:24:31.672 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.668+0000 7f8b8541b700 1 Processor -- start 2023-10-18T17:24:31.672 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.668+0000 7f8b8541b700 1 -- start start 2023-10-18T17:24:31.674 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.668+0000 7f8b8541b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b8014b1d0 0x7f8b8014e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:31.674 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.668+0000 7f8b8541b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8b8014b5b0 0x7f8b800bcd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:31.674 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.668+0000 7f8b8541b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b8014dd30 con 0x7f8b800bf8d0 2023-10-18T17:24:31.674 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.668+0000 7f8b8541b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b80062430 con 0x7f8b8014b5b0 2023-10-18T17:24:31.675 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.668+0000 7f8b8541b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b80062710 con 0x7f8b8014b1d0 2023-10-18T17:24:31.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.668+0000 7f8b7effd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b8014b1d0 0x7f8b8014e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:31.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.668+0000 7f8b7ffff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f8b800bf8d0 0x7f8b80151300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:55866/0 (socket says 172.21.15.158:55866) 2023-10-18T17:24:31.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.668+0000 7f8b7effd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b8014b1d0 0x7f8b8014e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:55924/0 (socket says 172.21.15.158:55924) 2023-10-18T17:24:31.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.668+0000 7f8b7ffff700 1 -- 172.21.15.158:0/707245507 learned_addr learned my addr 172.21.15.158:0/707245507 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:31.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.668+0000 7f8b77fff700 1 --2- 172.21.15.158:0/707245507 >> v2:172.21.15.158:3300/0 conn(0x7f8b8014b5b0 0x7f8b800bcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:31.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.672+0000 7f8b7e7fc700 1 -- 172.21.15.158:0/707245507 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869743885 0 0) 0x7f8b8014dd30 con 0x7f8b800bf8d0 2023-10-18T17:24:31.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.672+0000 7f8b7e7fc700 1 -- 172.21.15.158:0/707245507 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b6c0033f0 con 0x7f8b800bf8d0 2023-10-18T17:24:31.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.672+0000 7f8b7effd700 1 -- 172.21.15.158:0/707245507 >> v2:172.21.15.158:3300/0 conn(0x7f8b8014b5b0 msgr2=0x7f8b800bcd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:31.678 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.672+0000 7f8b7effd700 1 --2- 172.21.15.158:0/707245507 >> v2:172.21.15.158:3300/0 conn(0x7f8b8014b5b0 0x7f8b800bcd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:31.678 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.672+0000 7f8b7effd700 1 -- 172.21.15.158:0/707245507 >> v1:172.21.15.158:6789/0 conn(0x7f8b800bf8d0 legacy=0x7f8b80151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:31.678 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.672+0000 7f8b7effd700 1 -- 172.21.15.158:0/707245507 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b800629f0 con 0x7f8b8014b1d0 2023-10-18T17:24:31.678 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.672+0000 7f8b7effd700 1 --2- 172.21.15.158:0/707245507 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b8014b1d0 0x7f8b8014e510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8b70009760 tx=0x7f8b70009060).ready entity=mon.2 client_cookie=8f43d3d59f03dab6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:31.679 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.672+0000 7f8b7e7fc700 1 -- 172.21.15.158:0/707245507 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7000d4a0 con 0x7f8b8014b1d0 2023-10-18T17:24:31.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.672+0000 7f8b7e7fc700 1 -- 172.21.15.158:0/707245507 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7000d600 con 0x7f8b8014b1d0 2023-10-18T17:24:31.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.672+0000 7f8b7e7fc700 1 -- 172.21.15.158:0/707245507 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7000d980 con 0x7f8b8014b1d0 2023-10-18T17:24:31.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.672+0000 7f8b8541b700 1 -- 172.21.15.158:0/707245507 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b8014b1d0 msgr2=0x7f8b8014e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:31.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.672+0000 7f8b8541b700 1 --2- 172.21.15.158:0/707245507 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b8014b1d0 0x7f8b8014e510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8b70009760 tx=0x7f8b70009060).stop 2023-10-18T17:24:31.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.672+0000 7f8b8541b700 1 -- 172.21.15.158:0/707245507 shutdown_connections 2023-10-18T17:24:31.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.672+0000 7f8b8541b700 1 --2- 172.21.15.158:0/707245507 >> v2:172.21.15.158:3300/0 conn(0x7f8b8014b5b0 0x7f8b800bcd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:31.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.672+0000 7f8b8541b700 1 --2- 172.21.15.158:0/707245507 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b8014b1d0 0x7f8b8014e510 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:31.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.672+0000 7f8b8541b700 1 -- 172.21.15.158:0/707245507 >> 172.21.15.158:0/707245507 conn(0x7f8b800699e0 msgr2=0x7f8b80069df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:31.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.672+0000 7f8b8541b700 1 -- 172.21.15.158:0/707245507 shutdown_connections 2023-10-18T17:24:31.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.672+0000 7f8b8541b700 1 -- 172.21.15.158:0/707245507 wait complete. 2023-10-18T17:24:31.682 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.676+0000 7f8b8541b700 1 Processor -- start 2023-10-18T17:24:31.684 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.676+0000 7f8b8541b700 1 -- start start 2023-10-18T17:24:31.684 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.676+0000 7f8b8541b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b800bf8d0 0x7f8b80150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:31.684 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.676+0000 7f8b8541b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8b8014b1d0 0x7f8b800bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:31.684 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.676+0000 7f8b8541b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b800c0340 0x7f8b8015fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:31.684 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.676+0000 7f8b8541b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b80150000 con 0x7f8b8014b1d0 2023-10-18T17:24:31.685 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.676+0000 7f8b8541b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b80150c20 con 0x7f8b800bf8d0 2023-10-18T17:24:31.685 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.676+0000 7f8b8541b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b80155ff0 con 0x7f8b800c0340 2023-10-18T17:24:31.685 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.676+0000 7f8b77fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8b8014b1d0 0x7f8b800bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:31.685 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.676+0000 7f8b77fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8b8014b1d0 0x7f8b800bfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:35380/0 (socket says 172.21.15.158:35380) 2023-10-18T17:24:31.685 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.676+0000 7f8b77fff700 1 -- 172.21.15.158:0/1404653371 learned_addr learned my addr 172.21.15.158:0/1404653371 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:31.686 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.676+0000 7f8b7effd700 1 --2- 172.21.15.158:0/1404653371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b800bf8d0 0x7f8b80150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:31.686 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.676+0000 7f8b7ffff700 1 --2- 172.21.15.158:0/1404653371 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b800c0340 0x7f8b8015fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:31.686 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.676+0000 7f8b77fff700 1 -- 172.21.15.158:0/1404653371 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b800c0340 msgr2=0x7f8b8015fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:31.686 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.676+0000 7f8b77fff700 1 --2- 172.21.15.158:0/1404653371 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b800c0340 0x7f8b8015fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:31.686 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.676+0000 7f8b77fff700 1 -- 172.21.15.158:0/1404653371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b800bf8d0 msgr2=0x7f8b80150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:31.687 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.676+0000 7f8b77fff700 1 --2- 172.21.15.158:0/1404653371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b800bf8d0 0x7f8b80150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:31.687 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.676+0000 7f8b77fff700 1 -- 172.21.15.158:0/1404653371 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b700092a0 con 0x7f8b8014b1d0 2023-10-18T17:24:31.687 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.680+0000 7f8b77fff700 1 --2- 172.21.15.158:0/1404653371 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8b8014b1d0 0x7f8b800bfe50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f8b6800e900 tx=0x7f8b68006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:31.687 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.680+0000 7f8b76ffd700 1 -- 172.21.15.158:0/1404653371 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b680093f0 con 0x7f8b8014b1d0 2023-10-18T17:24:31.687 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.680+0000 7f8b76ffd700 1 -- 172.21.15.158:0/1404653371 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b68012600 con 0x7f8b8014b1d0 2023-10-18T17:24:31.688 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.680+0000 7f8b8541b700 1 -- 172.21.15.158:0/1404653371 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8014f130 con 0x7f8b8014b1d0 2023-10-18T17:24:31.688 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.680+0000 7f8b76ffd700 1 -- 172.21.15.158:0/1404653371 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b68012980 con 0x7f8b8014b1d0 2023-10-18T17:24:31.688 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.680+0000 7f8b8541b700 1 -- 172.21.15.158:0/1404653371 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8014f6d0 con 0x7f8b8014b1d0 2023-10-18T17:24:31.689 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.680+0000 7f8b8541b700 1 -- 172.21.15.158:0/1404653371 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8015f7f0 con 0x7f8b8014b1d0 2023-10-18T17:24:31.689 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.680+0000 7f8b76ffd700 1 -- 172.21.15.158:0/1404653371 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8b68012d30 con 0x7f8b8014b1d0 2023-10-18T17:24:31.689 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.684+0000 7f8b76ffd700 1 --2- 172.21.15.158:0/1404653371 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f8b6005a540 0x7f8b6005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:31.689 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.684+0000 7f8b76ffd700 1 -- 172.21.15.158:0/1404653371 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8b68074a60 con 0x7f8b8014b1d0 2023-10-18T17:24:31.690 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.684+0000 7f8b7effd700 1 --2- 172.21.15.158:0/1404653371 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f8b6005a540 0x7f8b6005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:31.690 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.684+0000 7f8b7effd700 1 --2- 172.21.15.158:0/1404653371 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f8b6005a540 0x7f8b6005ca00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f8b7000d260 tx=0x7f8b70016000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:31.694 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.688+0000 7f8b76ffd700 1 -- 172.21.15.158:0/1404653371 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f8b68048240 con 0x7f8b8014b1d0 2023-10-18T17:24:31.887 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.884+0000 7f8b8541b700 1 -- 172.21.15.158:0/1404653371 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8b80062cd0 con 0x7f8b8014b1d0 2023-10-18T17:24:31.888 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.884+0000 7f8b76ffd700 1 -- 172.21.15.158:0/1404653371 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f8b6804b860 con 0x7f8b8014b1d0 2023-10-18T17:24:31.888 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:31.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.884+0000 7f8b8541b700 1 -- 172.21.15.158:0/1404653371 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f8b6005a540 msgr2=0x7f8b6005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:31.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.884+0000 7f8b8541b700 1 --2- 172.21.15.158:0/1404653371 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f8b6005a540 0x7f8b6005ca00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f8b7000d260 tx=0x7f8b70016000).stop 2023-10-18T17:24:31.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.884+0000 7f8b8541b700 1 -- 172.21.15.158:0/1404653371 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8b8014b1d0 msgr2=0x7f8b800bfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:31.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.884+0000 7f8b8541b700 1 --2- 172.21.15.158:0/1404653371 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8b8014b1d0 0x7f8b800bfe50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f8b6800e900 tx=0x7f8b68006f40).stop 2023-10-18T17:24:31.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.888+0000 7f8b8541b700 1 -- 172.21.15.158:0/1404653371 shutdown_connections 2023-10-18T17:24:31.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.888+0000 7f8b8541b700 1 --2- 172.21.15.158:0/1404653371 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f8b6005a540 0x7f8b6005ca00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:31.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.888+0000 7f8b8541b700 1 --2- 172.21.15.158:0/1404653371 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b800c0340 0x7f8b8015fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:31.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.888+0000 7f8b8541b700 1 --2- 172.21.15.158:0/1404653371 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8b8014b1d0 0x7f8b800bfe50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:31.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.888+0000 7f8b8541b700 1 --2- 172.21.15.158:0/1404653371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b800bf8d0 0x7f8b80150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:31.893 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.888+0000 7f8b8541b700 1 -- 172.21.15.158:0/1404653371 >> 172.21.15.158:0/1404653371 conn(0x7f8b800699e0 msgr2=0x7f8b80063410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:31.893 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.888+0000 7f8b8541b700 1 -- 172.21.15.158:0/1404653371 shutdown_connections 2023-10-18T17:24:31.893 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:31.888+0000 7f8b8541b700 1 -- 172.21.15.158:0/1404653371 wait complete. 2023-10-18T17:24:31.912 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:24:33.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~20s 2023-10-18T17:24:33.818 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:24:33.825 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:24:34.914 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:24:35.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.076+0000 7fb3f35a9700 1 Processor -- start 2023-10-18T17:24:35.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.076+0000 7fb3f35a9700 1 -- start start 2023-10-18T17:24:35.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3f35a9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3ec0b9690 0x7fb3ec0b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:35.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3f35a9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb3ec0bca50 0x7fb3ec14dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:35.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3f35a9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb3ec065620 0x7fb3ec065a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:35.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3f35a9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3ec0bc480 con 0x7fb3ec065620 2023-10-18T17:24:35.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3f35a9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3ec065190 con 0x7fb3ec0bca50 2023-10-18T17:24:35.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3f35a9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec0bb920 con 0x7fb3ec0b9690 2023-10-18T17:24:35.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3f1b46700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb3ec065620 0x7fb3ec065a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:35.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3f1b46700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb3ec065620 0x7fb3ec065a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:35390/0 (socket says 172.21.15.158:35390) 2023-10-18T17:24:35.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3f1b46700 1 -- 172.21.15.158:0/3207890701 learned_addr learned my addr 172.21.15.158:0/3207890701 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:35.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3f1345700 1 --2- 172.21.15.158:0/3207890701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3ec0b9690 0x7fb3ec0b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:35.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3f0b44700 1 --2- 172.21.15.158:0/3207890701 >> v2:172.21.15.183:3300/0 conn(0x7fb3ec0bca50 0x7fb3ec14dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:35.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3f1b46700 1 -- 172.21.15.158:0/3207890701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3ec0b9690 msgr2=0x7fb3ec0b9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:35.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3f1b46700 1 --2- 172.21.15.158:0/3207890701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3ec0b9690 0x7fb3ec0b9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:35.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3f1b46700 1 -- 172.21.15.158:0/3207890701 >> v2:172.21.15.183:3300/0 conn(0x7fb3ec0bca50 msgr2=0x7fb3ec14dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:35.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3f1b46700 1 --2- 172.21.15.158:0/3207890701 >> v2:172.21.15.183:3300/0 conn(0x7fb3ec0bca50 0x7fb3ec14dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:35.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3f1b46700 1 -- 172.21.15.158:0/3207890701 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec0bbbe0 con 0x7fb3ec065620 2023-10-18T17:24:35.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3f0b44700 1 --2- 172.21.15.158:0/3207890701 >> v2:172.21.15.183:3300/0 conn(0x7fb3ec0bca50 0x7fb3ec14dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:24:35.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3f1b46700 1 --2- 172.21.15.158:0/3207890701 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ec065620 0x7fb3ec065a40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fb3ec067960 tx=0x7fb3e4009840).ready entity=mon.0 client_cookie=5bd9211328b1eef3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:35.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3e3fff700 1 -- 172.21.15.158:0/3207890701 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e400e070 con 0x7fb3ec065620 2023-10-18T17:24:35.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3e3fff700 1 -- 172.21.15.158:0/3207890701 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e400ba20 con 0x7fb3ec065620 2023-10-18T17:24:35.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.080+0000 7fb3e3fff700 1 -- 172.21.15.158:0/3207890701 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e400bda0 con 0x7fb3ec065620 2023-10-18T17:24:35.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.084+0000 7fb3f35a9700 1 -- 172.21.15.158:0/3207890701 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ec065620 msgr2=0x7fb3ec065a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:35.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.084+0000 7fb3f35a9700 1 --2- 172.21.15.158:0/3207890701 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ec065620 0x7fb3ec065a40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fb3ec067960 tx=0x7fb3e4009840).stop 2023-10-18T17:24:35.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.084+0000 7fb3f35a9700 1 -- 172.21.15.158:0/3207890701 shutdown_connections 2023-10-18T17:24:35.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.084+0000 7fb3f35a9700 1 --2- 172.21.15.158:0/3207890701 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ec065620 0x7fb3ec065a40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:35.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.084+0000 7fb3f35a9700 1 --2- 172.21.15.158:0/3207890701 >> v2:172.21.15.183:3300/0 conn(0x7fb3ec0bca50 0x7fb3ec14dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:35.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.084+0000 7fb3f35a9700 1 --2- 172.21.15.158:0/3207890701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3ec0b9690 0x7fb3ec0b9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:35.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.084+0000 7fb3f35a9700 1 -- 172.21.15.158:0/3207890701 >> 172.21.15.158:0/3207890701 conn(0x7fb3ec0620d0 msgr2=0x7fb3ec0624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:35.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.084+0000 7fb3f35a9700 1 -- 172.21.15.158:0/3207890701 shutdown_connections 2023-10-18T17:24:35.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.084+0000 7fb3f35a9700 1 -- 172.21.15.158:0/3207890701 wait complete. 2023-10-18T17:24:35.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.088+0000 7fb3f35a9700 1 Processor -- start 2023-10-18T17:24:35.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.088+0000 7fb3f35a9700 1 -- start start 2023-10-18T17:24:35.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.088+0000 7fb3f35a9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ec065620 0x7fb3ec0bd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:35.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.088+0000 7fb3f35a9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3ec0b9690 0x7fb3ec15fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:35.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.088+0000 7fb3f35a9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3ec151360 0x7fb3ec160380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:35.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.088+0000 7fb3f35a9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec068270 con 0x7fb3ec065620 2023-10-18T17:24:35.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.088+0000 7fb3f35a9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec160870 con 0x7fb3ec0b9690 2023-10-18T17:24:35.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.088+0000 7fb3f35a9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec1630b0 con 0x7fb3ec151360 2023-10-18T17:24:35.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.092+0000 7fb3f1345700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ec065620 0x7fb3ec0bd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:35.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.092+0000 7fb3f1345700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ec065620 0x7fb3ec0bd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:35394/0 (socket says 172.21.15.158:35394) 2023-10-18T17:24:35.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.092+0000 7fb3f1345700 1 -- 172.21.15.158:0/347729284 learned_addr learned my addr 172.21.15.158:0/347729284 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:35.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.092+0000 7fb3f0b44700 1 --2- 172.21.15.158:0/347729284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3ec0b9690 0x7fb3ec15fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:35.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.092+0000 7fb3f1b46700 1 --2- 172.21.15.158:0/347729284 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3ec151360 0x7fb3ec160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:35.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.092+0000 7fb3f1345700 1 -- 172.21.15.158:0/347729284 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3ec151360 msgr2=0x7fb3ec160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:35.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.092+0000 7fb3f1345700 1 --2- 172.21.15.158:0/347729284 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3ec151360 0x7fb3ec160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:35.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.092+0000 7fb3f1345700 1 -- 172.21.15.158:0/347729284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3ec0b9690 msgr2=0x7fb3ec15fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:35.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.092+0000 7fb3f1345700 1 --2- 172.21.15.158:0/347729284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3ec0b9690 0x7fb3ec15fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:35.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.092+0000 7fb3f1345700 1 -- 172.21.15.158:0/347729284 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e4009ae0 con 0x7fb3ec065620 2023-10-18T17:24:35.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.092+0000 7fb3f1b46700 1 --2- 172.21.15.158:0/347729284 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3ec151360 0x7fb3ec160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:24:35.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.092+0000 7fb3f1345700 1 --2- 172.21.15.158:0/347729284 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ec065620 0x7fb3ec0bd7a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fb3e800e950 tx=0x7fb3e8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:35.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.092+0000 7fb3e17fa700 1 -- 172.21.15.158:0/347729284 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e800c730 con 0x7fb3ec065620 2023-10-18T17:24:35.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.092+0000 7fb3e17fa700 1 -- 172.21.15.158:0/347729284 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e800c890 con 0x7fb3ec065620 2023-10-18T17:24:35.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.092+0000 7fb3f35a9700 1 -- 172.21.15.158:0/347729284 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ec1503b0 con 0x7fb3ec065620 2023-10-18T17:24:35.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.092+0000 7fb3e17fa700 1 -- 172.21.15.158:0/347729284 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e800cc10 con 0x7fb3ec065620 2023-10-18T17:24:35.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.092+0000 7fb3f35a9700 1 -- 172.21.15.158:0/347729284 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ec163630 con 0x7fb3ec065620 2023-10-18T17:24:35.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.092+0000 7fb3f35a9700 1 -- 172.21.15.158:0/347729284 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ec15fbb0 con 0x7fb3ec065620 2023-10-18T17:24:35.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.096+0000 7fb3e17fa700 1 -- 172.21.15.158:0/347729284 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb3e801b400 con 0x7fb3ec065620 2023-10-18T17:24:35.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.096+0000 7fb3e17fa700 1 --2- 172.21.15.158:0/347729284 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb3d005a510 0x7fb3d005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:35.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.096+0000 7fb3e17fa700 1 -- 172.21.15.158:0/347729284 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb3e8074e40 con 0x7fb3ec065620 2023-10-18T17:24:35.102 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.096+0000 7fb3f0b44700 1 --2- 172.21.15.158:0/347729284 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb3d005a510 0x7fb3d005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:35.102 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.096+0000 7fb3f0b44700 1 --2- 172.21.15.158:0/347729284 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb3d005a510 0x7fb3d005c9d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fb3ec14a5a0 tx=0x7fb3dc008040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:35.108 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.104+0000 7fb3e17fa700 1 -- 172.21.15.158:0/347729284 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fb3ec15fbb0 con 0x7fb3ec065620 2023-10-18T17:24:35.304 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.300+0000 7fb3f35a9700 1 -- 172.21.15.158:0/347729284 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb3ec15fbb0 con 0x7fb3ec065620 2023-10-18T17:24:35.305 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.300+0000 7fb3e17fa700 1 -- 172.21.15.158:0/347729284 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fb3ec15fbb0 con 0x7fb3ec065620 2023-10-18T17:24:35.305 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:35.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.304+0000 7fb3f35a9700 1 -- 172.21.15.158:0/347729284 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb3d005a510 msgr2=0x7fb3d005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:35.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.304+0000 7fb3f35a9700 1 --2- 172.21.15.158:0/347729284 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb3d005a510 0x7fb3d005c9d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fb3ec14a5a0 tx=0x7fb3dc008040).stop 2023-10-18T17:24:35.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.304+0000 7fb3f35a9700 1 -- 172.21.15.158:0/347729284 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ec065620 msgr2=0x7fb3ec0bd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:35.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.304+0000 7fb3f35a9700 1 --2- 172.21.15.158:0/347729284 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ec065620 0x7fb3ec0bd7a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fb3e800e950 tx=0x7fb3e8009060).stop 2023-10-18T17:24:35.308 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.304+0000 7fb3f35a9700 1 -- 172.21.15.158:0/347729284 shutdown_connections 2023-10-18T17:24:35.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.304+0000 7fb3f35a9700 1 --2- 172.21.15.158:0/347729284 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb3d005a510 0x7fb3d005c9d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:35.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.304+0000 7fb3f35a9700 1 --2- 172.21.15.158:0/347729284 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3ec151360 0x7fb3ec160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:35.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.304+0000 7fb3f35a9700 1 --2- 172.21.15.158:0/347729284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3ec0b9690 0x7fb3ec15fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:35.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.304+0000 7fb3f35a9700 1 --2- 172.21.15.158:0/347729284 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ec065620 0x7fb3ec0bd7a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:35.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.304+0000 7fb3f35a9700 1 -- 172.21.15.158:0/347729284 >> 172.21.15.158:0/347729284 conn(0x7fb3ec0620d0 msgr2=0x7fb3ec1431a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:35.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.304+0000 7fb3f35a9700 1 -- 172.21.15.158:0/347729284 shutdown_connections 2023-10-18T17:24:35.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:35.304+0000 7fb3f35a9700 1 -- 172.21.15.158:0/347729284 wait complete. 2023-10-18T17:24:35.324 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:24:38.325 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:24:38.491 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.488+0000 7f316da5b700 1 Processor -- start 2023-10-18T17:24:38.491 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.488+0000 7f316da5b700 1 -- start start 2023-10-18T17:24:38.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.488+0000 7f316da5b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f31680b9690 0x7f31680b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:38.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.488+0000 7f316da5b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31680bca50 0x7f316814dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:38.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.488+0000 7f316da5b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31680bc480 con 0x7f3168065620 2023-10-18T17:24:38.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.488+0000 7f316da5b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3168065190 con 0x7f31680b9690 2023-10-18T17:24:38.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.488+0000 7f316da5b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31680bb920 con 0x7f31680bca50 2023-10-18T17:24:38.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.488+0000 7f315e7fc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31680bca50 0x7f316814dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:38.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.488+0000 7f3166ffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f31680b9690 0x7f31680b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:38.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.488+0000 7f315e7fc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31680bca50 0x7f316814dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:55972/0 (socket says 172.21.15.158:55972) 2023-10-18T17:24:38.496 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.488+0000 7f315e7fc700 1 -- 172.21.15.158:0/2029695171 learned_addr learned my addr 172.21.15.158:0/2029695171 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:38.496 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.488+0000 7f315e7fc700 1 -- 172.21.15.158:0/2029695171 >> v2:172.21.15.183:3300/0 conn(0x7f31680b9690 msgr2=0x7f31680b9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:38.496 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.488+0000 7f315e7fc700 1 --2- 172.21.15.158:0/2029695171 >> v2:172.21.15.183:3300/0 conn(0x7f31680b9690 0x7f31680b9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:38.496 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.488+0000 7f315e7fc700 1 -- 172.21.15.158:0/2029695171 >> v1:172.21.15.183:6789/0 conn(0x7f3168065620 legacy=0x7f3168065a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:38.496 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.488+0000 7f315e7fc700 1 -- 172.21.15.158:0/2029695171 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31680bbbe0 con 0x7f31680bca50 2023-10-18T17:24:38.496 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.488+0000 7f3166ffd700 1 --2- 172.21.15.158:0/2029695171 >> v2:172.21.15.183:3300/0 conn(0x7f31680b9690 0x7f31680b9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:38.497 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.492+0000 7f315e7fc700 1 --2- 172.21.15.158:0/2029695171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31680bca50 0x7f316814dd50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f3150006fd0 tx=0x7f31500090f0).ready entity=mon.2 client_cookie=30a02dd885c3bf42 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:38.497 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.492+0000 7f31667fc700 1 -- 172.21.15.158:0/2029695171 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315000b580 con 0x7f31680bca50 2023-10-18T17:24:38.497 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.492+0000 7f31667fc700 1 -- 172.21.15.158:0/2029695171 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315000b6e0 con 0x7f31680bca50 2023-10-18T17:24:38.497 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.492+0000 7f31667fc700 1 -- 172.21.15.158:0/2029695171 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315000ba60 con 0x7f31680bca50 2023-10-18T17:24:38.498 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.492+0000 7f316da5b700 1 -- 172.21.15.158:0/2029695171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31680bca50 msgr2=0x7f316814dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:38.498 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.492+0000 7f316da5b700 1 --2- 172.21.15.158:0/2029695171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31680bca50 0x7f316814dd50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f3150006fd0 tx=0x7f31500090f0).stop 2023-10-18T17:24:38.499 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.492+0000 7f316da5b700 1 -- 172.21.15.158:0/2029695171 shutdown_connections 2023-10-18T17:24:38.499 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.492+0000 7f316da5b700 1 --2- 172.21.15.158:0/2029695171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31680bca50 0x7f316814dd50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:38.499 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.492+0000 7f316da5b700 1 --2- 172.21.15.158:0/2029695171 >> v2:172.21.15.183:3300/0 conn(0x7f31680b9690 0x7f31680b9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:38.499 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.492+0000 7f316da5b700 1 -- 172.21.15.158:0/2029695171 >> 172.21.15.158:0/2029695171 conn(0x7f31680620d0 msgr2=0x7f31680624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:38.499 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.492+0000 7f316da5b700 1 -- 172.21.15.158:0/2029695171 shutdown_connections 2023-10-18T17:24:38.500 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.492+0000 7f316da5b700 1 -- 172.21.15.158:0/2029695171 wait complete. 2023-10-18T17:24:38.501 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f316da5b700 1 Processor -- start 2023-10-18T17:24:38.501 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f316da5b700 1 -- start start 2023-10-18T17:24:38.501 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f316da5b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3168065620 0x7f3168145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:38.501 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f316da5b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31680b9690 0x7f3168068250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:38.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f316da5b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3168069990 0x7f3168148390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:38.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f316da5b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3168160c00 con 0x7f3168065620 2023-10-18T17:24:38.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f316da5b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3168160010 con 0x7f31680b9690 2023-10-18T17:24:38.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f316da5b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3168068b90 con 0x7f3168069990 2023-10-18T17:24:38.503 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f3166ffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3168065620 0x7f3168145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:38.503 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f3166ffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3168065620 0x7f3168145540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:35406/0 (socket says 172.21.15.158:35406) 2023-10-18T17:24:38.503 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f3166ffd700 1 -- 172.21.15.158:0/2951377181 learned_addr learned my addr 172.21.15.158:0/2951377181 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:38.503 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f31677fe700 1 --2- 172.21.15.158:0/2951377181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3168069990 0x7f3168148390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:38.504 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f315e7fc700 1 --2- 172.21.15.158:0/2951377181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31680b9690 0x7f3168068250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:38.505 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f3166ffd700 1 -- 172.21.15.158:0/2951377181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3168069990 msgr2=0x7f3168148390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:38.505 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f3166ffd700 1 --2- 172.21.15.158:0/2951377181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3168069990 0x7f3168148390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:38.505 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f3166ffd700 1 -- 172.21.15.158:0/2951377181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31680b9690 msgr2=0x7f3168068250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:38.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f3166ffd700 1 --2- 172.21.15.158:0/2951377181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31680b9690 0x7f3168068250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:38.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f3166ffd700 1 -- 172.21.15.158:0/2951377181 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3158009a20 con 0x7f3168065620 2023-10-18T17:24:38.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f3166ffd700 1 --2- 172.21.15.158:0/2951377181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3168065620 0x7f3168145540 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f315800c170 tx=0x7f315800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:38.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f315f7fe700 1 -- 172.21.15.158:0/2951377181 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315800cc50 con 0x7f3168065620 2023-10-18T17:24:38.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f315f7fe700 1 -- 172.21.15.158:0/2951377181 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315800f040 con 0x7f3168065620 2023-10-18T17:24:38.507 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.496+0000 7f316da5b700 1 -- 172.21.15.158:0/2951377181 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3150009370 con 0x7f3168065620 2023-10-18T17:24:38.507 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.500+0000 7f315f7fe700 1 -- 172.21.15.158:0/2951377181 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3158013400 con 0x7f3168065620 2023-10-18T17:24:38.507 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.500+0000 7f316da5b700 1 -- 172.21.15.158:0/2951377181 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31681605b0 con 0x7f3168065620 2023-10-18T17:24:38.507 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.500+0000 7f316da5b700 1 -- 172.21.15.158:0/2951377181 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316806c190 con 0x7f3168065620 2023-10-18T17:24:38.507 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.500+0000 7f315f7fe700 1 -- 172.21.15.158:0/2951377181 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f31580137b0 con 0x7f3168065620 2023-10-18T17:24:38.508 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.504+0000 7f315f7fe700 1 --2- 172.21.15.158:0/2951377181 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f314805a540 0x7f314805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:38.509 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.504+0000 7f315f7fe700 1 -- 172.21.15.158:0/2951377181 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3158075050 con 0x7f3168065620 2023-10-18T17:24:38.509 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.504+0000 7f315e7fc700 1 --2- 172.21.15.158:0/2951377181 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f314805a540 0x7f314805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:38.509 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.504+0000 7f315e7fc700 1 --2- 172.21.15.158:0/2951377181 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f314805a540 0x7f314805ca00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f3150009130 tx=0x7f3150017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:38.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.508+0000 7f315f7fe700 1 -- 172.21.15.158:0/2951377181 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f3158048830 con 0x7f3168065620 2023-10-18T17:24:38.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.700+0000 7f316da5b700 1 -- 172.21.15.158:0/2951377181 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f31680bbec0 con 0x7f3168065620 2023-10-18T17:24:38.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.704+0000 7f315f7fe700 1 -- 172.21.15.158:0/2951377181 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f315804be50 con 0x7f3168065620 2023-10-18T17:24:38.707 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:38.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.708+0000 7f316da5b700 1 -- 172.21.15.158:0/2951377181 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f314805a540 msgr2=0x7f314805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:38.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.708+0000 7f316da5b700 1 --2- 172.21.15.158:0/2951377181 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f314805a540 0x7f314805ca00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f3150009130 tx=0x7f3150017000).stop 2023-10-18T17:24:38.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.708+0000 7f316da5b700 1 -- 172.21.15.158:0/2951377181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3168065620 msgr2=0x7f3168145540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:38.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.708+0000 7f316da5b700 1 --2- 172.21.15.158:0/2951377181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3168065620 0x7f3168145540 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f315800c170 tx=0x7f315800b040).stop 2023-10-18T17:24:38.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.708+0000 7f316da5b700 1 -- 172.21.15.158:0/2951377181 shutdown_connections 2023-10-18T17:24:38.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.708+0000 7f316da5b700 1 --2- 172.21.15.158:0/2951377181 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f314805a540 0x7f314805ca00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:38.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.708+0000 7f316da5b700 1 --2- 172.21.15.158:0/2951377181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3168069990 0x7f3168148390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:38.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.708+0000 7f316da5b700 1 --2- 172.21.15.158:0/2951377181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31680b9690 0x7f3168068250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:38.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.708+0000 7f316da5b700 1 --2- 172.21.15.158:0/2951377181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3168065620 0x7f3168145540 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:38.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.708+0000 7f316da5b700 1 -- 172.21.15.158:0/2951377181 >> 172.21.15.158:0/2951377181 conn(0x7f31680620d0 msgr2=0x7f316814da50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:38.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.708+0000 7f316da5b700 1 -- 172.21.15.158:0/2951377181 shutdown_connections 2023-10-18T17:24:38.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:38.708+0000 7f316da5b700 1 -- 172.21.15.158:0/2951377181 wait complete. 2023-10-18T17:24:38.734 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:24:40.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~27s 2023-10-18T17:24:41.735 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:24:41.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.888+0000 7f0d85d69700 1 Processor -- start 2023-10-18T17:24:41.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.888+0000 7f0d85d69700 1 -- start start 2023-10-18T17:24:41.893 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.888+0000 7f0d85d69700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0d800beea0 0x7f0d80150b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:41.894 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.888+0000 7f0d85d69700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d800bd9e0 con 0x7f0d800beac0 2023-10-18T17:24:41.894 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.888+0000 7f0d85d69700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d800bcaf0 con 0x7f0d80067e50 2023-10-18T17:24:41.894 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.888+0000 7f0d85d69700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d80151080 con 0x7f0d800beea0 2023-10-18T17:24:41.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.888+0000 7f0d7f7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f0d800beac0 0x7f0d80066150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:60060/0 (socket says 172.21.15.158:60060) 2023-10-18T17:24:41.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.888+0000 7f0d7f7fe700 1 -- 172.21.15.158:0/1356022346 learned_addr learned my addr 172.21.15.158:0/1356022346 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:41.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.888+0000 7f0d77fff700 1 --2- 172.21.15.158:0/1356022346 >> v2:172.21.15.158:3300/0 conn(0x7f0d800beea0 0x7f0d80150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:41.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.892+0000 7f0d7effd700 1 -- 172.21.15.158:0/1356022346 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801321445 0 0) 0x7f0d800bcaf0 con 0x7f0d80067e50 2023-10-18T17:24:41.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.892+0000 7f0d7effd700 1 -- 172.21.15.158:0/1356022346 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d6c0033f0 con 0x7f0d80067e50 2023-10-18T17:24:41.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.892+0000 7f0d7effd700 1 -- 172.21.15.158:0/1356022346 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113821191 0 0) 0x7f0d800bd9e0 con 0x7f0d800beac0 2023-10-18T17:24:41.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.892+0000 7f0d77fff700 1 -- 172.21.15.158:0/1356022346 >> v1:172.21.15.183:6789/0 conn(0x7f0d80067e50 legacy=0x7f0d8014cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:41.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.892+0000 7f0d77fff700 1 -- 172.21.15.158:0/1356022346 >> v1:172.21.15.158:6789/0 conn(0x7f0d800beac0 legacy=0x7f0d80066150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:41.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.892+0000 7f0d77fff700 1 -- 172.21.15.158:0/1356022346 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d800bcdd0 con 0x7f0d800beea0 2023-10-18T17:24:41.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.892+0000 7f0d77fff700 1 --2- 172.21.15.158:0/1356022346 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d800beea0 0x7f0d80150b90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f0d68009760 tx=0x7f0d68009060).ready entity=mon.0 client_cookie=8ed1b99a9a9c1433 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:41.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.892+0000 7f0d7effd700 1 -- 172.21.15.158:0/1356022346 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6800b590 con 0x7f0d800beea0 2023-10-18T17:24:41.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.892+0000 7f0d7effd700 1 -- 172.21.15.158:0/1356022346 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6800b6f0 con 0x7f0d800beea0 2023-10-18T17:24:41.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.892+0000 7f0d7effd700 1 -- 172.21.15.158:0/1356022346 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6800ba70 con 0x7f0d800beea0 2023-10-18T17:24:41.899 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.892+0000 7f0d85d69700 1 -- 172.21.15.158:0/1356022346 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d800beea0 msgr2=0x7f0d80150b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:41.899 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.892+0000 7f0d85d69700 1 --2- 172.21.15.158:0/1356022346 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d800beea0 0x7f0d80150b90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f0d68009760 tx=0x7f0d68009060).stop 2023-10-18T17:24:41.899 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.892+0000 7f0d85d69700 1 -- 172.21.15.158:0/1356022346 shutdown_connections 2023-10-18T17:24:41.900 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.892+0000 7f0d85d69700 1 --2- 172.21.15.158:0/1356022346 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d800beea0 0x7f0d80150b90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:41.900 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.892+0000 7f0d85d69700 1 -- 172.21.15.158:0/1356022346 >> 172.21.15.158:0/1356022346 conn(0x7f0d800620d0 msgr2=0x7f0d800624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:41.900 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.892+0000 7f0d85d69700 1 -- 172.21.15.158:0/1356022346 shutdown_connections 2023-10-18T17:24:41.900 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.892+0000 7f0d85d69700 1 -- 172.21.15.158:0/1356022346 wait complete. 2023-10-18T17:24:41.901 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.896+0000 7f0d85d69700 1 Processor -- start 2023-10-18T17:24:41.901 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.896+0000 7f0d85d69700 1 -- start start 2023-10-18T17:24:41.902 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.896+0000 7f0d85d69700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d80067e50 0x7f0d800c1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:41.902 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.896+0000 7f0d85d69700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d800beac0 0x7f0d800c0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:41.902 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.896+0000 7f0d85d69700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d800beea0 0x7f0d8013c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:41.902 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.896+0000 7f0d85d69700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8013c540 con 0x7f0d800beac0 2023-10-18T17:24:41.903 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.896+0000 7f0d85d69700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8015fb90 con 0x7f0d800beea0 2023-10-18T17:24:41.903 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.896+0000 7f0d85d69700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8015fe50 con 0x7f0d80067e50 2023-10-18T17:24:41.904 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.896+0000 7f0d7f7fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d80067e50 0x7f0d800c1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:41.904 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.896+0000 7f0d77fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d800beac0 0x7f0d800c0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:41.905 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.896+0000 7f0d7f7fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d80067e50 0x7f0d800c1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:57862/0 (socket says 172.21.15.158:57862) 2023-10-18T17:24:41.905 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.896+0000 7f0d7f7fe700 1 -- 172.21.15.158:0/2451962865 learned_addr learned my addr 172.21.15.158:0/2451962865 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:41.905 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.896+0000 7f0d7ffff700 1 --2- 172.21.15.158:0/2451962865 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d800beea0 0x7f0d8013c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:41.905 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.900+0000 7f0d7f7fe700 1 -- 172.21.15.158:0/2451962865 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d800beea0 msgr2=0x7f0d8013c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:41.906 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.900+0000 7f0d7f7fe700 1 --2- 172.21.15.158:0/2451962865 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d800beea0 0x7f0d8013c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:41.906 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.900+0000 7f0d7f7fe700 1 -- 172.21.15.158:0/2451962865 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d800beac0 msgr2=0x7f0d800c0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:41.906 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.900+0000 7f0d7f7fe700 1 --2- 172.21.15.158:0/2451962865 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d800beac0 0x7f0d800c0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:41.907 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.900+0000 7f0d7f7fe700 1 -- 172.21.15.158:0/2451962865 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d680092a0 con 0x7f0d80067e50 2023-10-18T17:24:41.907 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.900+0000 7f0d77fff700 1 --2- 172.21.15.158:0/2451962865 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d800beac0 0x7f0d800c0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:41.907 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.900+0000 7f0d7f7fe700 1 --2- 172.21.15.158:0/2451962865 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d80067e50 0x7f0d800c1570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0d7000c4c0 tx=0x7f0d70007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:41.907 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.900+0000 7f0d777fe700 1 -- 172.21.15.158:0/2451962865 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700072e0 con 0x7f0d80067e50 2023-10-18T17:24:41.907 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.900+0000 7f0d777fe700 1 -- 172.21.15.158:0/2451962865 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d70007440 con 0x7f0d80067e50 2023-10-18T17:24:41.908 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.900+0000 7f0d777fe700 1 -- 172.21.15.158:0/2451962865 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700057a0 con 0x7f0d80067e50 2023-10-18T17:24:41.908 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.900+0000 7f0d85d69700 1 -- 172.21.15.158:0/2451962865 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8013bc10 con 0x7f0d80067e50 2023-10-18T17:24:41.908 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.900+0000 7f0d85d69700 1 -- 172.21.15.158:0/2451962865 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8013c1d0 con 0x7f0d80067e50 2023-10-18T17:24:41.909 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.900+0000 7f0d85d69700 1 -- 172.21.15.158:0/2451962865 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8006c190 con 0x7f0d80067e50 2023-10-18T17:24:41.909 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.904+0000 7f0d777fe700 1 -- 172.21.15.158:0/2451962865 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0d70005b90 con 0x7f0d80067e50 2023-10-18T17:24:41.909 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.904+0000 7f0d777fe700 1 --2- 172.21.15.158:0/2451962865 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f0d6005a4e0 0x7f0d6005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:41.909 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.904+0000 7f0d777fe700 1 -- 172.21.15.158:0/2451962865 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0d70073fa0 con 0x7f0d80067e50 2023-10-18T17:24:41.910 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.904+0000 7f0d77fff700 1 --2- 172.21.15.158:0/2451962865 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f0d6005a4e0 0x7f0d6005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:41.910 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.904+0000 7f0d77fff700 1 --2- 172.21.15.158:0/2451962865 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f0d6005a4e0 0x7f0d6005c9a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f0d6800b350 tx=0x7f0d68017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:41.919 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:41.916+0000 7f0d777fe700 1 -- 172.21.15.158:0/2451962865 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f0d700476c0 con 0x7f0d80067e50 2023-10-18T17:24:42.115 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:42.112+0000 7f0d85d69700 1 -- 172.21.15.158:0/2451962865 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0d800bd0b0 con 0x7f0d80067e50 2023-10-18T17:24:42.116 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:42.112+0000 7f0d777fe700 1 -- 172.21.15.158:0/2451962865 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f0d7004ace0 con 0x7f0d80067e50 2023-10-18T17:24:42.117 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:42.121 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:42.116+0000 7f0d85d69700 1 -- 172.21.15.158:0/2451962865 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f0d6005a4e0 msgr2=0x7f0d6005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:42.122 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:42.116+0000 7f0d85d69700 1 --2- 172.21.15.158:0/2451962865 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f0d6005a4e0 0x7f0d6005c9a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f0d6800b350 tx=0x7f0d68017000).stop 2023-10-18T17:24:42.122 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:42.116+0000 7f0d85d69700 1 -- 172.21.15.158:0/2451962865 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d80067e50 msgr2=0x7f0d800c1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:42.122 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:42.116+0000 7f0d85d69700 1 --2- 172.21.15.158:0/2451962865 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d80067e50 0x7f0d800c1570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0d7000c4c0 tx=0x7f0d70007c10).stop 2023-10-18T17:24:42.123 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:42.116+0000 7f0d85d69700 1 -- 172.21.15.158:0/2451962865 shutdown_connections 2023-10-18T17:24:42.123 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:42.116+0000 7f0d85d69700 1 --2- 172.21.15.158:0/2451962865 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f0d6005a4e0 0x7f0d6005c9a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:42.124 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:42.116+0000 7f0d85d69700 1 --2- 172.21.15.158:0/2451962865 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d800beea0 0x7f0d8013c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:42.124 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:42.116+0000 7f0d85d69700 1 --2- 172.21.15.158:0/2451962865 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d800beac0 0x7f0d800c0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:42.124 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:42.116+0000 7f0d85d69700 1 --2- 172.21.15.158:0/2451962865 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d80067e50 0x7f0d800c1570 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:42.125 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:42.116+0000 7f0d85d69700 1 -- 172.21.15.158:0/2451962865 >> 172.21.15.158:0/2451962865 conn(0x7f0d800620d0 msgr2=0x7f0d801496f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:42.125 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:42.116+0000 7f0d85d69700 1 -- 172.21.15.158:0/2451962865 shutdown_connections 2023-10-18T17:24:42.125 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:42.116+0000 7f0d85d69700 1 -- 172.21.15.158:0/2451962865 wait complete. 2023-10-18T17:24:42.142 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:24:45.144 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:24:45.315 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.312+0000 7f9ad4e5b700 1 Processor -- start 2023-10-18T17:24:45.315 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.312+0000 7f9ad4e5b700 1 -- start start 2023-10-18T17:24:45.318 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9ad4e5b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9ad0067ff0 0x7f9ad00683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:45.319 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9ad4e5b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9ad0151410 0x7f9ad0151820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:45.319 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9ad4e5b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad0065cd0 con 0x7f9ad00666b0 2023-10-18T17:24:45.319 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9ad4e5b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad0066160 con 0x7f9ad0151410 2023-10-18T17:24:45.319 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9ad4e5b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad0154750 con 0x7f9ad0067ff0 2023-10-18T17:24:45.321 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9aced9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9ad0151410 0x7f9ad0151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:45.321 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9ace59c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9ad0067ff0 0x7f9ad00683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:45.321 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9aced9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9ad0151410 0x7f9ad0151820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:33606/0 (socket says 172.21.15.158:33606) 2023-10-18T17:24:45.321 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9aced9d700 1 -- 172.21.15.158:0/605373815 learned_addr learned my addr 172.21.15.158:0/605373815 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:45.321 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9acdd9b700 1 --1- 172.21.15.158:0/605373815 >> v1:172.21.15.183:6789/0 conn(0x7f9ad00666b0 0x7f9ad00bd930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:60154/0 (socket says 172.21.15.158:60154) 2023-10-18T17:24:45.322 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9aced9d700 1 -- 172.21.15.158:0/605373815 >> v2:172.21.15.183:3300/0 conn(0x7f9ad0067ff0 msgr2=0x7f9ad00683d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:45.322 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9aced9d700 1 --2- 172.21.15.158:0/605373815 >> v2:172.21.15.183:3300/0 conn(0x7f9ad0067ff0 0x7f9ad00683d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:45.322 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9aced9d700 1 -- 172.21.15.158:0/605373815 >> v1:172.21.15.183:6789/0 conn(0x7f9ad00666b0 legacy=0x7f9ad00bd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:45.322 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9aced9d700 1 -- 172.21.15.158:0/605373815 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad0065100 con 0x7f9ad0151410 2023-10-18T17:24:45.322 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9aced9d700 1 --2- 172.21.15.158:0/605373815 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ad0151410 0x7f9ad0151820 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f9ad005e8c0 tx=0x7f9ac8009840).ready entity=mon.0 client_cookie=79296408b4294a21 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:45.323 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9acd59a700 1 -- 172.21.15.158:0/605373815 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac800e070 con 0x7f9ad0151410 2023-10-18T17:24:45.323 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9acd59a700 1 -- 172.21.15.158:0/605373815 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac800ba20 con 0x7f9ad0151410 2023-10-18T17:24:45.323 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9acd59a700 1 -- 172.21.15.158:0/605373815 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac800bda0 con 0x7f9ad0151410 2023-10-18T17:24:45.324 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9ad4e5b700 1 -- 172.21.15.158:0/605373815 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ad0151410 msgr2=0x7f9ad0151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:45.324 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9ad4e5b700 1 --2- 172.21.15.158:0/605373815 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ad0151410 0x7f9ad0151820 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f9ad005e8c0 tx=0x7f9ac8009840).stop 2023-10-18T17:24:45.324 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9ad4e5b700 1 -- 172.21.15.158:0/605373815 shutdown_connections 2023-10-18T17:24:45.325 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9ad4e5b700 1 --2- 172.21.15.158:0/605373815 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ad0151410 0x7f9ad0151820 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:45.325 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9ad4e5b700 1 --2- 172.21.15.158:0/605373815 >> v2:172.21.15.183:3300/0 conn(0x7f9ad0067ff0 0x7f9ad00683d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:45.325 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9ad4e5b700 1 -- 172.21.15.158:0/605373815 >> 172.21.15.158:0/605373815 conn(0x7f9ad00620d0 msgr2=0x7f9ad00624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:45.325 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9ad4e5b700 1 -- 172.21.15.158:0/605373815 shutdown_connections 2023-10-18T17:24:45.325 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.316+0000 7f9ad4e5b700 1 -- 172.21.15.158:0/605373815 wait complete. 2023-10-18T17:24:45.326 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.320+0000 7f9ad4e5b700 1 Processor -- start 2023-10-18T17:24:45.326 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.320+0000 7f9ad4e5b700 1 -- start start 2023-10-18T17:24:45.328 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.320+0000 7f9ad4e5b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ad00666b0 0x7f9ad00b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:45.328 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.320+0000 7f9ad4e5b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ad0067ff0 0x7f9ad01526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:45.328 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.320+0000 7f9ad4e5b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ad0151410 0x7f9ad0164950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:45.328 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.320+0000 7f9ad4e5b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad00b8ec0 con 0x7f9ad00666b0 2023-10-18T17:24:45.328 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.320+0000 7f9ad4e5b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad0164220 con 0x7f9ad0151410 2023-10-18T17:24:45.329 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.320+0000 7f9ad4e5b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad00b5e90 con 0x7f9ad0067ff0 2023-10-18T17:24:45.329 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.320+0000 7f9ace59c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ad00666b0 0x7f9ad00b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:45.329 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.324+0000 7f9ace59c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ad00666b0 0x7f9ad00b6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:33610/0 (socket says 172.21.15.158:33610) 2023-10-18T17:24:45.329 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.324+0000 7f9ace59c700 1 -- 172.21.15.158:0/3765580001 learned_addr learned my addr 172.21.15.158:0/3765580001 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:45.329 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.324+0000 7f9acdd9b700 1 --2- 172.21.15.158:0/3765580001 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ad0067ff0 0x7f9ad01526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:45.330 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.324+0000 7f9aced9d700 1 --2- 172.21.15.158:0/3765580001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ad0151410 0x7f9ad0164950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:45.330 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.324+0000 7f9ace59c700 1 -- 172.21.15.158:0/3765580001 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ad0067ff0 msgr2=0x7f9ad01526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:45.330 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.324+0000 7f9ace59c700 1 --2- 172.21.15.158:0/3765580001 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ad0067ff0 0x7f9ad01526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:45.330 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.324+0000 7f9ace59c700 1 -- 172.21.15.158:0/3765580001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ad0151410 msgr2=0x7f9ad0164950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:45.330 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.324+0000 7f9ace59c700 1 --2- 172.21.15.158:0/3765580001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ad0151410 0x7f9ad0164950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:45.330 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.324+0000 7f9ace59c700 1 -- 172.21.15.158:0/3765580001 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac8009ae0 con 0x7f9ad00666b0 2023-10-18T17:24:45.331 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.324+0000 7f9ace59c700 1 --2- 172.21.15.158:0/3765580001 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ad00666b0 0x7f9ad00b6fd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f9ac000e960 tx=0x7f9ac0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:45.331 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.324+0000 7f9abe7fc700 1 -- 172.21.15.158:0/3765580001 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac000c680 con 0x7f9ad00666b0 2023-10-18T17:24:45.331 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.324+0000 7f9abe7fc700 1 -- 172.21.15.158:0/3765580001 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac000c7e0 con 0x7f9ad00666b0 2023-10-18T17:24:45.331 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.324+0000 7f9ad4e5b700 1 -- 172.21.15.158:0/3765580001 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad00b8360 con 0x7f9ad00666b0 2023-10-18T17:24:45.331 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.324+0000 7f9abe7fc700 1 -- 172.21.15.158:0/3765580001 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac000cb60 con 0x7f9ad00666b0 2023-10-18T17:24:45.332 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.324+0000 7f9ad4e5b700 1 -- 172.21.15.158:0/3765580001 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad00b8900 con 0x7f9ad00666b0 2023-10-18T17:24:45.333 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.324+0000 7f9ad4e5b700 1 -- 172.21.15.158:0/3765580001 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad006c190 con 0x7f9ad00666b0 2023-10-18T17:24:45.333 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.324+0000 7f9abe7fc700 1 -- 172.21.15.158:0/3765580001 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9ac001b400 con 0x7f9ad00666b0 2023-10-18T17:24:45.333 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.328+0000 7f9abe7fc700 1 --2- 172.21.15.158:0/3765580001 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9ab005a510 0x7f9ab005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:45.333 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.328+0000 7f9abe7fc700 1 -- 172.21.15.158:0/3765580001 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9ac0074c80 con 0x7f9ad00666b0 2023-10-18T17:24:45.334 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.328+0000 7f9acdd9b700 1 --2- 172.21.15.158:0/3765580001 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9ab005a510 0x7f9ab005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:45.334 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.328+0000 7f9acdd9b700 1 --2- 172.21.15.158:0/3765580001 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9ab005a510 0x7f9ab005c9d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9ad0152170 tx=0x7f9ac4007d30).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:45.337 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.332+0000 7f9abe7fc700 1 -- 172.21.15.158:0/3765580001 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f9ac00484b0 con 0x7f9ad00666b0 2023-10-18T17:24:45.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.528+0000 7f9ad4e5b700 1 -- 172.21.15.158:0/3765580001 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9ad00653a0 con 0x7f9ad00666b0 2023-10-18T17:24:45.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.528+0000 7f9abe7fc700 1 -- 172.21.15.158:0/3765580001 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f9ac004bad0 con 0x7f9ad00666b0 2023-10-18T17:24:45.533 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:45.535 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.532+0000 7f9ad4e5b700 1 -- 172.21.15.158:0/3765580001 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9ab005a510 msgr2=0x7f9ab005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:45.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.532+0000 7f9ad4e5b700 1 --2- 172.21.15.158:0/3765580001 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9ab005a510 0x7f9ab005c9d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9ad0152170 tx=0x7f9ac4007d30).stop 2023-10-18T17:24:45.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.532+0000 7f9ad4e5b700 1 -- 172.21.15.158:0/3765580001 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ad00666b0 msgr2=0x7f9ad00b6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:45.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.532+0000 7f9ad4e5b700 1 --2- 172.21.15.158:0/3765580001 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ad00666b0 0x7f9ad00b6fd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f9ac000e960 tx=0x7f9ac0009060).stop 2023-10-18T17:24:45.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.532+0000 7f9ad4e5b700 1 -- 172.21.15.158:0/3765580001 shutdown_connections 2023-10-18T17:24:45.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.532+0000 7f9ad4e5b700 1 --2- 172.21.15.158:0/3765580001 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9ab005a510 0x7f9ab005c9d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:45.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.532+0000 7f9ad4e5b700 1 --2- 172.21.15.158:0/3765580001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ad0151410 0x7f9ad0164950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:45.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.532+0000 7f9ad4e5b700 1 --2- 172.21.15.158:0/3765580001 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ad0067ff0 0x7f9ad01526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:45.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.532+0000 7f9ad4e5b700 1 --2- 172.21.15.158:0/3765580001 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9ad00666b0 0x7f9ad00b6fd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:45.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.532+0000 7f9ad4e5b700 1 -- 172.21.15.158:0/3765580001 >> 172.21.15.158:0/3765580001 conn(0x7f9ad00620d0 msgr2=0x7f9ad00624b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:45.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.532+0000 7f9ad4e5b700 1 -- 172.21.15.158:0/3765580001 shutdown_connections 2023-10-18T17:24:45.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:45.532+0000 7f9ad4e5b700 1 -- 172.21.15.158:0/3765580001 wait complete. 2023-10-18T17:24:45.555 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:24:46.819 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~34s 2023-10-18T17:24:48.556 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:24:48.719 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.716+0000 7f269aee4700 1 Processor -- start 2023-10-18T17:24:48.720 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.716+0000 7f269aee4700 1 -- start start 2023-10-18T17:24:48.723 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.720+0000 7f269aee4700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2694067d30 0x7f26940630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:48.723 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.720+0000 7f269aee4700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2694068910 con 0x7f269414d170 2023-10-18T17:24:48.724 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.720+0000 7f269aee4700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2694150780 con 0x7f2694068180 2023-10-18T17:24:48.724 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.720+0000 7f269aee4700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2694150c10 con 0x7f2694067d30 2023-10-18T17:24:48.724 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.720+0000 7f2699ee2700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f269414d170 0x7f269406a150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:60076/0 (socket says 172.21.15.158:60076) 2023-10-18T17:24:48.724 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.720+0000 7f2699ee2700 1 -- 172.21.15.158:0/3706257614 learned_addr learned my addr 172.21.15.158:0/3706257614 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:48.725 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.720+0000 7f26996e1700 1 --2- 172.21.15.158:0/3706257614 >> v2:172.21.15.183:3300/0 conn(0x7f2694067d30 0x7f26940630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:48.726 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.720+0000 7f2698ee0700 1 -- 172.21.15.158:0/3706257614 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038111521 0 0) 0x7f2694068910 con 0x7f269414d170 2023-10-18T17:24:48.726 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.720+0000 7f2698ee0700 1 -- 172.21.15.158:0/3706257614 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26800033f0 con 0x7f269414d170 2023-10-18T17:24:48.727 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.720+0000 7f26996e1700 1 -- 172.21.15.158:0/3706257614 >> v1:172.21.15.183:6789/0 conn(0x7f2694068180 legacy=0x7f2694065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:48.727 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.720+0000 7f26996e1700 1 -- 172.21.15.158:0/3706257614 >> v1:172.21.15.158:6789/0 conn(0x7f269414d170 legacy=0x7f269406a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:48.727 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.720+0000 7f26996e1700 1 -- 172.21.15.158:0/3706257614 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2694068630 con 0x7f2694067d30 2023-10-18T17:24:48.727 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.720+0000 7f26996e1700 1 --2- 172.21.15.158:0/3706257614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2694067d30 0x7f26940630e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f2688009760 tx=0x7f2688009060).ready entity=mon.1 client_cookie=8aaecfaa0ace5ef0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:48.727 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.720+0000 7f2698ee0700 1 -- 172.21.15.158:0/3706257614 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268800b590 con 0x7f2694067d30 2023-10-18T17:24:48.728 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.720+0000 7f2698ee0700 1 -- 172.21.15.158:0/3706257614 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268800b6f0 con 0x7f2694067d30 2023-10-18T17:24:48.728 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.720+0000 7f2698ee0700 1 -- 172.21.15.158:0/3706257614 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268800ba70 con 0x7f2694067d30 2023-10-18T17:24:48.728 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.724+0000 7f269aee4700 1 -- 172.21.15.158:0/3706257614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2694067d30 msgr2=0x7f26940630e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:48.728 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.724+0000 7f269aee4700 1 --2- 172.21.15.158:0/3706257614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2694067d30 0x7f26940630e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f2688009760 tx=0x7f2688009060).stop 2023-10-18T17:24:48.728 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.724+0000 7f269aee4700 1 -- 172.21.15.158:0/3706257614 shutdown_connections 2023-10-18T17:24:48.728 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.724+0000 7f269aee4700 1 --2- 172.21.15.158:0/3706257614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2694067d30 0x7f26940630e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:48.729 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.724+0000 7f269aee4700 1 -- 172.21.15.158:0/3706257614 >> 172.21.15.158:0/3706257614 conn(0x7f2694062ba0 msgr2=0x7f26940c6330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:48.729 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.724+0000 7f269aee4700 1 -- 172.21.15.158:0/3706257614 shutdown_connections 2023-10-18T17:24:48.729 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.724+0000 7f269aee4700 1 -- 172.21.15.158:0/3706257614 wait complete. 2023-10-18T17:24:48.730 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.724+0000 7f269aee4700 1 Processor -- start 2023-10-18T17:24:48.730 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.724+0000 7f269aee4700 1 -- start start 2023-10-18T17:24:48.730 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.724+0000 7f269aee4700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2694067d30 0x7f2694163790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:48.731 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.724+0000 7f269aee4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2694068180 0x7f2694163c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:48.731 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.724+0000 7f269aee4700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f269414d170 0x7f26940bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:48.731 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.724+0000 7f269aee4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26940bd280 con 0x7f2694068180 2023-10-18T17:24:48.731 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.724+0000 7f269aee4700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2694164170 con 0x7f269414d170 2023-10-18T17:24:48.731 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.724+0000 7f269aee4700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26941643d0 con 0x7f2694067d30 2023-10-18T17:24:48.732 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.728+0000 7f26996e1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2694068180 0x7f2694163c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:48.733 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.728+0000 7f2699ee2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2694067d30 0x7f2694163790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:48.733 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.728+0000 7f26996e1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2694068180 0x7f2694163c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:33612/0 (socket says 172.21.15.158:33612) 2023-10-18T17:24:48.733 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.728+0000 7f26996e1700 1 -- 172.21.15.158:0/542468434 learned_addr learned my addr 172.21.15.158:0/542468434 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:48.733 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.728+0000 7f269a6e3700 1 --2- 172.21.15.158:0/542468434 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f269414d170 0x7f26940bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:48.733 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.728+0000 7f26996e1700 1 -- 172.21.15.158:0/542468434 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2694067d30 msgr2=0x7f2694163790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:48.734 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.728+0000 7f26996e1700 1 --2- 172.21.15.158:0/542468434 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2694067d30 0x7f2694163790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:48.734 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.728+0000 7f26996e1700 1 -- 172.21.15.158:0/542468434 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f269414d170 msgr2=0x7f26940bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:48.734 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.728+0000 7f26996e1700 1 --2- 172.21.15.158:0/542468434 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f269414d170 0x7f26940bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:48.734 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.728+0000 7f26996e1700 1 -- 172.21.15.158:0/542468434 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26880092a0 con 0x7f2694068180 2023-10-18T17:24:48.734 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.728+0000 7f26996e1700 1 --2- 172.21.15.158:0/542468434 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2694068180 0x7f2694163c80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f2688009e00 tx=0x7f2688017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:48.735 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.728+0000 7f2685ffb700 1 -- 172.21.15.158:0/542468434 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268800b860 con 0x7f2694068180 2023-10-18T17:24:48.735 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.728+0000 7f2685ffb700 1 -- 172.21.15.158:0/542468434 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268800b9c0 con 0x7f2694068180 2023-10-18T17:24:48.735 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.728+0000 7f269aee4700 1 -- 172.21.15.158:0/542468434 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26940bf2b0 con 0x7f2694068180 2023-10-18T17:24:48.735 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.728+0000 7f2685ffb700 1 -- 172.21.15.158:0/542468434 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268801b660 con 0x7f2694068180 2023-10-18T17:24:48.735 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.728+0000 7f269aee4700 1 -- 172.21.15.158:0/542468434 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26940bf550 con 0x7f2694068180 2023-10-18T17:24:48.736 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.732+0000 7f269aee4700 1 -- 172.21.15.158:0/542468434 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2694046f00 con 0x7f2694068180 2023-10-18T17:24:48.736 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.732+0000 7f2685ffb700 1 -- 172.21.15.158:0/542468434 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f268801ba50 con 0x7f2694068180 2023-10-18T17:24:48.737 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.732+0000 7f2685ffb700 1 --2- 172.21.15.158:0/542468434 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f267805a510 0x7f267805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:48.737 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.732+0000 7f2685ffb700 1 -- 172.21.15.158:0/542468434 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2688075f80 con 0x7f2694068180 2023-10-18T17:24:48.737 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.732+0000 7f2699ee2700 1 --2- 172.21.15.158:0/542468434 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f267805a510 0x7f267805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:48.738 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.732+0000 7f2699ee2700 1 --2- 172.21.15.158:0/542468434 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f267805a510 0x7f267805c9d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f2690007fd0 tx=0x7f2690009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:48.744 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.740+0000 7f2685ffb700 1 -- 172.21.15.158:0/542468434 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f2688049760 con 0x7f2694068180 2023-10-18T17:24:48.939 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.936+0000 7f269aee4700 1 -- 172.21.15.158:0/542468434 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f26940661a0 con 0x7f2694068180 2023-10-18T17:24:48.940 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.936+0000 7f2685ffb700 1 -- 172.21.15.158:0/542468434 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f268804cd80 con 0x7f2694068180 2023-10-18T17:24:48.940 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:48.945 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.940+0000 7f269aee4700 1 -- 172.21.15.158:0/542468434 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f267805a510 msgr2=0x7f267805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:48.945 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.940+0000 7f269aee4700 1 --2- 172.21.15.158:0/542468434 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f267805a510 0x7f267805c9d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f2690007fd0 tx=0x7f2690009040).stop 2023-10-18T17:24:48.945 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.940+0000 7f269aee4700 1 -- 172.21.15.158:0/542468434 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2694068180 msgr2=0x7f2694163c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:48.945 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.940+0000 7f269aee4700 1 --2- 172.21.15.158:0/542468434 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2694068180 0x7f2694163c80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f2688009e00 tx=0x7f2688017000).stop 2023-10-18T17:24:48.946 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.940+0000 7f269aee4700 1 -- 172.21.15.158:0/542468434 shutdown_connections 2023-10-18T17:24:48.946 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.940+0000 7f269aee4700 1 --2- 172.21.15.158:0/542468434 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f267805a510 0x7f267805c9d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:48.946 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.940+0000 7f269aee4700 1 --2- 172.21.15.158:0/542468434 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f269414d170 0x7f26940bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:48.946 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.940+0000 7f269aee4700 1 --2- 172.21.15.158:0/542468434 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2694068180 0x7f2694163c80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:48.946 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.940+0000 7f269aee4700 1 --2- 172.21.15.158:0/542468434 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2694067d30 0x7f2694163790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:48.947 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.940+0000 7f269aee4700 1 -- 172.21.15.158:0/542468434 >> 172.21.15.158:0/542468434 conn(0x7f2694062ba0 msgr2=0x7f269414db50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:48.947 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.940+0000 7f269aee4700 1 -- 172.21.15.158:0/542468434 shutdown_connections 2023-10-18T17:24:48.947 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:48.940+0000 7f269aee4700 1 -- 172.21.15.158:0/542468434 wait complete. 2023-10-18T17:24:48.968 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:24:50.536 INFO:tasks.ceph.mds.d.smithi183.stderr:terminate called after throwing an instance of 'boost::wrapexcept' 2023-10-18T17:24:50.536 INFO:tasks.ceph.mds.d.smithi183.stderr: what(): boost::bad_get: failed value get using boost::get 2023-10-18T17:24:50.537 INFO:tasks.ceph.mds.d.smithi183.stderr:*** Caught signal (Aborted) ** 2023-10-18T17:24:50.537 INFO:tasks.ceph.mds.d.smithi183.stderr: in thread 7fa8ff017700 thread_name:ms_dispatch 2023-10-18T17:24:50.537 INFO:tasks.ceph.mds.d.smithi183.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:24:50.537 INFO:tasks.ceph.mds.d.smithi183.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fa904276420] 2023-10-18T17:24:50.537 INFO:tasks.ceph.mds.d.smithi183.stderr: 2: gsignal() 2023-10-18T17:24:50.538 INFO:tasks.ceph.mds.d.smithi183.stderr: 3: abort() 2023-10-18T17:24:50.538 INFO:tasks.ceph.mds.d.smithi183.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7fa904118911] 2023-10-18T17:24:50.538 INFO:tasks.ceph.mds.d.smithi183.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7fa90412438c] 2023-10-18T17:24:50.538 INFO:tasks.ceph.mds.d.smithi183.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7fa9041243f7] 2023-10-18T17:24:50.538 INFO:tasks.ceph.mds.d.smithi183.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7fa9041246a9] 2023-10-18T17:24:50.539 INFO:tasks.ceph.mds.d.smithi183.stderr: 8: ceph-mds(+0x185107) [0x557ef5989107] 2023-10-18T17:24:50.539 INFO:tasks.ceph.mds.d.smithi183.stderr: 9: ceph-mds(+0x18572d) [0x557ef598972d] 2023-10-18T17:24:50.539 INFO:tasks.ceph.mds.d.smithi183.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x557ef59fb09f] 2023-10-18T17:24:50.539 INFO:tasks.ceph.mds.d.smithi183.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x557ef59fca95] 2023-10-18T17:24:50.539 INFO:tasks.ceph.mds.d.smithi183.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x557ef59c7b10] 2023-10-18T17:24:50.540 INFO:tasks.ceph.mds.d.smithi183.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x557ef59cbabf] 2023-10-18T17:24:50.540 INFO:tasks.ceph.mds.d.smithi183.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x557ef59cc456] 2023-10-18T17:24:50.540 INFO:tasks.ceph.mds.d.smithi183.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7fa90477c710] 2023-10-18T17:24:50.540 INFO:tasks.ceph.mds.d.smithi183.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7fa904779faf] 2023-10-18T17:24:50.540 INFO:tasks.ceph.mds.d.smithi183.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa904848b21] 2023-10-18T17:24:50.541 INFO:tasks.ceph.mds.d.smithi183.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fa90426a609] 2023-10-18T17:24:50.541 INFO:tasks.ceph.mds.d.smithi183.stderr: 19: clone() 2023-10-18T17:24:50.541 INFO:tasks.ceph.mds.d.smithi183.stderr:2023-10-18T17:24:50.529+0000 7fa8ff017700 -1 *** Caught signal (Aborted) ** 2023-10-18T17:24:50.541 INFO:tasks.ceph.mds.d.smithi183.stderr: in thread 7fa8ff017700 thread_name:ms_dispatch 2023-10-18T17:24:50.541 INFO:tasks.ceph.mds.d.smithi183.stderr: 2023-10-18T17:24:50.542 INFO:tasks.ceph.mds.d.smithi183.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:24:50.542 INFO:tasks.ceph.mds.d.smithi183.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fa904276420] 2023-10-18T17:24:50.542 INFO:tasks.ceph.mds.d.smithi183.stderr: 2: gsignal() 2023-10-18T17:24:50.542 INFO:tasks.ceph.mds.d.smithi183.stderr: 3: abort() 2023-10-18T17:24:50.543 INFO:tasks.ceph.mds.d.smithi183.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7fa904118911] 2023-10-18T17:24:50.543 INFO:tasks.ceph.mds.d.smithi183.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7fa90412438c] 2023-10-18T17:24:50.543 INFO:tasks.ceph.mds.d.smithi183.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7fa9041243f7] 2023-10-18T17:24:50.543 INFO:tasks.ceph.mds.d.smithi183.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7fa9041246a9] 2023-10-18T17:24:50.543 INFO:tasks.ceph.mds.d.smithi183.stderr: 8: ceph-mds(+0x185107) [0x557ef5989107] 2023-10-18T17:24:50.544 INFO:tasks.ceph.mds.d.smithi183.stderr: 9: ceph-mds(+0x18572d) [0x557ef598972d] 2023-10-18T17:24:50.544 INFO:tasks.ceph.mds.d.smithi183.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x557ef59fb09f] 2023-10-18T17:24:50.544 INFO:tasks.ceph.mds.d.smithi183.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x557ef59fca95] 2023-10-18T17:24:50.544 INFO:tasks.ceph.mds.d.smithi183.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x557ef59c7b10] 2023-10-18T17:24:50.544 INFO:tasks.ceph.mds.d.smithi183.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x557ef59cbabf] 2023-10-18T17:24:50.545 INFO:tasks.ceph.mds.d.smithi183.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x557ef59cc456] 2023-10-18T17:24:50.545 INFO:tasks.ceph.mds.d.smithi183.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7fa90477c710] 2023-10-18T17:24:50.545 INFO:tasks.ceph.mds.d.smithi183.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7fa904779faf] 2023-10-18T17:24:50.545 INFO:tasks.ceph.mds.d.smithi183.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa904848b21] 2023-10-18T17:24:50.545 INFO:tasks.ceph.mds.d.smithi183.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fa90426a609] 2023-10-18T17:24:50.546 INFO:tasks.ceph.mds.d.smithi183.stderr: 19: clone() 2023-10-18T17:24:50.546 INFO:tasks.ceph.mds.d.smithi183.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T17:24:50.546 INFO:tasks.ceph.mds.d.smithi183.stderr: 2023-10-18T17:24:50.546 INFO:tasks.ceph.mds.d.smithi183.stderr: 0> 2023-10-18T17:24:50.529+0000 7fa8ff017700 -1 *** Caught signal (Aborted) ** 2023-10-18T17:24:50.547 INFO:tasks.ceph.mds.d.smithi183.stderr: in thread 7fa8ff017700 thread_name:ms_dispatch 2023-10-18T17:24:50.547 INFO:tasks.ceph.mds.d.smithi183.stderr: 2023-10-18T17:24:50.547 INFO:tasks.ceph.mds.d.smithi183.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:24:50.547 INFO:tasks.ceph.mds.d.smithi183.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fa904276420] 2023-10-18T17:24:50.547 INFO:tasks.ceph.mds.d.smithi183.stderr: 2: gsignal() 2023-10-18T17:24:50.547 INFO:tasks.ceph.mds.d.smithi183.stderr: 3: abort() 2023-10-18T17:24:50.548 INFO:tasks.ceph.mds.d.smithi183.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7fa904118911] 2023-10-18T17:24:50.548 INFO:tasks.ceph.mds.d.smithi183.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7fa90412438c] 2023-10-18T17:24:50.548 INFO:tasks.ceph.mds.d.smithi183.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7fa9041243f7] 2023-10-18T17:24:50.548 INFO:tasks.ceph.mds.d.smithi183.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7fa9041246a9] 2023-10-18T17:24:50.548 INFO:tasks.ceph.mds.d.smithi183.stderr: 8: ceph-mds(+0x185107) [0x557ef5989107] 2023-10-18T17:24:50.549 INFO:tasks.ceph.mds.d.smithi183.stderr: 9: ceph-mds(+0x18572d) [0x557ef598972d] 2023-10-18T17:24:50.549 INFO:tasks.ceph.mds.d.smithi183.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x557ef59fb09f] 2023-10-18T17:24:50.549 INFO:tasks.ceph.mds.d.smithi183.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x557ef59fca95] 2023-10-18T17:24:50.549 INFO:tasks.ceph.mds.d.smithi183.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x557ef59c7b10] 2023-10-18T17:24:50.549 INFO:tasks.ceph.mds.d.smithi183.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x557ef59cbabf] 2023-10-18T17:24:50.550 INFO:tasks.ceph.mds.d.smithi183.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x557ef59cc456] 2023-10-18T17:24:50.550 INFO:tasks.ceph.mds.d.smithi183.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7fa90477c710] 2023-10-18T17:24:50.550 INFO:tasks.ceph.mds.d.smithi183.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7fa904779faf] 2023-10-18T17:24:50.550 INFO:tasks.ceph.mds.d.smithi183.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa904848b21] 2023-10-18T17:24:50.551 INFO:tasks.ceph.mds.d.smithi183.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fa90426a609] 2023-10-18T17:24:50.551 INFO:tasks.ceph.mds.d.smithi183.stderr: 19: clone() 2023-10-18T17:24:50.551 INFO:tasks.ceph.mds.d.smithi183.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T17:24:50.551 INFO:tasks.ceph.mds.d.smithi183.stderr: 2023-10-18T17:24:50.552 INFO:tasks.ceph.mds.d.smithi183.stderr: 0> 2023-10-18T17:24:50.529+0000 7fa8ff017700 -1 *** Caught signal (Aborted) ** 2023-10-18T17:24:50.552 INFO:tasks.ceph.mds.d.smithi183.stderr: in thread 7fa8ff017700 thread_name:ms_dispatch 2023-10-18T17:24:50.552 INFO:tasks.ceph.mds.d.smithi183.stderr: 2023-10-18T17:24:50.552 INFO:tasks.ceph.mds.d.smithi183.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:24:50.552 INFO:tasks.ceph.mds.d.smithi183.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fa904276420] 2023-10-18T17:24:50.553 INFO:tasks.ceph.mds.d.smithi183.stderr: 2: gsignal() 2023-10-18T17:24:50.553 INFO:tasks.ceph.mds.d.smithi183.stderr: 3: abort() 2023-10-18T17:24:50.553 INFO:tasks.ceph.mds.d.smithi183.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7fa904118911] 2023-10-18T17:24:50.553 INFO:tasks.ceph.mds.d.smithi183.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7fa90412438c] 2023-10-18T17:24:50.554 INFO:tasks.ceph.mds.d.smithi183.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7fa9041243f7] 2023-10-18T17:24:50.554 INFO:tasks.ceph.mds.d.smithi183.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7fa9041246a9] 2023-10-18T17:24:50.554 INFO:tasks.ceph.mds.d.smithi183.stderr: 8: ceph-mds(+0x185107) [0x557ef5989107] 2023-10-18T17:24:50.554 INFO:tasks.ceph.mds.d.smithi183.stderr: 9: ceph-mds(+0x18572d) [0x557ef598972d] 2023-10-18T17:24:50.554 INFO:tasks.ceph.mds.d.smithi183.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x557ef59fb09f] 2023-10-18T17:24:50.555 INFO:tasks.ceph.mds.d.smithi183.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x557ef59fca95] 2023-10-18T17:24:50.555 INFO:tasks.ceph.mds.d.smithi183.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x557ef59c7b10] 2023-10-18T17:24:50.555 INFO:tasks.ceph.mds.d.smithi183.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x557ef59cbabf] 2023-10-18T17:24:50.555 INFO:tasks.ceph.mds.d.smithi183.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x557ef59cc456] 2023-10-18T17:24:50.555 INFO:tasks.ceph.mds.d.smithi183.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7fa90477c710] 2023-10-18T17:24:50.556 INFO:tasks.ceph.mds.d.smithi183.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7fa904779faf] 2023-10-18T17:24:50.556 INFO:tasks.ceph.mds.d.smithi183.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa904848b21] 2023-10-18T17:24:50.556 INFO:tasks.ceph.mds.d.smithi183.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fa90426a609] 2023-10-18T17:24:50.556 INFO:tasks.ceph.mds.d.smithi183.stderr: 19: clone() 2023-10-18T17:24:50.557 INFO:tasks.ceph.mds.d.smithi183.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T17:24:50.558 INFO:tasks.ceph.mds.d.smithi183.stderr: 2023-10-18T17:24:50.649 INFO:tasks.ceph.mds.d.smithi183.stderr:daemon-helper: command crashed with signal 6 2023-10-18T17:24:51.969 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:24:52.126 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.120+0000 7f42e92db700 1 Processor -- start 2023-10-18T17:24:52.126 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.120+0000 7f42e92db700 1 -- start start 2023-10-18T17:24:52.127 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.124+0000 7f42e92db700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f42e414b1d0 0x7f42e414e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:52.128 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.124+0000 7f42e92db700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42e414b5b0 0x7f42e40bcd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:52.128 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.124+0000 7f42e92db700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f42e40bf8d0 0x7f42e40bd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:52.128 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.124+0000 7f42e92db700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e414dd30 con 0x7f42e414b1d0 2023-10-18T17:24:52.128 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.124+0000 7f42e92db700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e4062430 con 0x7f42e40bf8d0 2023-10-18T17:24:52.128 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.124+0000 7f42e92db700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e4062710 con 0x7f42e414b5b0 2023-10-18T17:24:52.129 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.124+0000 7f42da7fc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42e414b5b0 0x7f42e40bcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:52.130 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.124+0000 7f42da7fc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42e414b5b0 0x7f42e40bcd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:35078/0 (socket says 172.21.15.158:35078) 2023-10-18T17:24:52.130 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.124+0000 7f42da7fc700 1 -- 172.21.15.158:0/2473420737 learned_addr learned my addr 172.21.15.158:0/2473420737 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:52.130 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.124+0000 7f42e2ffd700 1 --2- 172.21.15.158:0/2473420737 >> v2:172.21.15.158:3300/0 conn(0x7f42e414b1d0 0x7f42e414e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:52.130 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.124+0000 7f42e3fff700 1 --2- 172.21.15.158:0/2473420737 >> v2:172.21.15.183:3300/0 conn(0x7f42e40bf8d0 0x7f42e40bd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:52.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.124+0000 7f42da7fc700 1 -- 172.21.15.158:0/2473420737 >> v2:172.21.15.183:3300/0 conn(0x7f42e40bf8d0 msgr2=0x7f42e40bd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:52.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.124+0000 7f42da7fc700 1 --2- 172.21.15.158:0/2473420737 >> v2:172.21.15.183:3300/0 conn(0x7f42e40bf8d0 0x7f42e40bd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:52.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.124+0000 7f42da7fc700 1 -- 172.21.15.158:0/2473420737 >> v2:172.21.15.158:3300/0 conn(0x7f42e414b1d0 msgr2=0x7f42e414e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:52.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.124+0000 7f42da7fc700 1 --2- 172.21.15.158:0/2473420737 >> v2:172.21.15.158:3300/0 conn(0x7f42e414b1d0 0x7f42e414e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:52.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.124+0000 7f42da7fc700 1 -- 172.21.15.158:0/2473420737 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e40629f0 con 0x7f42e414b5b0 2023-10-18T17:24:52.132 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.124+0000 7f42da7fc700 1 --2- 172.21.15.158:0/2473420737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42e414b5b0 0x7f42e40bcd70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f42e40c0830 tx=0x7f42cc009840).ready entity=mon.2 client_cookie=65622db48bc643ea server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:52.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.128+0000 7f42e27fc700 1 -- 172.21.15.158:0/2473420737 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc00e070 con 0x7f42e414b5b0 2023-10-18T17:24:52.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.128+0000 7f42e27fc700 1 -- 172.21.15.158:0/2473420737 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc00b970 con 0x7f42e414b5b0 2023-10-18T17:24:52.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.128+0000 7f42e27fc700 1 -- 172.21.15.158:0/2473420737 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc00bcf0 con 0x7f42e414b5b0 2023-10-18T17:24:52.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.128+0000 7f42e92db700 1 -- 172.21.15.158:0/2473420737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42e414b5b0 msgr2=0x7f42e40bcd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:52.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.128+0000 7f42e92db700 1 --2- 172.21.15.158:0/2473420737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42e414b5b0 0x7f42e40bcd70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f42e40c0830 tx=0x7f42cc009840).stop 2023-10-18T17:24:52.134 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.128+0000 7f42e92db700 1 -- 172.21.15.158:0/2473420737 shutdown_connections 2023-10-18T17:24:52.134 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.128+0000 7f42e92db700 1 --2- 172.21.15.158:0/2473420737 >> v2:172.21.15.183:3300/0 conn(0x7f42e40bf8d0 0x7f42e40bd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:52.134 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.128+0000 7f42e92db700 1 --2- 172.21.15.158:0/2473420737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42e414b5b0 0x7f42e40bcd70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:52.134 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.128+0000 7f42e92db700 1 --2- 172.21.15.158:0/2473420737 >> v2:172.21.15.158:3300/0 conn(0x7f42e414b1d0 0x7f42e414e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:52.134 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.128+0000 7f42e92db700 1 -- 172.21.15.158:0/2473420737 >> 172.21.15.158:0/2473420737 conn(0x7f42e40699e0 msgr2=0x7f42e4069df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:52.135 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.128+0000 7f42e92db700 1 -- 172.21.15.158:0/2473420737 shutdown_connections 2023-10-18T17:24:52.135 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.128+0000 7f42e92db700 1 -- 172.21.15.158:0/2473420737 wait complete. 2023-10-18T17:24:52.137 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.128+0000 7f42e92db700 1 Processor -- start 2023-10-18T17:24:52.137 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.128+0000 7f42e92db700 1 -- start start 2023-10-18T17:24:52.137 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42e92db700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42e40bf8d0 0x7f42e4148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:52.137 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42e92db700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f42e414b1d0 0x7f42e415e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:52.138 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42e92db700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42e415e760 0x7f42e41637d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:52.138 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42e92db700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e4163410 con 0x7f42e414b1d0 2023-10-18T17:24:52.138 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42e92db700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e40c2860 con 0x7f42e40bf8d0 2023-10-18T17:24:52.138 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42e92db700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e4162520 con 0x7f42e415e760 2023-10-18T17:24:52.138 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42da7fc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f42e414b1d0 0x7f42e415e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:52.139 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42e2ffd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42e40bf8d0 0x7f42e4148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:52.139 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42da7fc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f42e414b1d0 0x7f42e415e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:43552/0 (socket says 172.21.15.158:43552) 2023-10-18T17:24:52.139 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42da7fc700 1 -- 172.21.15.158:0/882959073 learned_addr learned my addr 172.21.15.158:0/882959073 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:52.139 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42e3fff700 1 --2- 172.21.15.158:0/882959073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42e415e760 0x7f42e41637d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:52.139 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42da7fc700 1 -- 172.21.15.158:0/882959073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42e415e760 msgr2=0x7f42e41637d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:52.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42da7fc700 1 --2- 172.21.15.158:0/882959073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42e415e760 0x7f42e41637d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:52.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42da7fc700 1 -- 172.21.15.158:0/882959073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42e40bf8d0 msgr2=0x7f42e4148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:52.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42da7fc700 1 --2- 172.21.15.158:0/882959073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42e40bf8d0 0x7f42e4148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:52.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42da7fc700 1 -- 172.21.15.158:0/882959073 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc009ae0 con 0x7f42e414b1d0 2023-10-18T17:24:52.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42e2ffd700 1 --2- 172.21.15.158:0/882959073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42e40bf8d0 0x7f42e4148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:52.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42da7fc700 1 --2- 172.21.15.158:0/882959073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f42e414b1d0 0x7f42e415e270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f42cc00b610 tx=0x7f42cc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:52.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42db7fe700 1 -- 172.21.15.158:0/882959073 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc00bee0 con 0x7f42e414b1d0 2023-10-18T17:24:52.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42db7fe700 1 -- 172.21.15.158:0/882959073 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc00bcf0 con 0x7f42e414b1d0 2023-10-18T17:24:52.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42db7fe700 1 -- 172.21.15.158:0/882959073 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc01f6d0 con 0x7f42e414b1d0 2023-10-18T17:24:52.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42e92db700 1 -- 172.21.15.158:0/882959073 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e4162800 con 0x7f42e414b1d0 2023-10-18T17:24:52.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.132+0000 7f42e92db700 1 -- 172.21.15.158:0/882959073 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e4162dc0 con 0x7f42e414b1d0 2023-10-18T17:24:52.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.136+0000 7f42e92db700 1 -- 172.21.15.158:0/882959073 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e4163580 con 0x7f42e414b1d0 2023-10-18T17:24:52.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.136+0000 7f42db7fe700 1 -- 172.21.15.158:0/882959073 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f42cc003040 con 0x7f42e414b1d0 2023-10-18T17:24:52.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.136+0000 7f42db7fe700 1 --2- 172.21.15.158:0/882959073 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f42c405a540 0x7f42c405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:52.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.136+0000 7f42db7fe700 1 -- 172.21.15.158:0/882959073 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6381+0+0 (secure 0 0 0) 0x7f42cc076180 con 0x7f42e414b1d0 2023-10-18T17:24:52.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.136+0000 7f42e2ffd700 1 --2- 172.21.15.158:0/882959073 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f42c405a540 0x7f42c405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:52.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.140+0000 7f42e2ffd700 1 --2- 172.21.15.158:0/882959073 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f42c405a540 0x7f42c405ca00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f42d4011310 tx=0x7f42d4009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:52.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.144+0000 7f42db7fe700 1 -- 172.21.15.158:0/882959073 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f42cc049850 con 0x7f42e414b1d0 2023-10-18T17:24:52.350 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.348+0000 7f42e92db700 1 -- 172.21.15.158:0/882959073 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f42e406c190 con 0x7f42e414b1d0 2023-10-18T17:24:52.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.348+0000 7f42db7fe700 1 -- 172.21.15.158:0/882959073 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f42cc024020 con 0x7f42e414b1d0 2023-10-18T17:24:52.351 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:52.354 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.348+0000 7f42e92db700 1 -- 172.21.15.158:0/882959073 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f42c405a540 msgr2=0x7f42c405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:52.354 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.348+0000 7f42e92db700 1 --2- 172.21.15.158:0/882959073 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f42c405a540 0x7f42c405ca00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f42d4011310 tx=0x7f42d4009060).stop 2023-10-18T17:24:52.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.348+0000 7f42e92db700 1 -- 172.21.15.158:0/882959073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f42e414b1d0 msgr2=0x7f42e415e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:52.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.348+0000 7f42e92db700 1 --2- 172.21.15.158:0/882959073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f42e414b1d0 0x7f42e415e270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f42cc00b610 tx=0x7f42cc009840).stop 2023-10-18T17:24:52.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.352+0000 7f42e92db700 1 -- 172.21.15.158:0/882959073 shutdown_connections 2023-10-18T17:24:52.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.352+0000 7f42e92db700 1 --2- 172.21.15.158:0/882959073 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f42c405a540 0x7f42c405ca00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:52.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.352+0000 7f42e92db700 1 --2- 172.21.15.158:0/882959073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42e415e760 0x7f42e41637d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:52.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.352+0000 7f42e92db700 1 --2- 172.21.15.158:0/882959073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f42e414b1d0 0x7f42e415e270 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:52.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.352+0000 7f42e92db700 1 --2- 172.21.15.158:0/882959073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42e40bf8d0 0x7f42e4148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:52.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.352+0000 7f42e92db700 1 -- 172.21.15.158:0/882959073 >> 172.21.15.158:0/882959073 conn(0x7f42e40699e0 msgr2=0x7f42e414bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:52.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.352+0000 7f42e92db700 1 -- 172.21.15.158:0/882959073 shutdown_connections 2023-10-18T17:24:52.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:52.352+0000 7f42e92db700 1 -- 172.21.15.158:0/882959073 wait complete. 2023-10-18T17:24:52.377 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:24:53.531 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~41s 2023-10-18T17:24:53.531 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-18T17:24:55.379 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:24:55.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.533+0000 7f6904c39700 1 Processor -- start 2023-10-18T17:24:55.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.533+0000 7f6904c39700 1 -- start start 2023-10-18T17:24:55.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.537+0000 7f6904c39700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f69001498d0 0x7f69000bd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:55.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.537+0000 7f6904c39700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6900063350 0x7f69000637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:55.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.537+0000 7f6904c39700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690014c380 con 0x7f69000bc930 2023-10-18T17:24:55.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.537+0000 7f6904c39700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f690014c640 con 0x7f69001498d0 2023-10-18T17:24:55.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.537+0000 7f6904c39700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690014c920 con 0x7f6900063350 2023-10-18T17:24:55.542 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.537+0000 7f68feffd700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f69000bc930 0x7f69000bdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:32952/0 (socket says 172.21.15.158:32952) 2023-10-18T17:24:55.542 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.537+0000 7f68feffd700 1 -- 172.21.15.158:0/463601212 learned_addr learned my addr 172.21.15.158:0/463601212 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:55.542 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.537+0000 7f68fffff700 1 --2- 172.21.15.158:0/463601212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6900063350 0x7f69000637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:55.542 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.537+0000 7f68ff7fe700 1 --2- 172.21.15.158:0/463601212 >> v2:172.21.15.183:3300/0 conn(0x7f69001498d0 0x7f69000bd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:55.542 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.537+0000 7f68fe7fc700 1 -- 172.21.15.158:0/463601212 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169333366 0 0) 0x7f690014c380 con 0x7f69000bc930 2023-10-18T17:24:55.543 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.537+0000 7f68fe7fc700 1 -- 172.21.15.158:0/463601212 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68e80033f0 con 0x7f69000bc930 2023-10-18T17:24:55.543 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.537+0000 7f68fffff700 1 -- 172.21.15.158:0/463601212 >> v2:172.21.15.183:3300/0 conn(0x7f69001498d0 msgr2=0x7f69000bd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:24:55.543 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.537+0000 7f68fffff700 1 --2- 172.21.15.158:0/463601212 >> v2:172.21.15.183:3300/0 conn(0x7f69001498d0 0x7f69000bd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:55.543 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.537+0000 7f68fffff700 1 -- 172.21.15.158:0/463601212 >> v1:172.21.15.158:6789/0 conn(0x7f69000bc930 legacy=0x7f69000bdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:55.543 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.537+0000 7f68fffff700 1 -- 172.21.15.158:0/463601212 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690014cc00 con 0x7f6900063350 2023-10-18T17:24:55.544 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.537+0000 7f68fffff700 1 --2- 172.21.15.158:0/463601212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6900063350 0x7f69000637c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f68f8009e60 tx=0x7f68f8009780).ready entity=mon.2 client_cookie=c6cf0b2cea949e6d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:55.545 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.541+0000 7f68fe7fc700 1 -- 172.21.15.158:0/463601212 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f800e070 con 0x7f6900063350 2023-10-18T17:24:55.545 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.541+0000 7f68fe7fc700 1 -- 172.21.15.158:0/463601212 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f800bab0 con 0x7f6900063350 2023-10-18T17:24:55.545 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.541+0000 7f68fe7fc700 1 -- 172.21.15.158:0/463601212 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f800be30 con 0x7f6900063350 2023-10-18T17:24:55.545 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.541+0000 7f6904c39700 1 -- 172.21.15.158:0/463601212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6900063350 msgr2=0x7f69000637c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:55.546 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.541+0000 7f6904c39700 1 --2- 172.21.15.158:0/463601212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6900063350 0x7f69000637c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f68f8009e60 tx=0x7f68f8009780).stop 2023-10-18T17:24:55.546 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.541+0000 7f6904c39700 1 -- 172.21.15.158:0/463601212 shutdown_connections 2023-10-18T17:24:55.546 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.541+0000 7f6904c39700 1 --2- 172.21.15.158:0/463601212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6900063350 0x7f69000637c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:55.546 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.541+0000 7f6904c39700 1 --2- 172.21.15.158:0/463601212 >> v2:172.21.15.183:3300/0 conn(0x7f69001498d0 0x7f69000bd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:55.546 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.541+0000 7f6904c39700 1 -- 172.21.15.158:0/463601212 >> 172.21.15.158:0/463601212 conn(0x7f6900062ba0 msgr2=0x7f69000c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:55.547 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.541+0000 7f6904c39700 1 -- 172.21.15.158:0/463601212 shutdown_connections 2023-10-18T17:24:55.547 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.541+0000 7f6904c39700 1 -- 172.21.15.158:0/463601212 wait complete. 2023-10-18T17:24:55.547 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.545+0000 7f6904c39700 1 Processor -- start 2023-10-18T17:24:55.548 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.545+0000 7f6904c39700 1 -- start start 2023-10-18T17:24:55.548 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.545+0000 7f6904c39700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6900063350 0x7f6900160c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:55.549 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.545+0000 7f6904c39700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69000bc930 0x7f690014a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:55.549 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.545+0000 7f6904c39700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69001498d0 0x7f69000c1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:55.549 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.545+0000 7f6904c39700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6900164520 con 0x7f6900063350 2023-10-18T17:24:55.549 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.545+0000 7f6904c39700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690014ac80 con 0x7f69000bc930 2023-10-18T17:24:55.549 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.545+0000 7f6904c39700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6900065e70 con 0x7f69001498d0 2023-10-18T17:24:55.551 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.545+0000 7f68ff7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6900063350 0x7f6900160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:55.551 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.545+0000 7f68fffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69001498d0 0x7f69000c1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:55.551 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.545+0000 7f68feffd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69000bc930 0x7f690014a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:55.552 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.545+0000 7f68feffd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69000bc930 0x7f690014a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:58214/0 (socket says 172.21.15.158:58214) 2023-10-18T17:24:55.552 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.545+0000 7f68feffd700 1 -- 172.21.15.158:0/3022932387 learned_addr learned my addr 172.21.15.158:0/3022932387 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:55.552 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.545+0000 7f68fffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69001498d0 0x7f69000c1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:35122/0 (socket says 172.21.15.158:35122) 2023-10-18T17:24:55.552 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.549+0000 7f68ff7fe700 1 -- 172.21.15.158:0/3022932387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69001498d0 msgr2=0x7f69000c1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:55.553 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.549+0000 7f68ff7fe700 1 --2- 172.21.15.158:0/3022932387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69001498d0 0x7f69000c1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:55.553 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.549+0000 7f68ff7fe700 1 -- 172.21.15.158:0/3022932387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69000bc930 msgr2=0x7f690014a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:55.553 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.549+0000 7f68ff7fe700 1 --2- 172.21.15.158:0/3022932387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69000bc930 0x7f690014a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:55.553 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.549+0000 7f68ff7fe700 1 -- 172.21.15.158:0/3022932387 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f8009a20 con 0x7f6900063350 2023-10-18T17:24:55.553 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.549+0000 7f68feffd700 1 --2- 172.21.15.158:0/3022932387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69000bc930 0x7f690014a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:24:55.553 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.549+0000 7f68ff7fe700 1 --2- 172.21.15.158:0/3022932387 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6900063350 0x7f6900160c40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f68f000e6f0 tx=0x7f68f0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:55.554 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.549+0000 7f68e77fe700 1 -- 172.21.15.158:0/3022932387 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0012600 con 0x7f6900063350 2023-10-18T17:24:55.554 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.549+0000 7f68e77fe700 1 -- 172.21.15.158:0/3022932387 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f0012760 con 0x7f6900063350 2023-10-18T17:24:55.554 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.549+0000 7f6904c39700 1 -- 172.21.15.158:0/3022932387 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69001607b0 con 0x7f6900063350 2023-10-18T17:24:55.554 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.549+0000 7f68e77fe700 1 -- 172.21.15.158:0/3022932387 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0012ae0 con 0x7f6900063350 2023-10-18T17:24:55.554 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.549+0000 7f6904c39700 1 -- 172.21.15.158:0/3022932387 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69000b5ca0 con 0x7f6900063350 2023-10-18T17:24:55.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.549+0000 7f6904c39700 1 -- 172.21.15.158:0/3022932387 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6900046f00 con 0x7f6900063350 2023-10-18T17:24:55.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.553+0000 7f68e77fe700 1 -- 172.21.15.158:0/3022932387 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f68f001b400 con 0x7f6900063350 2023-10-18T17:24:55.556 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.553+0000 7f68e77fe700 1 --2- 172.21.15.158:0/3022932387 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f68ec05a510 0x7f68ec05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:55.556 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.553+0000 7f68e77fe700 1 -- 172.21.15.158:0/3022932387 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6381+0+0 (secure 0 0 0) 0x7f68f0074b90 con 0x7f6900063350 2023-10-18T17:24:55.557 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.553+0000 7f68feffd700 1 --2- 172.21.15.158:0/3022932387 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f68ec05a510 0x7f68ec05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:55.557 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.553+0000 7f68feffd700 1 --2- 172.21.15.158:0/3022932387 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f68ec05a510 0x7f68ec05c9d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f69000bc7a0 tx=0x7f68f4009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:55.562 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.561+0000 7f68e77fe700 1 -- 172.21.15.158:0/3022932387 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f68f0048150 con 0x7f6900063350 2023-10-18T17:24:55.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.753+0000 7f6904c39700 1 -- 172.21.15.158:0/3022932387 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f690014cee0 con 0x7f6900063350 2023-10-18T17:24:55.756 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.753+0000 7f68e77fe700 1 -- 172.21.15.158:0/3022932387 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f68f0074070 con 0x7f6900063350 2023-10-18T17:24:55.756 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:55.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.757+0000 7f6904c39700 1 -- 172.21.15.158:0/3022932387 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f68ec05a510 msgr2=0x7f68ec05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:55.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.757+0000 7f6904c39700 1 --2- 172.21.15.158:0/3022932387 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f68ec05a510 0x7f68ec05c9d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f69000bc7a0 tx=0x7f68f4009040).stop 2023-10-18T17:24:55.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.757+0000 7f6904c39700 1 -- 172.21.15.158:0/3022932387 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6900063350 msgr2=0x7f6900160c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:55.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.757+0000 7f6904c39700 1 --2- 172.21.15.158:0/3022932387 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6900063350 0x7f6900160c40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f68f000e6f0 tx=0x7f68f0009060).stop 2023-10-18T17:24:55.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.757+0000 7f6904c39700 1 -- 172.21.15.158:0/3022932387 shutdown_connections 2023-10-18T17:24:55.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.757+0000 7f6904c39700 1 --2- 172.21.15.158:0/3022932387 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f68ec05a510 0x7f68ec05c9d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:55.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.757+0000 7f6904c39700 1 --2- 172.21.15.158:0/3022932387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69001498d0 0x7f69000c1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:55.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.757+0000 7f6904c39700 1 --2- 172.21.15.158:0/3022932387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69000bc930 0x7f690014a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:55.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.757+0000 7f6904c39700 1 --2- 172.21.15.158:0/3022932387 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6900063350 0x7f6900160c40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:55.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.757+0000 7f6904c39700 1 -- 172.21.15.158:0/3022932387 >> 172.21.15.158:0/3022932387 conn(0x7f6900062ba0 msgr2=0x7f69000bdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:55.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.757+0000 7f6904c39700 1 -- 172.21.15.158:0/3022932387 shutdown_connections 2023-10-18T17:24:55.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:55.757+0000 7f6904c39700 1 -- 172.21.15.158:0/3022932387 wait complete. 2023-10-18T17:24:55.779 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:24:58.780 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:24:58.942 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.941+0000 7feb6e239700 1 Processor -- start 2023-10-18T17:24:58.943 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.941+0000 7feb6e239700 1 -- start start 2023-10-18T17:24:58.944 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.941+0000 7feb6e239700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb681517c0 0x7feb6806a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:58.944 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.941+0000 7feb6e239700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb68154b00 con 0x7feb680630e0 2023-10-18T17:24:58.945 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.941+0000 7feb6e239700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb68154f90 con 0x7feb681513e0 2023-10-18T17:24:58.945 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.941+0000 7feb6e239700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb68069380 con 0x7feb681517c0 2023-10-18T17:24:58.946 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.941+0000 7feb6ca36700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb681517c0 0x7feb6806a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:58.947 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.941+0000 7feb6d237700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7feb681513e0 0x7feb68067d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:34726/0 (socket says 172.21.15.158:34726) 2023-10-18T17:24:58.947 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.941+0000 7feb6d237700 1 -- 172.21.15.158:0/3690778459 learned_addr learned my addr 172.21.15.158:0/3690778459 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:24:58.947 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.941+0000 7feb6ca36700 1 -- 172.21.15.158:0/3690778459 >> v1:172.21.15.183:6789/0 conn(0x7feb681513e0 legacy=0x7feb68067d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:58.947 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.941+0000 7feb6ca36700 1 -- 172.21.15.158:0/3690778459 >> v1:172.21.15.158:6789/0 conn(0x7feb680630e0 legacy=0x7feb68065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:58.947 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.941+0000 7feb6ca36700 1 -- 172.21.15.158:0/3690778459 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb68068570 con 0x7feb681517c0 2023-10-18T17:24:58.947 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.945+0000 7feb6ca36700 1 --2- 172.21.15.158:0/3690778459 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb681517c0 0x7feb6806a040 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7feb58009790 tx=0x7feb58009060).ready entity=mon.2 client_cookie=fb513ce537a8dec4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:58.948 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.945+0000 7feb5ffff700 1 -- 172.21.15.158:0/3690778459 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5800b5a0 con 0x7feb681517c0 2023-10-18T17:24:58.948 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.945+0000 7feb5ffff700 1 -- 172.21.15.158:0/3690778459 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5800b700 con 0x7feb681517c0 2023-10-18T17:24:58.948 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.945+0000 7feb5ffff700 1 -- 172.21.15.158:0/3690778459 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5800ba80 con 0x7feb681517c0 2023-10-18T17:24:58.949 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.945+0000 7feb6e239700 1 -- 172.21.15.158:0/3690778459 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb681517c0 msgr2=0x7feb6806a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:58.949 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.945+0000 7feb6e239700 1 --2- 172.21.15.158:0/3690778459 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb681517c0 0x7feb6806a040 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7feb58009790 tx=0x7feb58009060).stop 2023-10-18T17:24:58.949 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.945+0000 7feb6e239700 1 -- 172.21.15.158:0/3690778459 shutdown_connections 2023-10-18T17:24:58.949 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.945+0000 7feb6e239700 1 --2- 172.21.15.158:0/3690778459 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb681517c0 0x7feb6806a040 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:58.950 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.945+0000 7feb6e239700 1 -- 172.21.15.158:0/3690778459 >> 172.21.15.158:0/3690778459 conn(0x7feb68062ba0 msgr2=0x7feb680c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:58.950 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.945+0000 7feb6e239700 1 -- 172.21.15.158:0/3690778459 shutdown_connections 2023-10-18T17:24:58.950 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.945+0000 7feb6e239700 1 -- 172.21.15.158:0/3690778459 wait complete. 2023-10-18T17:24:58.951 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.945+0000 7feb6e239700 1 Processor -- start 2023-10-18T17:24:58.951 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.949+0000 7feb6e239700 1 -- start start 2023-10-18T17:24:58.952 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.949+0000 7feb6e239700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feb680630e0 0x7feb68158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:58.952 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.949+0000 7feb6e239700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb681513e0 0x7feb68164c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:58.952 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.949+0000 7feb6e239700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb681517c0 0x7feb680a6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:58.953 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.949+0000 7feb6e239700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb681588a0 con 0x7feb680630e0 2023-10-18T17:24:58.953 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.949+0000 7feb6e239700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb680b96a0 con 0x7feb681517c0 2023-10-18T17:24:58.953 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.949+0000 7feb6e239700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb681554c0 con 0x7feb681513e0 2023-10-18T17:24:58.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.949+0000 7feb6d237700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feb680630e0 0x7feb68158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:58.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.949+0000 7feb6d237700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feb680630e0 0x7feb68158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:43572/0 (socket says 172.21.15.158:43572) 2023-10-18T17:24:58.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.949+0000 7feb6d237700 1 -- 172.21.15.158:0/1376025797 learned_addr learned my addr 172.21.15.158:0/1376025797 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:24:58.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.949+0000 7feb6ca36700 1 --2- 172.21.15.158:0/1376025797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb681513e0 0x7feb68164c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:58.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.949+0000 7feb6da38700 1 --2- 172.21.15.158:0/1376025797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb681517c0 0x7feb680a6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:58.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.949+0000 7feb6d237700 1 -- 172.21.15.158:0/1376025797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb681513e0 msgr2=0x7feb68164c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:58.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.949+0000 7feb6d237700 1 --2- 172.21.15.158:0/1376025797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb681513e0 0x7feb68164c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:58.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.949+0000 7feb6d237700 1 -- 172.21.15.158:0/1376025797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb681517c0 msgr2=0x7feb680a6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:58.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.949+0000 7feb6d237700 1 --2- 172.21.15.158:0/1376025797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb681517c0 0x7feb680a6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:58.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.949+0000 7feb6d237700 1 -- 172.21.15.158:0/1376025797 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb580092a0 con 0x7feb680630e0 2023-10-18T17:24:58.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.949+0000 7feb6d237700 1 --2- 172.21.15.158:0/1376025797 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feb680630e0 0x7feb68158f20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7feb6400c410 tx=0x7feb64007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:58.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.953+0000 7feb5d7fa700 1 -- 172.21.15.158:0/1376025797 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb640070d0 con 0x7feb680630e0 2023-10-18T17:24:58.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.953+0000 7feb5d7fa700 1 -- 172.21.15.158:0/1376025797 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb64007230 con 0x7feb680630e0 2023-10-18T17:24:58.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.953+0000 7feb5d7fa700 1 -- 172.21.15.158:0/1376025797 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb640075d0 con 0x7feb680630e0 2023-10-18T17:24:58.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.953+0000 7feb6e239700 1 -- 172.21.15.158:0/1376025797 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb681651b0 con 0x7feb680630e0 2023-10-18T17:24:58.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.953+0000 7feb6e239700 1 -- 172.21.15.158:0/1376025797 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb68165770 con 0x7feb680630e0 2023-10-18T17:24:58.958 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.953+0000 7feb6e239700 1 -- 172.21.15.158:0/1376025797 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb68046f00 con 0x7feb680630e0 2023-10-18T17:24:58.958 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.953+0000 7feb5d7fa700 1 -- 172.21.15.158:0/1376025797 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7feb640059b0 con 0x7feb680630e0 2023-10-18T17:24:58.959 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.957+0000 7feb5d7fa700 1 --2- 172.21.15.158:0/1376025797 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7feb4c05a510 0x7feb4c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:24:58.959 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.957+0000 7feb5d7fa700 1 -- 172.21.15.158:0/1376025797 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6381+0+0 (secure 0 0 0) 0x7feb64073f40 con 0x7feb680630e0 2023-10-18T17:24:58.959 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.957+0000 7feb6ca36700 1 --2- 172.21.15.158:0/1376025797 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7feb4c05a510 0x7feb4c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:24:58.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.957+0000 7feb6ca36700 1 --2- 172.21.15.158:0/1376025797 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7feb4c05a510 0x7feb4c05c9d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7feb580096e0 tx=0x7feb58015000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:24:58.965 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:58.961+0000 7feb5d7fa700 1 -- 172.21.15.158:0/1376025797 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7feb64047560 con 0x7feb680630e0 2023-10-18T17:24:59.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:59.157+0000 7feb6e239700 1 -- 172.21.15.158:0/1376025797 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7feb681541d0 con 0x7feb680630e0 2023-10-18T17:24:59.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:59.157+0000 7feb5d7fa700 1 -- 172.21.15.158:0/1376025797 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7feb6404ab80 con 0x7feb680630e0 2023-10-18T17:24:59.161 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:24:59.165 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:59.161+0000 7feb6e239700 1 -- 172.21.15.158:0/1376025797 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7feb4c05a510 msgr2=0x7feb4c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:59.165 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:59.161+0000 7feb6e239700 1 --2- 172.21.15.158:0/1376025797 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7feb4c05a510 0x7feb4c05c9d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7feb580096e0 tx=0x7feb58015000).stop 2023-10-18T17:24:59.165 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:59.161+0000 7feb6e239700 1 -- 172.21.15.158:0/1376025797 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feb680630e0 msgr2=0x7feb68158f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:24:59.165 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:59.161+0000 7feb6e239700 1 --2- 172.21.15.158:0/1376025797 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feb680630e0 0x7feb68158f20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7feb6400c410 tx=0x7feb64007e50).stop 2023-10-18T17:24:59.165 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:59.161+0000 7feb6e239700 1 -- 172.21.15.158:0/1376025797 shutdown_connections 2023-10-18T17:24:59.166 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:59.161+0000 7feb6e239700 1 --2- 172.21.15.158:0/1376025797 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7feb4c05a510 0x7feb4c05c9d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:59.166 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:59.161+0000 7feb6e239700 1 --2- 172.21.15.158:0/1376025797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb681517c0 0x7feb680a6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:59.166 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:59.161+0000 7feb6e239700 1 --2- 172.21.15.158:0/1376025797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb681513e0 0x7feb68164c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:59.166 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:59.161+0000 7feb6e239700 1 --2- 172.21.15.158:0/1376025797 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feb680630e0 0x7feb68158f20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:24:59.167 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:59.161+0000 7feb6e239700 1 -- 172.21.15.158:0/1376025797 >> 172.21.15.158:0/1376025797 conn(0x7feb68062ba0 msgr2=0x7feb68153520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:24:59.167 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:59.161+0000 7feb6e239700 1 -- 172.21.15.158:0/1376025797 shutdown_connections 2023-10-18T17:24:59.167 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:24:59.161+0000 7feb6e239700 1 -- 172.21.15.158:0/1376025797 wait complete. 2023-10-18T17:24:59.185 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:25:00.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~48s 2023-10-18T17:25:00.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2023-10-18T17:25:02.186 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:25:02.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.349+0000 7fbc60d46700 1 Processor -- start 2023-10-18T17:25:02.352 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.349+0000 7fbc60d46700 1 -- start start 2023-10-18T17:25:02.354 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc60d46700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbc5c0666b0 0x7fbc5c0c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:02.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc60d46700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc5c0c2230 0x7fbc5c14cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:02.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc60d46700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5c065cf0 con 0x7fbc5c067ff0 2023-10-18T17:25:02.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc60d46700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5c150350 con 0x7fbc5c0666b0 2023-10-18T17:25:02.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc60d46700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0650e0 con 0x7fbc5c0c2230 2023-10-18T17:25:02.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc5a59c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fbc5c067ff0 0x7fbc5c0683d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:33792/0 (socket says 172.21.15.158:33792) 2023-10-18T17:25:02.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc5a59c700 1 -- 172.21.15.158:0/2000374324 learned_addr learned my addr 172.21.15.158:0/2000374324 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:25:02.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc53fff700 1 --2- 172.21.15.158:0/2000374324 >> v2:172.21.15.183:3300/0 conn(0x7fbc5c0666b0 0x7fbc5c0c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:02.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc5ad9d700 1 --2- 172.21.15.158:0/2000374324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc5c0c2230 0x7fbc5c14cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:02.357 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc53fff700 1 -- 172.21.15.158:0/2000374324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc5c0c2230 msgr2=0x7fbc5c14cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:25:02.357 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc53fff700 1 --2- 172.21.15.158:0/2000374324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc5c0c2230 0x7fbc5c14cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:02.357 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc53fff700 1 -- 172.21.15.158:0/2000374324 >> v1:172.21.15.158:6789/0 conn(0x7fbc5c067ff0 legacy=0x7fbc5c0683d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:02.357 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc53fff700 1 -- 172.21.15.158:0/2000374324 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c0653c0 con 0x7fbc5c0666b0 2023-10-18T17:25:02.357 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc59d9b700 1 -- 172.21.15.158:0/2000374324 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647280737 0 0) 0x7fbc5c065cf0 con 0x7fbc5c067ff0 2023-10-18T17:25:02.357 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc53fff700 1 --2- 172.21.15.158:0/2000374324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc5c0666b0 0x7fbc5c0c1d40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fbc44009760 tx=0x7fbc44009060).ready entity=mon.1 client_cookie=b096ced4b7714940 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:02.358 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc59d9b700 1 -- 172.21.15.158:0/2000374324 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4400b590 con 0x7fbc5c0666b0 2023-10-18T17:25:02.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc59d9b700 1 -- 172.21.15.158:0/2000374324 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4400b6f0 con 0x7fbc5c0666b0 2023-10-18T17:25:02.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc59d9b700 1 -- 172.21.15.158:0/2000374324 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4400ba70 con 0x7fbc5c0666b0 2023-10-18T17:25:02.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc60d46700 1 -- 172.21.15.158:0/2000374324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc5c0666b0 msgr2=0x7fbc5c0c1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:02.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc60d46700 1 --2- 172.21.15.158:0/2000374324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc5c0666b0 0x7fbc5c0c1d40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fbc44009760 tx=0x7fbc44009060).stop 2023-10-18T17:25:02.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc60d46700 1 -- 172.21.15.158:0/2000374324 shutdown_connections 2023-10-18T17:25:02.360 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc60d46700 1 --2- 172.21.15.158:0/2000374324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc5c0c2230 0x7fbc5c14cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:02.360 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc60d46700 1 --2- 172.21.15.158:0/2000374324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc5c0666b0 0x7fbc5c0c1d40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:02.360 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.353+0000 7fbc60d46700 1 -- 172.21.15.158:0/2000374324 >> 172.21.15.158:0/2000374324 conn(0x7fbc5c0620d0 msgr2=0x7fbc5c0624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:02.360 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.357+0000 7fbc60d46700 1 -- 172.21.15.158:0/2000374324 shutdown_connections 2023-10-18T17:25:02.360 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.357+0000 7fbc60d46700 1 -- 172.21.15.158:0/2000374324 wait complete. 2023-10-18T17:25:02.361 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.357+0000 7fbc60d46700 1 Processor -- start 2023-10-18T17:25:02.361 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.357+0000 7fbc60d46700 1 -- start start 2023-10-18T17:25:02.362 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.357+0000 7fbc60d46700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc5c0666b0 0x7fbc5c0ba190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:02.362 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.357+0000 7fbc60d46700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc5c067ff0 0x7fbc5c151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:02.362 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.357+0000 7fbc60d46700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc5c0c2230 0x7fbc5c1506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:02.362 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.357+0000 7fbc60d46700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c151de0 con 0x7fbc5c0c2230 2023-10-18T17:25:02.363 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.357+0000 7fbc60d46700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0c6280 con 0x7fbc5c0666b0 2023-10-18T17:25:02.363 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.357+0000 7fbc60d46700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0c5df0 con 0x7fbc5c067ff0 2023-10-18T17:25:02.363 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.357+0000 7fbc5ad9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc5c0c2230 0x7fbc5c1506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:02.363 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.357+0000 7fbc5ad9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc5c0c2230 0x7fbc5c1506c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:39226/0 (socket says 172.21.15.158:39226) 2023-10-18T17:25:02.363 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.357+0000 7fbc5ad9d700 1 -- 172.21.15.158:0/612104240 learned_addr learned my addr 172.21.15.158:0/612104240 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:02.363 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.357+0000 7fbc53fff700 1 --2- 172.21.15.158:0/612104240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc5c067ff0 0x7fbc5c151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:02.364 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.357+0000 7fbc5a59c700 1 --2- 172.21.15.158:0/612104240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc5c0666b0 0x7fbc5c0ba190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:02.365 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.361+0000 7fbc5ad9d700 1 -- 172.21.15.158:0/612104240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc5c067ff0 msgr2=0x7fbc5c151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:02.365 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.361+0000 7fbc5ad9d700 1 --2- 172.21.15.158:0/612104240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc5c067ff0 0x7fbc5c151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:02.365 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.361+0000 7fbc5ad9d700 1 -- 172.21.15.158:0/612104240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc5c0666b0 msgr2=0x7fbc5c0ba190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:02.365 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.361+0000 7fbc5ad9d700 1 --2- 172.21.15.158:0/612104240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc5c0666b0 0x7fbc5c0ba190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:02.365 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.361+0000 7fbc5ad9d700 1 -- 172.21.15.158:0/612104240 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc440092a0 con 0x7fbc5c0c2230 2023-10-18T17:25:02.366 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.361+0000 7fbc5ad9d700 1 --2- 172.21.15.158:0/612104240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc5c0c2230 0x7fbc5c1506c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fbc54009e50 tx=0x7fbc5400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:02.366 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.361+0000 7fbc527fc700 1 -- 172.21.15.158:0/612104240 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5400caa0 con 0x7fbc5c0c2230 2023-10-18T17:25:02.366 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.361+0000 7fbc527fc700 1 -- 172.21.15.158:0/612104240 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5400f040 con 0x7fbc5c0c2230 2023-10-18T17:25:02.366 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.361+0000 7fbc527fc700 1 -- 172.21.15.158:0/612104240 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5400ce10 con 0x7fbc5c0c2230 2023-10-18T17:25:02.366 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.361+0000 7fbc60d46700 1 -- 172.21.15.158:0/612104240 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5c164050 con 0x7fbc5c0c2230 2023-10-18T17:25:02.367 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.361+0000 7fbc60d46700 1 -- 172.21.15.158:0/612104240 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5c0c57a0 con 0x7fbc5c0c2230 2023-10-18T17:25:02.367 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.361+0000 7fbc60d46700 1 -- 172.21.15.158:0/612104240 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5c069aa0 con 0x7fbc5c0c2230 2023-10-18T17:25:02.367 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.361+0000 7fbc527fc700 1 -- 172.21.15.158:0/612104240 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbc54013610 con 0x7fbc5c0c2230 2023-10-18T17:25:02.368 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.365+0000 7fbc527fc700 1 --2- 172.21.15.158:0/612104240 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fbc3c05a510 0x7fbc3c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:02.368 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.365+0000 7fbc527fc700 1 -- 172.21.15.158:0/612104240 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6381+0+0 (secure 0 0 0) 0x7fbc54075080 con 0x7fbc5c0c2230 2023-10-18T17:25:02.368 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.365+0000 7fbc5a59c700 1 --2- 172.21.15.158:0/612104240 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fbc3c05a510 0x7fbc3c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:02.368 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.365+0000 7fbc5a59c700 1 --2- 172.21.15.158:0/612104240 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fbc3c05a510 0x7fbc3c05c9d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fbc4c0011e0 tx=0x7fbc4c007bb0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:02.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.373+0000 7fbc527fc700 1 -- 172.21.15.158:0/612104240 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fbc540a3ac0 con 0x7fbc5c0c2230 2023-10-18T17:25:02.573 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.569+0000 7fbc60d46700 1 -- 172.21.15.158:0/612104240 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbc5c0c5fa0 con 0x7fbc5c0c2230 2023-10-18T17:25:02.573 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.569+0000 7fbc527fc700 1 -- 172.21.15.158:0/612104240 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fbc5c0c5fa0 con 0x7fbc5c0c2230 2023-10-18T17:25:02.574 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:25:02.576 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.573+0000 7fbc60d46700 1 -- 172.21.15.158:0/612104240 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fbc3c05a510 msgr2=0x7fbc3c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:02.576 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.573+0000 7fbc60d46700 1 --2- 172.21.15.158:0/612104240 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fbc3c05a510 0x7fbc3c05c9d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fbc4c0011e0 tx=0x7fbc4c007bb0).stop 2023-10-18T17:25:02.577 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.573+0000 7fbc60d46700 1 -- 172.21.15.158:0/612104240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc5c0c2230 msgr2=0x7fbc5c1506c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:02.577 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.573+0000 7fbc60d46700 1 --2- 172.21.15.158:0/612104240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc5c0c2230 0x7fbc5c1506c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fbc54009e50 tx=0x7fbc5400b040).stop 2023-10-18T17:25:02.577 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.573+0000 7fbc60d46700 1 -- 172.21.15.158:0/612104240 shutdown_connections 2023-10-18T17:25:02.577 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.573+0000 7fbc60d46700 1 --2- 172.21.15.158:0/612104240 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fbc3c05a510 0x7fbc3c05c9d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:02.577 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.573+0000 7fbc60d46700 1 --2- 172.21.15.158:0/612104240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc5c0c2230 0x7fbc5c1506c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:02.578 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.573+0000 7fbc60d46700 1 --2- 172.21.15.158:0/612104240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc5c067ff0 0x7fbc5c151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:02.578 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.573+0000 7fbc60d46700 1 --2- 172.21.15.158:0/612104240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc5c0666b0 0x7fbc5c0ba190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:02.578 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.573+0000 7fbc60d46700 1 -- 172.21.15.158:0/612104240 >> 172.21.15.158:0/612104240 conn(0x7fbc5c0620d0 msgr2=0x7fbc5c0c43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:02.578 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.573+0000 7fbc60d46700 1 -- 172.21.15.158:0/612104240 shutdown_connections 2023-10-18T17:25:02.578 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:02.573+0000 7fbc60d46700 1 -- 172.21.15.158:0/612104240 wait complete. 2023-10-18T17:25:02.595 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:25:03.890 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:25:03.898 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:25:05.538 INFO:tasks.ceph.mds.a.smithi158.stderr:terminate called after throwing an instance of 'boost::wrapexcept' 2023-10-18T17:25:05.538 INFO:tasks.ceph.mds.a.smithi158.stderr: what(): boost::bad_get: failed value get using boost::get 2023-10-18T17:25:05.538 INFO:tasks.ceph.mds.a.smithi158.stderr:*** Caught signal (Aborted) ** 2023-10-18T17:25:05.538 INFO:tasks.ceph.mds.a.smithi158.stderr: in thread 7f44d717e700 thread_name:ms_dispatch 2023-10-18T17:25:05.540 INFO:tasks.ceph.mds.a.smithi158.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:25:05.540 INFO:tasks.ceph.mds.a.smithi158.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f44e514e420] 2023-10-18T17:25:05.540 INFO:tasks.ceph.mds.a.smithi158.stderr: 2: gsignal() 2023-10-18T17:25:05.540 INFO:tasks.ceph.mds.a.smithi158.stderr: 3: abort() 2023-10-18T17:25:05.541 INFO:tasks.ceph.mds.a.smithi158.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7f44dc281911] 2023-10-18T17:25:05.541 INFO:tasks.ceph.mds.a.smithi158.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7f44dc28d38c] 2023-10-18T17:25:05.541 INFO:tasks.ceph.mds.a.smithi158.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7f44dc28d3f7] 2023-10-18T17:25:05.541 INFO:tasks.ceph.mds.a.smithi158.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7f44dc28d6a9] 2023-10-18T17:25:05.541 INFO:tasks.ceph.mds.a.smithi158.stderr: 8: ceph-mds(+0x185107) [0x557594480107] 2023-10-18T17:25:05.542 INFO:tasks.ceph.mds.a.smithi158.stderr: 9: ceph-mds(+0x18572d) [0x55759448072d] 2023-10-18T17:25:05.542 INFO:tasks.ceph.mds.a.smithi158.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x5575944f209f] 2023-10-18T17:25:05.542 INFO:tasks.ceph.mds.a.smithi158.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x5575944f3a95] 2023-10-18T17:25:05.542 INFO:tasks.ceph.mds.a.smithi158.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x5575944beb10] 2023-10-18T17:25:05.542 INFO:tasks.ceph.mds.a.smithi158.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x5575944c2abf] 2023-10-18T17:25:05.543 INFO:tasks.ceph.mds.a.smithi158.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x5575944c3456] 2023-10-18T17:25:05.543 INFO:tasks.ceph.mds.a.smithi158.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7f44dc8bc710] 2023-10-18T17:25:05.543 INFO:tasks.ceph.mds.a.smithi158.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7f44dc8b9faf] 2023-10-18T17:25:05.543 INFO:tasks.ceph.mds.a.smithi158.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f44dc988b21] 2023-10-18T17:25:05.543 INFO:tasks.ceph.mds.a.smithi158.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f44e5142609] 2023-10-18T17:25:05.544 INFO:tasks.ceph.mds.a.smithi158.stderr: 19: clone() 2023-10-18T17:25:05.544 INFO:tasks.ceph.mds.a.smithi158.stderr:2023-10-18T17:25:05.537+0000 7f44d717e700 -1 *** Caught signal (Aborted) ** 2023-10-18T17:25:05.544 INFO:tasks.ceph.mds.a.smithi158.stderr: in thread 7f44d717e700 thread_name:ms_dispatch 2023-10-18T17:25:05.544 INFO:tasks.ceph.mds.a.smithi158.stderr: 2023-10-18T17:25:05.545 INFO:tasks.ceph.mds.a.smithi158.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:25:05.545 INFO:tasks.ceph.mds.a.smithi158.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f44e514e420] 2023-10-18T17:25:05.545 INFO:tasks.ceph.mds.a.smithi158.stderr: 2: gsignal() 2023-10-18T17:25:05.545 INFO:tasks.ceph.mds.a.smithi158.stderr: 3: abort() 2023-10-18T17:25:05.545 INFO:tasks.ceph.mds.a.smithi158.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7f44dc281911] 2023-10-18T17:25:05.546 INFO:tasks.ceph.mds.a.smithi158.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7f44dc28d38c] 2023-10-18T17:25:05.546 INFO:tasks.ceph.mds.a.smithi158.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7f44dc28d3f7] 2023-10-18T17:25:05.546 INFO:tasks.ceph.mds.a.smithi158.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7f44dc28d6a9] 2023-10-18T17:25:05.547 INFO:tasks.ceph.mds.a.smithi158.stderr: 8: ceph-mds(+0x185107) [0x557594480107] 2023-10-18T17:25:05.547 INFO:tasks.ceph.mds.a.smithi158.stderr: 9: ceph-mds(+0x18572d) [0x55759448072d] 2023-10-18T17:25:05.547 INFO:tasks.ceph.mds.a.smithi158.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x5575944f209f] 2023-10-18T17:25:05.547 INFO:tasks.ceph.mds.a.smithi158.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x5575944f3a95] 2023-10-18T17:25:05.547 INFO:tasks.ceph.mds.a.smithi158.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x5575944beb10] 2023-10-18T17:25:05.548 INFO:tasks.ceph.mds.a.smithi158.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x5575944c2abf] 2023-10-18T17:25:05.548 INFO:tasks.ceph.mds.a.smithi158.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x5575944c3456] 2023-10-18T17:25:05.548 INFO:tasks.ceph.mds.a.smithi158.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7f44dc8bc710] 2023-10-18T17:25:05.548 INFO:tasks.ceph.mds.a.smithi158.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7f44dc8b9faf] 2023-10-18T17:25:05.548 INFO:tasks.ceph.mds.a.smithi158.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f44dc988b21] 2023-10-18T17:25:05.548 INFO:tasks.ceph.mds.a.smithi158.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f44e5142609] 2023-10-18T17:25:05.549 INFO:tasks.ceph.mds.a.smithi158.stderr: 19: clone() 2023-10-18T17:25:05.549 INFO:tasks.ceph.mds.a.smithi158.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T17:25:05.549 INFO:tasks.ceph.mds.a.smithi158.stderr: 2023-10-18T17:25:05.550 INFO:tasks.ceph.mds.a.smithi158.stderr: 0> 2023-10-18T17:25:05.537+0000 7f44d717e700 -1 *** Caught signal (Aborted) ** 2023-10-18T17:25:05.550 INFO:tasks.ceph.mds.a.smithi158.stderr: in thread 7f44d717e700 thread_name:ms_dispatch 2023-10-18T17:25:05.550 INFO:tasks.ceph.mds.a.smithi158.stderr: 2023-10-18T17:25:05.550 INFO:tasks.ceph.mds.a.smithi158.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:25:05.550 INFO:tasks.ceph.mds.a.smithi158.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f44e514e420] 2023-10-18T17:25:05.551 INFO:tasks.ceph.mds.a.smithi158.stderr: 2: gsignal() 2023-10-18T17:25:05.551 INFO:tasks.ceph.mds.a.smithi158.stderr: 3: abort() 2023-10-18T17:25:05.551 INFO:tasks.ceph.mds.a.smithi158.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7f44dc281911] 2023-10-18T17:25:05.551 INFO:tasks.ceph.mds.a.smithi158.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7f44dc28d38c] 2023-10-18T17:25:05.551 INFO:tasks.ceph.mds.a.smithi158.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7f44dc28d3f7] 2023-10-18T17:25:05.552 INFO:tasks.ceph.mds.a.smithi158.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7f44dc28d6a9] 2023-10-18T17:25:05.552 INFO:tasks.ceph.mds.a.smithi158.stderr: 8: ceph-mds(+0x185107) [0x557594480107] 2023-10-18T17:25:05.552 INFO:tasks.ceph.mds.a.smithi158.stderr: 9: ceph-mds(+0x18572d) [0x55759448072d] 2023-10-18T17:25:05.552 INFO:tasks.ceph.mds.a.smithi158.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x5575944f209f] 2023-10-18T17:25:05.552 INFO:tasks.ceph.mds.a.smithi158.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x5575944f3a95] 2023-10-18T17:25:05.552 INFO:tasks.ceph.mds.a.smithi158.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x5575944beb10] 2023-10-18T17:25:05.553 INFO:tasks.ceph.mds.a.smithi158.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x5575944c2abf] 2023-10-18T17:25:05.553 INFO:tasks.ceph.mds.a.smithi158.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x5575944c3456] 2023-10-18T17:25:05.553 INFO:tasks.ceph.mds.a.smithi158.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7f44dc8bc710] 2023-10-18T17:25:05.553 INFO:tasks.ceph.mds.a.smithi158.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7f44dc8b9faf] 2023-10-18T17:25:05.553 INFO:tasks.ceph.mds.a.smithi158.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f44dc988b21] 2023-10-18T17:25:05.554 INFO:tasks.ceph.mds.a.smithi158.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f44e5142609] 2023-10-18T17:25:05.554 INFO:tasks.ceph.mds.a.smithi158.stderr: 19: clone() 2023-10-18T17:25:05.554 INFO:tasks.ceph.mds.a.smithi158.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T17:25:05.554 INFO:tasks.ceph.mds.a.smithi158.stderr: 2023-10-18T17:25:05.554 INFO:tasks.ceph.mds.a.smithi158.stderr: 0> 2023-10-18T17:25:05.537+0000 7f44d717e700 -1 *** Caught signal (Aborted) ** 2023-10-18T17:25:05.554 INFO:tasks.ceph.mds.a.smithi158.stderr: in thread 7f44d717e700 thread_name:ms_dispatch 2023-10-18T17:25:05.555 INFO:tasks.ceph.mds.a.smithi158.stderr: 2023-10-18T17:25:05.555 INFO:tasks.ceph.mds.a.smithi158.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:25:05.555 INFO:tasks.ceph.mds.a.smithi158.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f44e514e420] 2023-10-18T17:25:05.555 INFO:tasks.ceph.mds.a.smithi158.stderr: 2: gsignal() 2023-10-18T17:25:05.555 INFO:tasks.ceph.mds.a.smithi158.stderr: 3: abort() 2023-10-18T17:25:05.556 INFO:tasks.ceph.mds.a.smithi158.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7f44dc281911] 2023-10-18T17:25:05.556 INFO:tasks.ceph.mds.a.smithi158.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7f44dc28d38c] 2023-10-18T17:25:05.556 INFO:tasks.ceph.mds.a.smithi158.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7f44dc28d3f7] 2023-10-18T17:25:05.556 INFO:tasks.ceph.mds.a.smithi158.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7f44dc28d6a9] 2023-10-18T17:25:05.556 INFO:tasks.ceph.mds.a.smithi158.stderr: 8: ceph-mds(+0x185107) [0x557594480107] 2023-10-18T17:25:05.557 INFO:tasks.ceph.mds.a.smithi158.stderr: 9: ceph-mds(+0x18572d) [0x55759448072d] 2023-10-18T17:25:05.557 INFO:tasks.ceph.mds.a.smithi158.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x5575944f209f] 2023-10-18T17:25:05.557 INFO:tasks.ceph.mds.a.smithi158.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x5575944f3a95] 2023-10-18T17:25:05.557 INFO:tasks.ceph.mds.a.smithi158.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x5575944beb10] 2023-10-18T17:25:05.557 INFO:tasks.ceph.mds.a.smithi158.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x5575944c2abf] 2023-10-18T17:25:05.558 INFO:tasks.ceph.mds.a.smithi158.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x5575944c3456] 2023-10-18T17:25:05.558 INFO:tasks.ceph.mds.a.smithi158.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7f44dc8bc710] 2023-10-18T17:25:05.558 INFO:tasks.ceph.mds.a.smithi158.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7f44dc8b9faf] 2023-10-18T17:25:05.558 INFO:tasks.ceph.mds.a.smithi158.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f44dc988b21] 2023-10-18T17:25:05.558 INFO:tasks.ceph.mds.a.smithi158.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f44e5142609] 2023-10-18T17:25:05.558 INFO:tasks.ceph.mds.a.smithi158.stderr: 19: clone() 2023-10-18T17:25:05.559 INFO:tasks.ceph.mds.a.smithi158.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T17:25:05.559 INFO:tasks.ceph.mds.a.smithi158.stderr: 2023-10-18T17:25:05.596 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:25:05.689 INFO:tasks.ceph.mds.a.smithi158.stderr:daemon-helper: command crashed with signal 6 2023-10-18T17:25:05.766 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.765+0000 7fb8751f9700 1 Processor -- start 2023-10-18T17:25:05.766 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.765+0000 7fb8751f9700 1 -- start start 2023-10-18T17:25:05.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.765+0000 7fb8751f9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb8700658a0 0x7fb870065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:05.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.765+0000 7fb8751f9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb870069f20 0x7fb8700c2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:05.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.765+0000 7fb8751f9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87006a760 con 0x7fb8700c2b20 2023-10-18T17:25:05.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.765+0000 7fb8751f9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb870150bf0 con 0x7fb8700658a0 2023-10-18T17:25:05.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.765+0000 7fb8751f9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87006a480 con 0x7fb870069f20 2023-10-18T17:25:05.769 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.765+0000 7fb8677fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb870069f20 0x7fb8700c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:05.769 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.765+0000 7fb8749f8700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fb8700c2b20 0x7fb8700630e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:57046/0 (socket says 172.21.15.158:57046) 2023-10-18T17:25:05.770 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.765+0000 7fb8749f8700 1 -- 172.21.15.158:0/3081017836 learned_addr learned my addr 172.21.15.158:0/3081017836 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:25:05.770 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.765+0000 7fb86ffff700 1 --2- 172.21.15.158:0/3081017836 >> v2:172.21.15.158:3300/0 conn(0x7fb8700658a0 0x7fb870065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:05.770 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.765+0000 7fb86f7fe700 1 -- 172.21.15.158:0/3081017836 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979115970 0 0) 0x7fb87006a760 con 0x7fb8700c2b20 2023-10-18T17:25:05.770 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.765+0000 7fb86f7fe700 1 -- 172.21.15.158:0/3081017836 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb85c0033f0 con 0x7fb8700c2b20 2023-10-18T17:25:05.771 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.765+0000 7fb8677fe700 1 -- 172.21.15.158:0/3081017836 >> v2:172.21.15.158:3300/0 conn(0x7fb8700658a0 msgr2=0x7fb870065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:25:05.771 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.765+0000 7fb8677fe700 1 --2- 172.21.15.158:0/3081017836 >> v2:172.21.15.158:3300/0 conn(0x7fb8700658a0 0x7fb870065c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:05.771 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.765+0000 7fb8677fe700 1 -- 172.21.15.158:0/3081017836 >> v1:172.21.15.183:6789/0 conn(0x7fb8700c2b20 legacy=0x7fb8700630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:05.771 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.765+0000 7fb8677fe700 1 -- 172.21.15.158:0/3081017836 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87014fe30 con 0x7fb870069f20 2023-10-18T17:25:05.772 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.769+0000 7fb8677fe700 1 --2- 172.21.15.158:0/3081017836 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb870069f20 0x7fb8700c2630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb858009760 tx=0x7fb858009060).ready entity=mon.2 client_cookie=756a1f6fbec5270f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:05.772 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.769+0000 7fb86f7fe700 1 -- 172.21.15.158:0/3081017836 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85800f510 con 0x7fb870069f20 2023-10-18T17:25:05.773 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.769+0000 7fb86f7fe700 1 -- 172.21.15.158:0/3081017836 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85800f670 con 0x7fb870069f20 2023-10-18T17:25:05.773 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.769+0000 7fb86f7fe700 1 -- 172.21.15.158:0/3081017836 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85800f9f0 con 0x7fb870069f20 2023-10-18T17:25:05.773 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.769+0000 7fb8751f9700 1 -- 172.21.15.158:0/3081017836 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb870069f20 msgr2=0x7fb8700c2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:05.773 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.769+0000 7fb8751f9700 1 --2- 172.21.15.158:0/3081017836 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb870069f20 0x7fb8700c2630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb858009760 tx=0x7fb858009060).stop 2023-10-18T17:25:05.774 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.769+0000 7fb8751f9700 1 -- 172.21.15.158:0/3081017836 shutdown_connections 2023-10-18T17:25:05.774 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.769+0000 7fb8751f9700 1 --2- 172.21.15.158:0/3081017836 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb870069f20 0x7fb8700c2630 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:05.774 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.769+0000 7fb8751f9700 1 --2- 172.21.15.158:0/3081017836 >> v2:172.21.15.158:3300/0 conn(0x7fb8700658a0 0x7fb870065c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:05.774 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.769+0000 7fb8751f9700 1 -- 172.21.15.158:0/3081017836 >> 172.21.15.158:0/3081017836 conn(0x7fb870062ba0 msgr2=0x7fb8700c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:05.775 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.769+0000 7fb8751f9700 1 -- 172.21.15.158:0/3081017836 shutdown_connections 2023-10-18T17:25:05.775 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.769+0000 7fb8751f9700 1 -- 172.21.15.158:0/3081017836 wait complete. 2023-10-18T17:25:05.775 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.773+0000 7fb8751f9700 1 Processor -- start 2023-10-18T17:25:05.775 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.773+0000 7fb8751f9700 1 -- start start 2023-10-18T17:25:05.776 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.773+0000 7fb8751f9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8700658a0 0x7fb8700a4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:05.776 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.773+0000 7fb8751f9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb870069f20 0x7fb8700b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:05.777 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.773+0000 7fb8751f9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8700c2b20 0x7fb8700b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:05.777 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.773+0000 7fb8751f9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700b3480 con 0x7fb8700c2b20 2023-10-18T17:25:05.777 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.773+0000 7fb8751f9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700a2dc0 con 0x7fb870069f20 2023-10-18T17:25:05.777 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.773+0000 7fb8751f9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700a2750 con 0x7fb8700658a0 2023-10-18T17:25:05.778 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.773+0000 7fb8677fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb870069f20 0x7fb8700b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:05.779 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.773+0000 7fb8749f8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8700c2b20 0x7fb8700b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:05.779 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.773+0000 7fb86ffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8700658a0 0x7fb8700a4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:05.779 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.773+0000 7fb8677fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb870069f20 0x7fb8700b37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:48150/0 (socket says 172.21.15.158:48150) 2023-10-18T17:25:05.779 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.773+0000 7fb8677fe700 1 -- 172.21.15.158:0/3242985945 learned_addr learned my addr 172.21.15.158:0/3242985945 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:05.779 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.773+0000 7fb8677fe700 1 -- 172.21.15.158:0/3242985945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8700658a0 msgr2=0x7fb8700a4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:05.780 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.773+0000 7fb8677fe700 1 --2- 172.21.15.158:0/3242985945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8700658a0 0x7fb8700a4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:05.780 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.773+0000 7fb8677fe700 1 -- 172.21.15.158:0/3242985945 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8700c2b20 msgr2=0x7fb8700b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:05.780 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.773+0000 7fb8677fe700 1 --2- 172.21.15.158:0/3242985945 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8700c2b20 0x7fb8700b18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:05.780 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.773+0000 7fb8677fe700 1 -- 172.21.15.158:0/3242985945 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8580092a0 con 0x7fb870069f20 2023-10-18T17:25:05.781 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.777+0000 7fb8677fe700 1 --2- 172.21.15.158:0/3242985945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb870069f20 0x7fb8700b37f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fb858009d50 tx=0x7fb858017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:05.781 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.777+0000 7fb86cff9700 1 -- 172.21.15.158:0/3242985945 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85800f510 con 0x7fb870069f20 2023-10-18T17:25:05.781 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.777+0000 7fb86cff9700 1 -- 172.21.15.158:0/3242985945 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85800f7e0 con 0x7fb870069f20 2023-10-18T17:25:05.781 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.777+0000 7fb86cff9700 1 -- 172.21.15.158:0/3242985945 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85801b410 con 0x7fb870069f20 2023-10-18T17:25:05.781 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.777+0000 7fb8751f9700 1 -- 172.21.15.158:0/3242985945 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8700a2a30 con 0x7fb870069f20 2023-10-18T17:25:05.781 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.777+0000 7fb8751f9700 1 -- 172.21.15.158:0/3242985945 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8700a32f0 con 0x7fb870069f20 2023-10-18T17:25:05.782 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.777+0000 7fb8751f9700 1 -- 172.21.15.158:0/3242985945 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb870046f00 con 0x7fb870069f20 2023-10-18T17:25:05.782 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.781+0000 7fb86cff9700 1 -- 172.21.15.158:0/3242985945 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb85801b7c0 con 0x7fb870069f20 2023-10-18T17:25:05.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.781+0000 7fb86cff9700 1 --2- 172.21.15.158:0/3242985945 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb85005a540 0x7fb85005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:05.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.781+0000 7fb86cff9700 1 -- 172.21.15.158:0/3242985945 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6467+0+0 (secure 0 0 0) 0x7fb858076040 con 0x7fb870069f20 2023-10-18T17:25:05.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.781+0000 7fb86ffff700 1 --2- 172.21.15.158:0/3242985945 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb85005a540 0x7fb85005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:05.785 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.781+0000 7fb86ffff700 1 --2- 172.21.15.158:0/3242985945 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb85005a540 0x7fb85005ca00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fb86000f570 tx=0x7fb86000b040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:05.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.793+0000 7fb86cff9700 1 -- 172.21.15.158:0/3242985945 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fb858049600 con 0x7fb870069f20 2023-10-18T17:25:05.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.997+0000 7fb8751f9700 1 -- 172.21.15.158:0/3242985945 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb8700a8050 con 0x7fb870069f20 2023-10-18T17:25:05.999 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:05.997+0000 7fb86cff9700 1 -- 172.21.15.158:0/3242985945 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fb85804cc20 con 0x7fb870069f20 2023-10-18T17:25:05.999 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:25:06.004 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:06.001+0000 7fb8751f9700 1 -- 172.21.15.158:0/3242985945 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb85005a540 msgr2=0x7fb85005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:06.004 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:06.001+0000 7fb8751f9700 1 --2- 172.21.15.158:0/3242985945 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb85005a540 0x7fb85005ca00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fb86000f570 tx=0x7fb86000b040).stop 2023-10-18T17:25:06.004 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:06.001+0000 7fb8751f9700 1 -- 172.21.15.158:0/3242985945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb870069f20 msgr2=0x7fb8700b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:06.004 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:06.001+0000 7fb8751f9700 1 --2- 172.21.15.158:0/3242985945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb870069f20 0x7fb8700b37f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fb858009d50 tx=0x7fb858017000).stop 2023-10-18T17:25:06.005 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:06.001+0000 7fb8751f9700 1 -- 172.21.15.158:0/3242985945 shutdown_connections 2023-10-18T17:25:06.005 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:06.001+0000 7fb8751f9700 1 --2- 172.21.15.158:0/3242985945 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb85005a540 0x7fb85005ca00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:06.005 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:06.001+0000 7fb8751f9700 1 --2- 172.21.15.158:0/3242985945 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8700c2b20 0x7fb8700b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:06.005 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:06.001+0000 7fb8751f9700 1 --2- 172.21.15.158:0/3242985945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb870069f20 0x7fb8700b37f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:06.005 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:06.001+0000 7fb8751f9700 1 --2- 172.21.15.158:0/3242985945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8700658a0 0x7fb8700a4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:06.006 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:06.001+0000 7fb8751f9700 1 -- 172.21.15.158:0/3242985945 >> 172.21.15.158:0/3242985945 conn(0x7fb870062ba0 msgr2=0x7fb87014d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:06.006 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:06.001+0000 7fb8751f9700 1 -- 172.21.15.158:0/3242985945 shutdown_connections 2023-10-18T17:25:06.006 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:06.001+0000 7fb8751f9700 1 -- 172.21.15.158:0/3242985945 wait complete. 2023-10-18T17:25:06.024 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:25:06.857 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-18T17:25:06.858 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~54s 2023-10-18T17:25:06.858 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~13s 2023-10-18T17:25:09.025 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:25:09.183 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.181+0000 7f60940f1700 1 Processor -- start 2023-10-18T17:25:09.183 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.181+0000 7f60940f1700 1 -- start start 2023-10-18T17:25:09.186 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.181+0000 7f60940f1700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f608c067ff0 0x7f608c0683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:09.186 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f60940f1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f608c0666b0 0x7f608c0bd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:09.186 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f60940f1700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f608c0bde20 0x7f608c151410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:09.186 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f60940f1700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608c066160 con 0x7f608c0bde20 2023-10-18T17:25:09.187 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f60940f1700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608c065cd0 con 0x7f608c067ff0 2023-10-18T17:25:09.187 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f60940f1700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608c154750 con 0x7f608c0666b0 2023-10-18T17:25:09.188 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f6091e8d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f608c067ff0 0x7f608c0683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:09.188 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f609268e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f608c0bde20 0x7f608c151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:09.188 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f6091e8d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f608c067ff0 0x7f608c0683d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:50656/0 (socket says 172.21.15.158:50656) 2023-10-18T17:25:09.189 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f609168c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f608c0666b0 0x7f608c0bd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:09.189 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f6091e8d700 1 -- 172.21.15.158:0/3172651342 learned_addr learned my addr 172.21.15.158:0/3172651342 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:09.189 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f6091e8d700 1 -- 172.21.15.158:0/3172651342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f608c0666b0 msgr2=0x7f608c0bd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:25:09.189 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f6091e8d700 1 --2- 172.21.15.158:0/3172651342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f608c0666b0 0x7f608c0bd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:09.189 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f6091e8d700 1 -- 172.21.15.158:0/3172651342 >> v2:172.21.15.158:3300/0 conn(0x7f608c0bde20 msgr2=0x7f608c151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:25:09.190 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f6091e8d700 1 --2- 172.21.15.158:0/3172651342 >> v2:172.21.15.158:3300/0 conn(0x7f608c0bde20 0x7f608c151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:09.190 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f6091e8d700 1 -- 172.21.15.158:0/3172651342 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c065100 con 0x7f608c067ff0 2023-10-18T17:25:09.190 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f609168c700 1 --2- 172.21.15.158:0/3172651342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f608c0666b0 0x7f608c0bd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:25:09.190 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f609268e700 1 --2- 172.21.15.158:0/3172651342 >> v2:172.21.15.158:3300/0 conn(0x7f608c0bde20 0x7f608c151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:25:09.190 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f6091e8d700 1 --2- 172.21.15.158:0/3172651342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f608c067ff0 0x7f608c0683d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f608c05e8c0 tx=0x7f60880090f0).ready entity=mon.1 client_cookie=41257eb104af0c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:09.191 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f6090e8b700 1 -- 172.21.15.158:0/3172651342 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608800f510 con 0x7f608c067ff0 2023-10-18T17:25:09.191 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f6090e8b700 1 -- 172.21.15.158:0/3172651342 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608800f670 con 0x7f608c067ff0 2023-10-18T17:25:09.191 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f6090e8b700 1 -- 172.21.15.158:0/3172651342 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608800f9f0 con 0x7f608c067ff0 2023-10-18T17:25:09.192 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f60940f1700 1 -- 172.21.15.158:0/3172651342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f608c067ff0 msgr2=0x7f608c0683d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:09.192 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f60940f1700 1 --2- 172.21.15.158:0/3172651342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f608c067ff0 0x7f608c0683d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f608c05e8c0 tx=0x7f60880090f0).stop 2023-10-18T17:25:09.192 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f60940f1700 1 -- 172.21.15.158:0/3172651342 shutdown_connections 2023-10-18T17:25:09.192 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f60940f1700 1 --2- 172.21.15.158:0/3172651342 >> v2:172.21.15.158:3300/0 conn(0x7f608c0bde20 0x7f608c151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:09.193 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f60940f1700 1 --2- 172.21.15.158:0/3172651342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f608c0666b0 0x7f608c0bd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:09.193 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f60940f1700 1 --2- 172.21.15.158:0/3172651342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f608c067ff0 0x7f608c0683d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:09.193 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.185+0000 7f60940f1700 1 -- 172.21.15.158:0/3172651342 >> 172.21.15.158:0/3172651342 conn(0x7f608c0620d0 msgr2=0x7f608c0624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:09.193 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.189+0000 7f60940f1700 1 -- 172.21.15.158:0/3172651342 shutdown_connections 2023-10-18T17:25:09.193 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.189+0000 7f60940f1700 1 -- 172.21.15.158:0/3172651342 wait complete. 2023-10-18T17:25:09.193 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.189+0000 7f60940f1700 1 Processor -- start 2023-10-18T17:25:09.194 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.189+0000 7f60940f1700 1 -- start start 2023-10-18T17:25:09.195 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.189+0000 7f60940f1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f608c0666b0 0x7f608c155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:09.196 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.189+0000 7f60940f1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f608c067ff0 0x7f608c165fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:09.196 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.189+0000 7f60940f1700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f608c0bde20 0x7f608c1664d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:09.196 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.189+0000 7f60940f1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c1669c0 con 0x7f608c067ff0 2023-10-18T17:25:09.196 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.189+0000 7f60940f1700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c0c1d20 con 0x7f608c0bde20 2023-10-18T17:25:09.196 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.189+0000 7f60940f1700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608c0c2000 con 0x7f608c0666b0 2023-10-18T17:25:09.197 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.189+0000 7f609268e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f608c0bde20 0x7f608c1664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:09.197 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.189+0000 7f6091e8d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f608c0666b0 0x7f608c155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:09.197 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.189+0000 7f609168c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f608c067ff0 0x7f608c165fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:09.197 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.189+0000 7f609268e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f608c0bde20 0x7f608c1664d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:50668/0 (socket says 172.21.15.158:50668) 2023-10-18T17:25:09.197 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.189+0000 7f609268e700 1 -- 172.21.15.158:0/370990709 learned_addr learned my addr 172.21.15.158:0/370990709 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:09.198 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.189+0000 7f6091e8d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f608c0666b0 0x7f608c155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:56378/0 (socket says 172.21.15.158:56378) 2023-10-18T17:25:09.198 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.193+0000 7f609168c700 1 -- 172.21.15.158:0/370990709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f608c0666b0 msgr2=0x7f608c155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:09.198 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.193+0000 7f609168c700 1 --2- 172.21.15.158:0/370990709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f608c0666b0 0x7f608c155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:09.198 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.193+0000 7f609168c700 1 -- 172.21.15.158:0/370990709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f608c0bde20 msgr2=0x7f608c1664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:09.198 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.193+0000 7f609168c700 1 --2- 172.21.15.158:0/370990709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f608c0bde20 0x7f608c1664d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:09.199 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.193+0000 7f609168c700 1 -- 172.21.15.158:0/370990709 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c0092a0 con 0x7f608c067ff0 2023-10-18T17:25:09.199 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.193+0000 7f609268e700 1 --2- 172.21.15.158:0/370990709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f608c0bde20 0x7f608c1664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:25:09.199 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.193+0000 7f609168c700 1 --2- 172.21.15.158:0/370990709 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f608c067ff0 0x7f608c165fe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f607c00e880 tx=0x7f607c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:09.199 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.193+0000 7f6081ffb700 1 -- 172.21.15.158:0/370990709 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c012600 con 0x7f608c067ff0 2023-10-18T17:25:09.199 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.193+0000 7f6081ffb700 1 -- 172.21.15.158:0/370990709 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607c012760 con 0x7f608c067ff0 2023-10-18T17:25:09.200 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.193+0000 7f60940f1700 1 -- 172.21.15.158:0/370990709 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6084009a20 con 0x7f608c067ff0 2023-10-18T17:25:09.200 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.193+0000 7f6081ffb700 1 -- 172.21.15.158:0/370990709 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c012ae0 con 0x7f608c067ff0 2023-10-18T17:25:09.200 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.193+0000 7f60940f1700 1 -- 172.21.15.158:0/370990709 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6088009370 con 0x7f608c067ff0 2023-10-18T17:25:09.201 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.197+0000 7f60940f1700 1 -- 172.21.15.158:0/370990709 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608c06c190 con 0x7f608c067ff0 2023-10-18T17:25:09.201 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.197+0000 7f6081ffb700 1 -- 172.21.15.158:0/370990709 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f607c01b400 con 0x7f608c067ff0 2023-10-18T17:25:09.201 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.197+0000 7f6081ffb700 1 --2- 172.21.15.158:0/370990709 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f607005a510 0x7f607005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:09.201 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.197+0000 7f6081ffb700 1 -- 172.21.15.158:0/370990709 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6467+0+0 (secure 0 0 0) 0x7f607c074de0 con 0x7f608c067ff0 2023-10-18T17:25:09.202 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.197+0000 7f6091e8d700 1 --2- 172.21.15.158:0/370990709 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f607005a510 0x7f607005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:09.202 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.197+0000 7f6091e8d700 1 --2- 172.21.15.158:0/370990709 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f607005a510 0x7f607005c9d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f6088009130 tx=0x7f6088017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:09.205 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.201+0000 7f6081ffb700 1 -- 172.21.15.158:0/370990709 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f607c048340 con 0x7f608c067ff0 2023-10-18T17:25:09.399 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.397+0000 7f60940f1700 1 -- 172.21.15.158:0/370990709 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f608c154490 con 0x7f608c067ff0 2023-10-18T17:25:09.400 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.397+0000 7f6081ffb700 1 -- 172.21.15.158:0/370990709 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f607c016020 con 0x7f608c067ff0 2023-10-18T17:25:09.400 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:25:09.402 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.401+0000 7f60940f1700 1 -- 172.21.15.158:0/370990709 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f607005a510 msgr2=0x7f607005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:09.403 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.401+0000 7f60940f1700 1 --2- 172.21.15.158:0/370990709 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f607005a510 0x7f607005c9d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f6088009130 tx=0x7f6088017000).stop 2023-10-18T17:25:09.403 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.401+0000 7f60940f1700 1 -- 172.21.15.158:0/370990709 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f608c067ff0 msgr2=0x7f608c165fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:09.403 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.401+0000 7f60940f1700 1 --2- 172.21.15.158:0/370990709 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f608c067ff0 0x7f608c165fe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f607c00e880 tx=0x7f607c009060).stop 2023-10-18T17:25:09.403 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.401+0000 7f60940f1700 1 -- 172.21.15.158:0/370990709 shutdown_connections 2023-10-18T17:25:09.403 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.401+0000 7f60940f1700 1 --2- 172.21.15.158:0/370990709 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f607005a510 0x7f607005c9d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:09.404 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.401+0000 7f60940f1700 1 --2- 172.21.15.158:0/370990709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f608c0bde20 0x7f608c1664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:09.404 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.401+0000 7f60940f1700 1 --2- 172.21.15.158:0/370990709 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f608c067ff0 0x7f608c165fe0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:09.404 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.401+0000 7f60940f1700 1 --2- 172.21.15.158:0/370990709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f608c0666b0 0x7f608c155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:09.404 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.401+0000 7f60940f1700 1 -- 172.21.15.158:0/370990709 >> 172.21.15.158:0/370990709 conn(0x7f608c0620d0 msgr2=0x7f608c1505e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:09.404 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.401+0000 7f60940f1700 1 -- 172.21.15.158:0/370990709 shutdown_connections 2023-10-18T17:25:09.405 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:09.401+0000 7f60940f1700 1 -- 172.21.15.158:0/370990709 wait complete. 2023-10-18T17:25:09.420 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:25:12.421 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:25:12.579 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.577+0000 7f96e6f47700 1 Processor -- start 2023-10-18T17:25:12.580 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.577+0000 7f96e6f47700 1 -- start start 2023-10-18T17:25:12.584 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.581+0000 7f96e6f47700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f96e01513e0 0x7f96e0067d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:12.584 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.581+0000 7f96e6f47700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96e01517c0 0x7f96e006a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:12.585 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.581+0000 7f96e6f47700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f96e00630e0 0x7f96e0065700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:12.585 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.581+0000 7f96e6f47700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e0069380 con 0x7f96e00630e0 2023-10-18T17:25:12.585 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.581+0000 7f96e6f47700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e0154b00 con 0x7f96e01513e0 2023-10-18T17:25:12.585 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.581+0000 7f96e6f47700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0154f90 con 0x7f96e01517c0 2023-10-18T17:25:12.585 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.581+0000 7f96e5744700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96e01517c0 0x7f96e006a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:12.586 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.581+0000 7f96e5f45700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f96e01513e0 0x7f96e0067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:12.586 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.581+0000 7f96e5744700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96e01517c0 0x7f96e006a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:56394/0 (socket says 172.21.15.158:56394) 2023-10-18T17:25:12.586 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.581+0000 7f96e5744700 1 -- 172.21.15.158:0/2441630875 learned_addr learned my addr 172.21.15.158:0/2441630875 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:12.586 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.581+0000 7f96e5f45700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f96e01513e0 0x7f96e0067d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:50676/0 (socket says 172.21.15.158:50676) 2023-10-18T17:25:12.586 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.581+0000 7f96e6746700 1 --2- 172.21.15.158:0/2441630875 >> v2:172.21.15.158:3300/0 conn(0x7f96e00630e0 0x7f96e0065700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:12.588 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.581+0000 7f96e5744700 1 -- 172.21.15.158:0/2441630875 >> v2:172.21.15.183:3300/0 conn(0x7f96e01513e0 msgr2=0x7f96e0067d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:25:12.588 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.581+0000 7f96e5744700 1 --2- 172.21.15.158:0/2441630875 >> v2:172.21.15.183:3300/0 conn(0x7f96e01513e0 0x7f96e0067d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:12.588 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.581+0000 7f96e5744700 1 -- 172.21.15.158:0/2441630875 >> v2:172.21.15.158:3300/0 conn(0x7f96e00630e0 msgr2=0x7f96e0065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:25:12.588 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.581+0000 7f96e5744700 1 --2- 172.21.15.158:0/2441630875 >> v2:172.21.15.158:3300/0 conn(0x7f96e00630e0 0x7f96e0065700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:12.589 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.581+0000 7f96e5744700 1 -- 172.21.15.158:0/2441630875 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e0068570 con 0x7f96e01517c0 2023-10-18T17:25:12.589 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.585+0000 7f96e5744700 1 --2- 172.21.15.158:0/2441630875 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96e01517c0 0x7f96e006a040 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f96e0063040 tx=0x7f96d00090f0).ready entity=mon.2 client_cookie=9a38b28497c0132f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:12.589 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.585+0000 7f96e4f43700 1 -- 172.21.15.158:0/2441630875 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d000f510 con 0x7f96e01517c0 2023-10-18T17:25:12.589 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.585+0000 7f96e4f43700 1 -- 172.21.15.158:0/2441630875 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d000f670 con 0x7f96e01517c0 2023-10-18T17:25:12.589 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.585+0000 7f96e4f43700 1 -- 172.21.15.158:0/2441630875 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d000f9f0 con 0x7f96e01517c0 2023-10-18T17:25:12.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.585+0000 7f96e6f47700 1 -- 172.21.15.158:0/2441630875 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96e01517c0 msgr2=0x7f96e006a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:12.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.585+0000 7f96e6f47700 1 --2- 172.21.15.158:0/2441630875 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96e01517c0 0x7f96e006a040 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f96e0063040 tx=0x7f96d00090f0).stop 2023-10-18T17:25:12.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.585+0000 7f96e6f47700 1 -- 172.21.15.158:0/2441630875 shutdown_connections 2023-10-18T17:25:12.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.585+0000 7f96e6f47700 1 --2- 172.21.15.158:0/2441630875 >> v2:172.21.15.158:3300/0 conn(0x7f96e00630e0 0x7f96e0065700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:12.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.585+0000 7f96e6f47700 1 --2- 172.21.15.158:0/2441630875 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96e01517c0 0x7f96e006a040 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:12.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.585+0000 7f96e6f47700 1 --2- 172.21.15.158:0/2441630875 >> v2:172.21.15.183:3300/0 conn(0x7f96e01513e0 0x7f96e0067d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:12.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.585+0000 7f96e6f47700 1 -- 172.21.15.158:0/2441630875 >> 172.21.15.158:0/2441630875 conn(0x7f96e0062ba0 msgr2=0x7f96e00c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:12.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.585+0000 7f96e6f47700 1 -- 172.21.15.158:0/2441630875 shutdown_connections 2023-10-18T17:25:12.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.585+0000 7f96e6f47700 1 -- 172.21.15.158:0/2441630875 wait complete. 2023-10-18T17:25:12.593 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e6f47700 1 Processor -- start 2023-10-18T17:25:12.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e6f47700 1 -- start start 2023-10-18T17:25:12.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e6f47700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96e00630e0 0x7f96e0151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:12.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e6f47700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96e01513e0 0x7f96e015a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:12.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e6f47700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96e01517c0 0x7f96e014cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:12.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e6f47700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e014e280 con 0x7f96e01517c0 2023-10-18T17:25:12.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e6f47700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e014e820 con 0x7f96e01513e0 2023-10-18T17:25:12.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e6f47700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e00c1580 con 0x7f96e00630e0 2023-10-18T17:25:12.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e6746700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96e01517c0 0x7f96e014cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:12.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e6746700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96e01517c0 0x7f96e014cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:50272/0 (socket says 172.21.15.158:50272) 2023-10-18T17:25:12.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e6746700 1 -- 172.21.15.158:0/1543825864 learned_addr learned my addr 172.21.15.158:0/1543825864 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:12.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e5f45700 1 --2- 172.21.15.158:0/1543825864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96e00630e0 0x7f96e0151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:12.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e5744700 1 --2- 172.21.15.158:0/1543825864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96e01513e0 0x7f96e015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:12.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e6746700 1 -- 172.21.15.158:0/1543825864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96e00630e0 msgr2=0x7f96e0151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:12.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e6746700 1 --2- 172.21.15.158:0/1543825864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96e00630e0 0x7f96e0151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:12.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e6746700 1 -- 172.21.15.158:0/1543825864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96e01513e0 msgr2=0x7f96e015a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:12.597 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e6746700 1 --2- 172.21.15.158:0/1543825864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96e01513e0 0x7f96e015a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:12.597 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e6746700 1 -- 172.21.15.158:0/1543825864 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d0009370 con 0x7f96e01517c0 2023-10-18T17:25:12.597 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e5f45700 1 --2- 172.21.15.158:0/1543825864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96e00630e0 0x7f96e0151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T17:25:12.597 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e5744700 1 --2- 172.21.15.158:0/1543825864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96e01513e0 0x7f96e015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T17:25:12.597 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e6746700 1 --2- 172.21.15.158:0/1543825864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96e01517c0 0x7f96e014cf50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f96d8009e90 tx=0x7f96d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:12.597 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96d5ffb700 1 -- 172.21.15.158:0/1543825864 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d800cc80 con 0x7f96e01517c0 2023-10-18T17:25:12.598 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96d5ffb700 1 -- 172.21.15.158:0/1543825864 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d800f040 con 0x7f96e01517c0 2023-10-18T17:25:12.598 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e6f47700 1 -- 172.21.15.158:0/1543825864 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e014e540 con 0x7f96e01517c0 2023-10-18T17:25:12.598 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96d5ffb700 1 -- 172.21.15.158:0/1543825864 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8013400 con 0x7f96e01517c0 2023-10-18T17:25:12.598 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.589+0000 7f96e6f47700 1 -- 172.21.15.158:0/1543825864 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e0153c50 con 0x7f96e01517c0 2023-10-18T17:25:12.599 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.593+0000 7f96e6f47700 1 -- 172.21.15.158:0/1543825864 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e014cc70 con 0x7f96e01517c0 2023-10-18T17:25:12.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.593+0000 7f96d5ffb700 1 -- 172.21.15.158:0/1543825864 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f96d80137b0 con 0x7f96e01517c0 2023-10-18T17:25:12.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.593+0000 7f96d5ffb700 1 --2- 172.21.15.158:0/1543825864 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f96c405a540 0x7f96c405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:12.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.593+0000 7f96d5ffb700 1 -- 172.21.15.158:0/1543825864 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6467+0+0 (secure 0 0 0) 0x7f96d80751f0 con 0x7f96e01517c0 2023-10-18T17:25:12.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.593+0000 7f96e5f45700 1 --2- 172.21.15.158:0/1543825864 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f96c405a540 0x7f96c405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:12.601 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.597+0000 7f96e5f45700 1 --2- 172.21.15.158:0/1543825864 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f96c405a540 0x7f96c405ca00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f96dc009270 tx=0x7f96dc008040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:12.601 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.597+0000 7f96d5ffb700 1 -- 172.21.15.158:0/1543825864 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f96e014cc70 con 0x7f96e01517c0 2023-10-18T17:25:12.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.793+0000 7f96e6f47700 1 -- 172.21.15.158:0/1543825864 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f96e014cc70 con 0x7f96e01517c0 2023-10-18T17:25:12.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.793+0000 7f96d5ffb700 1 -- 172.21.15.158:0/1543825864 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f96e014cc70 con 0x7f96e01517c0 2023-10-18T17:25:12.796 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:25:12.799 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.797+0000 7f96e6f47700 1 -- 172.21.15.158:0/1543825864 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f96c405a540 msgr2=0x7f96c405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:12.799 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.797+0000 7f96e6f47700 1 --2- 172.21.15.158:0/1543825864 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f96c405a540 0x7f96c405ca00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f96dc009270 tx=0x7f96dc008040).stop 2023-10-18T17:25:12.800 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.797+0000 7f96e6f47700 1 -- 172.21.15.158:0/1543825864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96e01517c0 msgr2=0x7f96e014cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:12.800 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.797+0000 7f96e6f47700 1 --2- 172.21.15.158:0/1543825864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96e01517c0 0x7f96e014cf50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f96d8009e90 tx=0x7f96d800b040).stop 2023-10-18T17:25:12.800 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.797+0000 7f96e6f47700 1 -- 172.21.15.158:0/1543825864 shutdown_connections 2023-10-18T17:25:12.800 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.797+0000 7f96e6f47700 1 --2- 172.21.15.158:0/1543825864 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f96c405a540 0x7f96c405ca00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:12.800 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.797+0000 7f96e6f47700 1 --2- 172.21.15.158:0/1543825864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96e01517c0 0x7f96e014cf50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:12.801 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.797+0000 7f96e6f47700 1 --2- 172.21.15.158:0/1543825864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96e01513e0 0x7f96e015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:12.801 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.797+0000 7f96e6f47700 1 --2- 172.21.15.158:0/1543825864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96e00630e0 0x7f96e0151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:12.801 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.797+0000 7f96e6f47700 1 -- 172.21.15.158:0/1543825864 >> 172.21.15.158:0/1543825864 conn(0x7f96e0062ba0 msgr2=0x7f96e014f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:12.801 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.797+0000 7f96e6f47700 1 -- 172.21.15.158:0/1543825864 shutdown_connections 2023-10-18T17:25:12.801 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:12.797+0000 7f96e6f47700 1 -- 172.21.15.158:0/1543825864 wait complete. 2023-10-18T17:25:12.818 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:25:13.471 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-10-18T17:25:13.471 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~61s 2023-10-18T17:25:13.471 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~20s 2023-10-18T17:25:15.820 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:25:15.979 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.977+0000 7f9971179700 1 Processor -- start 2023-10-18T17:25:15.980 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.977+0000 7f9971179700 1 -- start start 2023-10-18T17:25:15.983 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.981+0000 7f9971179700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f996c063350 0x7f996c063780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:15.983 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.981+0000 7f9971179700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f996c14c380 con 0x7f996c0bc930 2023-10-18T17:25:15.983 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.981+0000 7f9971179700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f996c14c640 con 0x7f996c1498d0 2023-10-18T17:25:15.984 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.981+0000 7f9971179700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f996c14c920 con 0x7f996c063350 2023-10-18T17:25:15.984 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.981+0000 7f99637fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f996c0bc930 0x7f996c0bdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:47910/0 (socket says 172.21.15.158:47910) 2023-10-18T17:25:15.984 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.981+0000 7f99637fe700 1 -- 172.21.15.158:0/1739891612 learned_addr learned my addr 172.21.15.158:0/1739891612 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:25:15.984 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.981+0000 7f9970978700 1 --2- 172.21.15.158:0/1739891612 >> v2:172.21.15.158:3300/0 conn(0x7f996c063350 0x7f996c063780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:15.984 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.981+0000 7f996bfff700 1 --1- 172.21.15.158:0/1739891612 >> v1:172.21.15.183:6789/0 conn(0x7f996c1498d0 0x7f996c0bd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:38514/0 (socket says 172.21.15.158:38514) 2023-10-18T17:25:15.986 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.981+0000 7f996b7fe700 1 -- 172.21.15.158:0/1739891612 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581825592 0 0) 0x7f996c14c380 con 0x7f996c0bc930 2023-10-18T17:25:15.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.981+0000 7f996b7fe700 1 -- 172.21.15.158:0/1739891612 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9958004500 con 0x7f996c0bc930 2023-10-18T17:25:15.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.981+0000 7f996b7fe700 1 -- 172.21.15.158:0/1739891612 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1626931367 0 0) 0x7f996c14c640 con 0x7f996c1498d0 2023-10-18T17:25:15.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.981+0000 7f9970978700 1 -- 172.21.15.158:0/1739891612 >> v1:172.21.15.183:6789/0 conn(0x7f996c1498d0 legacy=0x7f996c0bd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:15.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.981+0000 7f9970978700 1 -- 172.21.15.158:0/1739891612 >> v1:172.21.15.158:6789/0 conn(0x7f996c0bc930 legacy=0x7f996c0bdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:15.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.981+0000 7f9970978700 1 -- 172.21.15.158:0/1739891612 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996c14cc00 con 0x7f996c063350 2023-10-18T17:25:15.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.981+0000 7f9970978700 1 --2- 172.21.15.158:0/1739891612 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f996c063350 0x7f996c063780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f9964009760 tx=0x7f9964009060).ready entity=mon.0 client_cookie=cd50ab72a11089b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:15.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.981+0000 7f996b7fe700 1 -- 172.21.15.158:0/1739891612 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996400f510 con 0x7f996c063350 2023-10-18T17:25:15.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.981+0000 7f996b7fe700 1 -- 172.21.15.158:0/1739891612 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996400f670 con 0x7f996c063350 2023-10-18T17:25:15.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.981+0000 7f996b7fe700 1 -- 172.21.15.158:0/1739891612 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996400f9f0 con 0x7f996c063350 2023-10-18T17:25:15.989 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.985+0000 7f9971179700 1 -- 172.21.15.158:0/1739891612 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f996c063350 msgr2=0x7f996c063780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:15.989 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.985+0000 7f9971179700 1 --2- 172.21.15.158:0/1739891612 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f996c063350 0x7f996c063780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f9964009760 tx=0x7f9964009060).stop 2023-10-18T17:25:15.989 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.985+0000 7f9971179700 1 -- 172.21.15.158:0/1739891612 shutdown_connections 2023-10-18T17:25:15.989 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.985+0000 7f9971179700 1 --2- 172.21.15.158:0/1739891612 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f996c063350 0x7f996c063780 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:15.989 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.985+0000 7f9971179700 1 -- 172.21.15.158:0/1739891612 >> 172.21.15.158:0/1739891612 conn(0x7f996c062ba0 msgr2=0x7f996c0c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:15.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.985+0000 7f9971179700 1 -- 172.21.15.158:0/1739891612 shutdown_connections 2023-10-18T17:25:15.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.985+0000 7f9971179700 1 -- 172.21.15.158:0/1739891612 wait complete. 2023-10-18T17:25:15.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.985+0000 7f9971179700 1 Processor -- start 2023-10-18T17:25:15.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.985+0000 7f9971179700 1 -- start start 2023-10-18T17:25:15.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f9971179700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f996c063350 0x7f996c14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:15.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f9971179700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f996c0bc930 0x7f996c14f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:15.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f9971179700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f996c1498d0 0x7f996c14da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:15.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f9971179700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996c0b6a50 con 0x7f996c1498d0 2023-10-18T17:25:15.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f9971179700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996c0b7830 con 0x7f996c063350 2023-10-18T17:25:15.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f9971179700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996c14d6b0 con 0x7f996c0bc930 2023-10-18T17:25:15.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f996bfff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f996c063350 0x7f996c14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:15.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f99637fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f996c0bc930 0x7f996c14f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:15.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f9970978700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f996c1498d0 0x7f996c14da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:15.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f996bfff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f996c063350 0x7f996c14ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:50708/0 (socket says 172.21.15.158:50708) 2023-10-18T17:25:15.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f99637fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f996c0bc930 0x7f996c14f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:56410/0 (socket says 172.21.15.158:56410) 2023-10-18T17:25:15.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f996bfff700 1 -- 172.21.15.158:0/1579723145 learned_addr learned my addr 172.21.15.158:0/1579723145 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:15.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f9970978700 1 -- 172.21.15.158:0/1579723145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f996c0bc930 msgr2=0x7f996c14f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:15.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f9970978700 1 --2- 172.21.15.158:0/1579723145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f996c0bc930 0x7f996c14f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:15.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f9970978700 1 -- 172.21.15.158:0/1579723145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f996c063350 msgr2=0x7f996c14ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:15.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f9970978700 1 --2- 172.21.15.158:0/1579723145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f996c063350 0x7f996c14ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:15.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f9970978700 1 -- 172.21.15.158:0/1579723145 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99640092a0 con 0x7f996c1498d0 2023-10-18T17:25:15.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f9970978700 1 --2- 172.21.15.158:0/1579723145 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f996c1498d0 0x7f996c14da90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f9964014000 tx=0x7f9964017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:15.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f9968ff9700 1 -- 172.21.15.158:0/1579723145 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996400f7e0 con 0x7f996c1498d0 2023-10-18T17:25:15.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f9968ff9700 1 -- 172.21.15.158:0/1579723145 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996400f940 con 0x7f996c1498d0 2023-10-18T17:25:15.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f9971179700 1 -- 172.21.15.158:0/1579723145 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996c150660 con 0x7f996c1498d0 2023-10-18T17:25:15.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f9968ff9700 1 -- 172.21.15.158:0/1579723145 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996401b660 con 0x7f996c1498d0 2023-10-18T17:25:15.999 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.989+0000 7f9971179700 1 -- 172.21.15.158:0/1579723145 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f996c0b5ba0 con 0x7f996c1498d0 2023-10-18T17:25:15.999 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.993+0000 7f9971179700 1 -- 172.21.15.158:0/1579723145 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f996c0b79e0 con 0x7f996c1498d0 2023-10-18T17:25:16.000 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.993+0000 7f9968ff9700 1 -- 172.21.15.158:0/1579723145 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f996401b9d0 con 0x7f996c1498d0 2023-10-18T17:25:16.000 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.993+0000 7f9968ff9700 1 --2- 172.21.15.158:0/1579723145 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f994c05a4e0 0x7f994c05c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:16.000 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.993+0000 7f9968ff9700 1 -- 172.21.15.158:0/1579723145 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6467+0+0 (secure 0 0 0) 0x7f9964076230 con 0x7f996c1498d0 2023-10-18T17:25:16.000 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.993+0000 7f996bfff700 1 --2- 172.21.15.158:0/1579723145 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f994c05a4e0 0x7f994c05c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:16.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.997+0000 7f996bfff700 1 --2- 172.21.15.158:0/1579723145 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f994c05a4e0 0x7f994c05c9a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f995c001ae0 tx=0x7f995c001580).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:16.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:15.997+0000 7f9968ff9700 1 -- 172.21.15.158:0/1579723145 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f996c0b79e0 con 0x7f996c1498d0 2023-10-18T17:25:16.193 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:16.189+0000 7f9971179700 1 -- 172.21.15.158:0/1579723145 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f996c0b79e0 con 0x7f996c1498d0 2023-10-18T17:25:16.194 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:16.193+0000 7f9968ff9700 1 -- 172.21.15.158:0/1579723145 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f996c0b79e0 con 0x7f996c1498d0 2023-10-18T17:25:16.194 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:25:16.196 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:16.193+0000 7f9971179700 1 -- 172.21.15.158:0/1579723145 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f994c05a4e0 msgr2=0x7f994c05c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:16.197 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:16.193+0000 7f9971179700 1 --2- 172.21.15.158:0/1579723145 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f994c05a4e0 0x7f994c05c9a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f995c001ae0 tx=0x7f995c001580).stop 2023-10-18T17:25:16.197 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:16.193+0000 7f9971179700 1 -- 172.21.15.158:0/1579723145 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f996c1498d0 msgr2=0x7f996c14da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:16.197 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:16.193+0000 7f9971179700 1 --2- 172.21.15.158:0/1579723145 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f996c1498d0 0x7f996c14da90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f9964014000 tx=0x7f9964017000).stop 2023-10-18T17:25:16.197 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:16.193+0000 7f9971179700 1 -- 172.21.15.158:0/1579723145 shutdown_connections 2023-10-18T17:25:16.197 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:16.193+0000 7f9971179700 1 --2- 172.21.15.158:0/1579723145 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f994c05a4e0 0x7f994c05c9a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:16.198 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:16.193+0000 7f9971179700 1 --2- 172.21.15.158:0/1579723145 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f996c1498d0 0x7f996c14da90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:16.198 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:16.193+0000 7f9971179700 1 --2- 172.21.15.158:0/1579723145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f996c0bc930 0x7f996c14f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:16.198 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:16.193+0000 7f9971179700 1 --2- 172.21.15.158:0/1579723145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f996c063350 0x7f996c14ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:16.198 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:16.193+0000 7f9971179700 1 -- 172.21.15.158:0/1579723145 >> 172.21.15.158:0/1579723145 conn(0x7f996c062ba0 msgr2=0x7f996c148ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:16.199 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:16.193+0000 7f9971179700 1 -- 172.21.15.158:0/1579723145 shutdown_connections 2023-10-18T17:25:16.199 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:16.193+0000 7f9971179700 1 -- 172.21.15.158:0/1579723145 wait complete. 2023-10-18T17:25:16.216 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:25:19.218 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:25:19.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.377+0000 7f96e2347700 1 Processor -- start 2023-10-18T17:25:19.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.377+0000 7f96e2347700 1 -- start start 2023-10-18T17:25:19.382 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.381+0000 7f96e2347700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f96dc0c2bf0 0x7f96dc065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:19.382 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.381+0000 7f96e2347700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96dc0be2e0 con 0x7f96dc0658a0 2023-10-18T17:25:19.383 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.381+0000 7f96e2347700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96dc0be770 con 0x7f96dc0bd1c0 2023-10-18T17:25:19.383 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.381+0000 7f96e2347700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96dc0bda80 con 0x7f96dc0c2bf0 2023-10-18T17:25:19.384 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.381+0000 7f96e0b44700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f96dc0c2bf0 0x7f96dc065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:19.384 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.381+0000 7f96e1345700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f96dc0658a0 0x7f96dc0630e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:41790/0 (socket says 172.21.15.158:41790) 2023-10-18T17:25:19.384 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.381+0000 7f96e1345700 1 -- 172.21.15.158:0/3851229841 learned_addr learned my addr 172.21.15.158:0/3851229841 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:25:19.384 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.381+0000 7f96e1b46700 1 --1- 172.21.15.158:0/3851229841 >> v1:172.21.15.183:6789/0 conn(0x7f96dc0bd1c0 0x7f96dc14ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:46750/0 (socket says 172.21.15.158:46750) 2023-10-18T17:25:19.384 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.381+0000 7f96dbfff700 1 -- 172.21.15.158:0/3851229841 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587596211 0 0) 0x7f96dc0be770 con 0x7f96dc0bd1c0 2023-10-18T17:25:19.385 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.381+0000 7f96e0b44700 1 -- 172.21.15.158:0/3851229841 >> v1:172.21.15.183:6789/0 conn(0x7f96dc0bd1c0 legacy=0x7f96dc14ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:19.385 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.381+0000 7f96e0b44700 1 -- 172.21.15.158:0/3851229841 >> v1:172.21.15.158:6789/0 conn(0x7f96dc0658a0 legacy=0x7f96dc0630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:19.385 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.381+0000 7f96e0b44700 1 -- 172.21.15.158:0/3851229841 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96dc0b9580 con 0x7f96dc0c2bf0 2023-10-18T17:25:19.386 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.381+0000 7f96e0b44700 1 --2- 172.21.15.158:0/3851229841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96dc0c2bf0 0x7f96dc065c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f96d0009760 tx=0x7f96d0009060).ready entity=mon.1 client_cookie=70bf0e6adb9ca7d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:19.386 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.381+0000 7f96dbfff700 1 -- 172.21.15.158:0/3851229841 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d000b580 con 0x7f96dc0c2bf0 2023-10-18T17:25:19.387 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.381+0000 7f96dbfff700 1 -- 172.21.15.158:0/3851229841 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d000b6e0 con 0x7f96dc0c2bf0 2023-10-18T17:25:19.387 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.381+0000 7f96dbfff700 1 -- 172.21.15.158:0/3851229841 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d000ba60 con 0x7f96dc0c2bf0 2023-10-18T17:25:19.387 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.385+0000 7f96e2347700 1 -- 172.21.15.158:0/3851229841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96dc0c2bf0 msgr2=0x7f96dc065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:19.387 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.385+0000 7f96e2347700 1 --2- 172.21.15.158:0/3851229841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96dc0c2bf0 0x7f96dc065c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f96d0009760 tx=0x7f96d0009060).stop 2023-10-18T17:25:19.387 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.385+0000 7f96e2347700 1 -- 172.21.15.158:0/3851229841 shutdown_connections 2023-10-18T17:25:19.388 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.385+0000 7f96e2347700 1 --2- 172.21.15.158:0/3851229841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96dc0c2bf0 0x7f96dc065c80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:19.388 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.385+0000 7f96e2347700 1 -- 172.21.15.158:0/3851229841 >> 172.21.15.158:0/3851229841 conn(0x7f96dc062ba0 msgr2=0x7f96dc0c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:19.388 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.385+0000 7f96e2347700 1 -- 172.21.15.158:0/3851229841 shutdown_connections 2023-10-18T17:25:19.388 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.385+0000 7f96e2347700 1 -- 172.21.15.158:0/3851229841 wait complete. 2023-10-18T17:25:19.389 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.385+0000 7f96e2347700 1 Processor -- start 2023-10-18T17:25:19.389 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.385+0000 7f96e2347700 1 -- start start 2023-10-18T17:25:19.392 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96e2347700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96dc0658a0 0x7f96dc1607a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:19.392 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96e2347700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96dc0bd1c0 0x7f96dc0c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:19.392 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96e2347700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96dc0c2bf0 0x7f96dc0691f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:19.392 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96e2347700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc0b7d00 con 0x7f96dc0658a0 2023-10-18T17:25:19.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96e2347700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc15fd90 con 0x7f96dc0bd1c0 2023-10-18T17:25:19.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96e2347700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc152180 con 0x7f96dc0c2bf0 2023-10-18T17:25:19.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96e1345700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96dc0658a0 0x7f96dc1607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:19.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96e1345700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96dc0658a0 0x7f96dc1607a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:49556/0 (socket says 172.21.15.158:49556) 2023-10-18T17:25:19.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96e1345700 1 -- 172.21.15.158:0/1645501694 learned_addr learned my addr 172.21.15.158:0/1645501694 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:19.394 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96e0b44700 1 --2- 172.21.15.158:0/1645501694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96dc0bd1c0 0x7f96dc0c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:19.394 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96e1b46700 1 --2- 172.21.15.158:0/1645501694 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96dc0c2bf0 0x7f96dc0691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:19.394 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96e1345700 1 -- 172.21.15.158:0/1645501694 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96dc0c2bf0 msgr2=0x7f96dc0691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:19.394 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96e1345700 1 --2- 172.21.15.158:0/1645501694 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96dc0c2bf0 0x7f96dc0691f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:19.394 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96e1345700 1 -- 172.21.15.158:0/1645501694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96dc0bd1c0 msgr2=0x7f96dc0c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:19.395 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96e1345700 1 --2- 172.21.15.158:0/1645501694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96dc0bd1c0 0x7f96dc0c0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:19.395 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96e1345700 1 -- 172.21.15.158:0/1645501694 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d00092a0 con 0x7f96dc0658a0 2023-10-18T17:25:19.395 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96e1345700 1 --2- 172.21.15.158:0/1645501694 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96dc0658a0 0x7f96dc1607a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f96cc00c490 tx=0x7f96cc007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:19.396 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96d97fa700 1 -- 172.21.15.158:0/1645501694 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc00ce90 con 0x7f96dc0658a0 2023-10-18T17:25:19.396 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96d97fa700 1 -- 172.21.15.158:0/1645501694 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96cc0072e0 con 0x7f96dc0658a0 2023-10-18T17:25:19.396 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96e2347700 1 -- 172.21.15.158:0/1645501694 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96dc149c60 con 0x7f96dc0658a0 2023-10-18T17:25:19.397 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96d97fa700 1 -- 172.21.15.158:0/1645501694 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc007660 con 0x7f96dc0658a0 2023-10-18T17:25:19.397 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.389+0000 7f96e2347700 1 -- 172.21.15.158:0/1645501694 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96dc160c90 con 0x7f96dc0658a0 2023-10-18T17:25:19.397 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.393+0000 7f96e2347700 1 -- 172.21.15.158:0/1645501694 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96dc069eb0 con 0x7f96dc0658a0 2023-10-18T17:25:19.397 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.393+0000 7f96d97fa700 1 -- 172.21.15.158:0/1645501694 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f96cc0059b0 con 0x7f96dc0658a0 2023-10-18T17:25:19.398 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.393+0000 7f96d97fa700 1 --2- 172.21.15.158:0/1645501694 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f96c805a510 0x7f96c805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:19.398 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.393+0000 7f96d97fa700 1 -- 172.21.15.158:0/1645501694 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6467+0+0 (secure 0 0 0) 0x7f96cc074110 con 0x7f96dc0658a0 2023-10-18T17:25:19.399 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.393+0000 7f96e0b44700 1 --2- 172.21.15.158:0/1645501694 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f96c805a510 0x7f96c805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:19.399 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.397+0000 7f96e0b44700 1 --2- 172.21.15.158:0/1645501694 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f96c805a510 0x7f96c805c9d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f96d000b340 tx=0x7f96d0017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:19.402 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.401+0000 7f96d97fa700 1 -- 172.21.15.158:0/1645501694 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f96dc069eb0 con 0x7f96dc0658a0 2023-10-18T17:25:19.598 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.597+0000 7f96e2347700 1 -- 172.21.15.158:0/1645501694 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f96dc069eb0 con 0x7f96dc0658a0 2023-10-18T17:25:19.598 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.597+0000 7f96d97fa700 1 -- 172.21.15.158:0/1645501694 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f96dc069eb0 con 0x7f96dc0658a0 2023-10-18T17:25:19.599 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:25:19.601 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.597+0000 7f96e2347700 1 -- 172.21.15.158:0/1645501694 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f96c805a510 msgr2=0x7f96c805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:19.601 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.597+0000 7f96e2347700 1 --2- 172.21.15.158:0/1645501694 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f96c805a510 0x7f96c805c9d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f96d000b340 tx=0x7f96d0017000).stop 2023-10-18T17:25:19.601 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.597+0000 7f96e2347700 1 -- 172.21.15.158:0/1645501694 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96dc0658a0 msgr2=0x7f96dc1607a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:19.601 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.597+0000 7f96e2347700 1 --2- 172.21.15.158:0/1645501694 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96dc0658a0 0x7f96dc1607a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f96cc00c490 tx=0x7f96cc007df0).stop 2023-10-18T17:25:19.602 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.597+0000 7f96e2347700 1 -- 172.21.15.158:0/1645501694 shutdown_connections 2023-10-18T17:25:19.603 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.597+0000 7f96e2347700 1 --2- 172.21.15.158:0/1645501694 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f96c805a510 0x7f96c805c9d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:19.603 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.597+0000 7f96e2347700 1 --2- 172.21.15.158:0/1645501694 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96dc0c2bf0 0x7f96dc0691f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:19.603 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.597+0000 7f96e2347700 1 --2- 172.21.15.158:0/1645501694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96dc0bd1c0 0x7f96dc0c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:19.603 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.597+0000 7f96e2347700 1 --2- 172.21.15.158:0/1645501694 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96dc0658a0 0x7f96dc1607a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:19.603 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.597+0000 7f96e2347700 1 -- 172.21.15.158:0/1645501694 >> 172.21.15.158:0/1645501694 conn(0x7f96dc062ba0 msgr2=0x7f96dc14e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:19.604 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.601+0000 7f96e2347700 1 -- 172.21.15.158:0/1645501694 shutdown_connections 2023-10-18T17:25:19.604 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:19.601+0000 7f96e2347700 1 -- 172.21.15.158:0/1645501694 wait complete. 2023-10-18T17:25:19.620 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:25:20.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2023-10-18T17:25:20.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~68s 2023-10-18T17:25:20.084 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~27s 2023-10-18T17:25:20.545 INFO:tasks.ceph.mds.e.smithi158.stderr:terminate called after throwing an instance of 'boost::wrapexcept' 2023-10-18T17:25:20.546 INFO:tasks.ceph.mds.e.smithi158.stderr: what(): boost::bad_get: failed value get using boost::get 2023-10-18T17:25:20.546 INFO:tasks.ceph.mds.e.smithi158.stderr:*** Caught signal (Aborted) ** 2023-10-18T17:25:20.546 INFO:tasks.ceph.mds.e.smithi158.stderr: in thread 7fb09d09b700 thread_name:ms_dispatch 2023-10-18T17:25:20.548 INFO:tasks.ceph.mds.e.smithi158.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:25:20.548 INFO:tasks.ceph.mds.e.smithi158.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fb0ab02a420] 2023-10-18T17:25:20.549 INFO:tasks.ceph.mds.e.smithi158.stderr: 2: gsignal() 2023-10-18T17:25:20.549 INFO:tasks.ceph.mds.e.smithi158.stderr: 3: abort() 2023-10-18T17:25:20.549 INFO:tasks.ceph.mds.e.smithi158.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7fb0a20bc911] 2023-10-18T17:25:20.549 INFO:tasks.ceph.mds.e.smithi158.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7fb0a20c838c] 2023-10-18T17:25:20.549 INFO:tasks.ceph.mds.e.smithi158.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7fb0a20c83f7] 2023-10-18T17:25:20.550 INFO:tasks.ceph.mds.e.smithi158.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7fb0a20c86a9] 2023-10-18T17:25:20.550 INFO:tasks.ceph.mds.e.smithi158.stderr: 8: ceph-mds(+0x185107) [0x5590879fe107] 2023-10-18T17:25:20.550 INFO:tasks.ceph.mds.e.smithi158.stderr: 9: ceph-mds(+0x18572d) [0x5590879fe72d] 2023-10-18T17:25:20.550 INFO:tasks.ceph.mds.e.smithi158.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x559087a7009f] 2023-10-18T17:25:20.550 INFO:tasks.ceph.mds.e.smithi158.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x559087a71a95] 2023-10-18T17:25:20.551 INFO:tasks.ceph.mds.e.smithi158.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x559087a3cb10] 2023-10-18T17:25:20.551 INFO:tasks.ceph.mds.e.smithi158.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x559087a40abf] 2023-10-18T17:25:20.551 INFO:tasks.ceph.mds.e.smithi158.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x559087a41456] 2023-10-18T17:25:20.551 INFO:tasks.ceph.mds.e.smithi158.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7fb0a26bc710] 2023-10-18T17:25:20.551 INFO:tasks.ceph.mds.e.smithi158.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7fb0a26b9faf] 2023-10-18T17:25:20.552 INFO:tasks.ceph.mds.e.smithi158.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb0a2788b21] 2023-10-18T17:25:20.552 INFO:tasks.ceph.mds.e.smithi158.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fb0ab01e609] 2023-10-18T17:25:20.552 INFO:tasks.ceph.mds.e.smithi158.stderr: 19: clone() 2023-10-18T17:25:20.553 INFO:tasks.ceph.mds.e.smithi158.stderr:2023-10-18T17:25:20.545+0000 7fb09d09b700 -1 *** Caught signal (Aborted) ** 2023-10-18T17:25:20.553 INFO:tasks.ceph.mds.e.smithi158.stderr: in thread 7fb09d09b700 thread_name:ms_dispatch 2023-10-18T17:25:20.553 INFO:tasks.ceph.mds.e.smithi158.stderr: 2023-10-18T17:25:20.553 INFO:tasks.ceph.mds.e.smithi158.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:25:20.553 INFO:tasks.ceph.mds.e.smithi158.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fb0ab02a420] 2023-10-18T17:25:20.554 INFO:tasks.ceph.mds.e.smithi158.stderr: 2: gsignal() 2023-10-18T17:25:20.554 INFO:tasks.ceph.mds.e.smithi158.stderr: 3: abort() 2023-10-18T17:25:20.554 INFO:tasks.ceph.mds.e.smithi158.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7fb0a20bc911] 2023-10-18T17:25:20.554 INFO:tasks.ceph.mds.e.smithi158.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7fb0a20c838c] 2023-10-18T17:25:20.554 INFO:tasks.ceph.mds.e.smithi158.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7fb0a20c83f7] 2023-10-18T17:25:20.555 INFO:tasks.ceph.mds.e.smithi158.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7fb0a20c86a9] 2023-10-18T17:25:20.555 INFO:tasks.ceph.mds.e.smithi158.stderr: 8: ceph-mds(+0x185107) [0x5590879fe107] 2023-10-18T17:25:20.555 INFO:tasks.ceph.mds.e.smithi158.stderr: 9: ceph-mds(+0x18572d) [0x5590879fe72d] 2023-10-18T17:25:20.555 INFO:tasks.ceph.mds.e.smithi158.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x559087a7009f] 2023-10-18T17:25:20.556 INFO:tasks.ceph.mds.e.smithi158.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x559087a71a95] 2023-10-18T17:25:20.556 INFO:tasks.ceph.mds.e.smithi158.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x559087a3cb10] 2023-10-18T17:25:20.556 INFO:tasks.ceph.mds.e.smithi158.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x559087a40abf] 2023-10-18T17:25:20.556 INFO:tasks.ceph.mds.e.smithi158.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x559087a41456] 2023-10-18T17:25:20.556 INFO:tasks.ceph.mds.e.smithi158.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7fb0a26bc710] 2023-10-18T17:25:20.557 INFO:tasks.ceph.mds.e.smithi158.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7fb0a26b9faf] 2023-10-18T17:25:20.557 INFO:tasks.ceph.mds.e.smithi158.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb0a2788b21] 2023-10-18T17:25:20.557 INFO:tasks.ceph.mds.e.smithi158.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fb0ab01e609] 2023-10-18T17:25:20.557 INFO:tasks.ceph.mds.e.smithi158.stderr: 19: clone() 2023-10-18T17:25:20.557 INFO:tasks.ceph.mds.e.smithi158.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T17:25:20.558 INFO:tasks.ceph.mds.e.smithi158.stderr: 2023-10-18T17:25:20.558 INFO:tasks.ceph.mds.e.smithi158.stderr: 0> 2023-10-18T17:25:20.545+0000 7fb09d09b700 -1 *** Caught signal (Aborted) ** 2023-10-18T17:25:20.558 INFO:tasks.ceph.mds.e.smithi158.stderr: in thread 7fb09d09b700 thread_name:ms_dispatch 2023-10-18T17:25:20.558 INFO:tasks.ceph.mds.e.smithi158.stderr: 2023-10-18T17:25:20.558 INFO:tasks.ceph.mds.e.smithi158.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:25:20.559 INFO:tasks.ceph.mds.e.smithi158.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fb0ab02a420] 2023-10-18T17:25:20.559 INFO:tasks.ceph.mds.e.smithi158.stderr: 2: gsignal() 2023-10-18T17:25:20.559 INFO:tasks.ceph.mds.e.smithi158.stderr: 3: abort() 2023-10-18T17:25:20.559 INFO:tasks.ceph.mds.e.smithi158.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7fb0a20bc911] 2023-10-18T17:25:20.559 INFO:tasks.ceph.mds.e.smithi158.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7fb0a20c838c] 2023-10-18T17:25:20.560 INFO:tasks.ceph.mds.e.smithi158.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7fb0a20c83f7] 2023-10-18T17:25:20.560 INFO:tasks.ceph.mds.e.smithi158.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7fb0a20c86a9] 2023-10-18T17:25:20.560 INFO:tasks.ceph.mds.e.smithi158.stderr: 8: ceph-mds(+0x185107) [0x5590879fe107] 2023-10-18T17:25:20.560 INFO:tasks.ceph.mds.e.smithi158.stderr: 9: ceph-mds(+0x18572d) [0x5590879fe72d] 2023-10-18T17:25:20.560 INFO:tasks.ceph.mds.e.smithi158.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x559087a7009f] 2023-10-18T17:25:20.561 INFO:tasks.ceph.mds.e.smithi158.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x559087a71a95] 2023-10-18T17:25:20.561 INFO:tasks.ceph.mds.e.smithi158.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x559087a3cb10] 2023-10-18T17:25:20.561 INFO:tasks.ceph.mds.e.smithi158.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x559087a40abf] 2023-10-18T17:25:20.561 INFO:tasks.ceph.mds.e.smithi158.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x559087a41456] 2023-10-18T17:25:20.561 INFO:tasks.ceph.mds.e.smithi158.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7fb0a26bc710] 2023-10-18T17:25:20.562 INFO:tasks.ceph.mds.e.smithi158.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7fb0a26b9faf] 2023-10-18T17:25:20.562 INFO:tasks.ceph.mds.e.smithi158.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb0a2788b21] 2023-10-18T17:25:20.562 INFO:tasks.ceph.mds.e.smithi158.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fb0ab01e609] 2023-10-18T17:25:20.562 INFO:tasks.ceph.mds.e.smithi158.stderr: 19: clone() 2023-10-18T17:25:20.562 INFO:tasks.ceph.mds.e.smithi158.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T17:25:20.563 INFO:tasks.ceph.mds.e.smithi158.stderr: 2023-10-18T17:25:20.563 INFO:tasks.ceph.mds.e.smithi158.stderr: 0> 2023-10-18T17:25:20.545+0000 7fb09d09b700 -1 *** Caught signal (Aborted) ** 2023-10-18T17:25:20.563 INFO:tasks.ceph.mds.e.smithi158.stderr: in thread 7fb09d09b700 thread_name:ms_dispatch 2023-10-18T17:25:20.563 INFO:tasks.ceph.mds.e.smithi158.stderr: 2023-10-18T17:25:20.564 INFO:tasks.ceph.mds.e.smithi158.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:25:20.564 INFO:tasks.ceph.mds.e.smithi158.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fb0ab02a420] 2023-10-18T17:25:20.564 INFO:tasks.ceph.mds.e.smithi158.stderr: 2: gsignal() 2023-10-18T17:25:20.564 INFO:tasks.ceph.mds.e.smithi158.stderr: 3: abort() 2023-10-18T17:25:20.564 INFO:tasks.ceph.mds.e.smithi158.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7fb0a20bc911] 2023-10-18T17:25:20.565 INFO:tasks.ceph.mds.e.smithi158.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7fb0a20c838c] 2023-10-18T17:25:20.565 INFO:tasks.ceph.mds.e.smithi158.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7fb0a20c83f7] 2023-10-18T17:25:20.565 INFO:tasks.ceph.mds.e.smithi158.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7fb0a20c86a9] 2023-10-18T17:25:20.565 INFO:tasks.ceph.mds.e.smithi158.stderr: 8: ceph-mds(+0x185107) [0x5590879fe107] 2023-10-18T17:25:20.565 INFO:tasks.ceph.mds.e.smithi158.stderr: 9: ceph-mds(+0x18572d) [0x5590879fe72d] 2023-10-18T17:25:20.566 INFO:tasks.ceph.mds.e.smithi158.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x559087a7009f] 2023-10-18T17:25:20.566 INFO:tasks.ceph.mds.e.smithi158.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x559087a71a95] 2023-10-18T17:25:20.566 INFO:tasks.ceph.mds.e.smithi158.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x559087a3cb10] 2023-10-18T17:25:20.566 INFO:tasks.ceph.mds.e.smithi158.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x559087a40abf] 2023-10-18T17:25:20.566 INFO:tasks.ceph.mds.e.smithi158.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x559087a41456] 2023-10-18T17:25:20.567 INFO:tasks.ceph.mds.e.smithi158.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7fb0a26bc710] 2023-10-18T17:25:20.567 INFO:tasks.ceph.mds.e.smithi158.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7fb0a26b9faf] 2023-10-18T17:25:20.567 INFO:tasks.ceph.mds.e.smithi158.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb0a2788b21] 2023-10-18T17:25:20.567 INFO:tasks.ceph.mds.e.smithi158.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fb0ab01e609] 2023-10-18T17:25:20.567 INFO:tasks.ceph.mds.e.smithi158.stderr: 19: clone() 2023-10-18T17:25:20.568 INFO:tasks.ceph.mds.e.smithi158.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T17:25:20.568 INFO:tasks.ceph.mds.e.smithi158.stderr: 2023-10-18T17:25:20.713 INFO:tasks.ceph.mds.e.smithi158.stderr:daemon-helper: command crashed with signal 6 2023-10-18T17:25:22.621 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:25:22.778 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.777+0000 7fbfb3e9b700 1 Processor -- start 2023-10-18T17:25:22.779 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.777+0000 7fbfb3e9b700 1 -- start start 2023-10-18T17:25:22.781 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.777+0000 7fbfb3e9b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfac0666b0 0x7fbfac0bd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:22.781 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.777+0000 7fbfb3e9b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfac065cd0 con 0x7fbfac0bde20 2023-10-18T17:25:22.781 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.777+0000 7fbfb3e9b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfac154750 con 0x7fbfac067ff0 2023-10-18T17:25:22.781 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.777+0000 7fbfb3e9b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac066160 con 0x7fbfac0666b0 2023-10-18T17:25:22.783 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.777+0000 7fbfb1c37700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fbfac067ff0 0x7fbfac0683d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:46762/0 (socket says 172.21.15.158:46762) 2023-10-18T17:25:22.783 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb1c37700 1 -- 172.21.15.158:0/2923728338 learned_addr learned my addr 172.21.15.158:0/2923728338 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:25:22.783 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb2438700 1 --1- 172.21.15.158:0/2923728338 >> v1:172.21.15.158:6789/0 conn(0x7fbfac0bde20 0x7fbfac151410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:41804/0 (socket says 172.21.15.158:41804) 2023-10-18T17:25:22.783 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb1436700 1 --2- 172.21.15.158:0/2923728338 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfac0666b0 0x7fbfac0bd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:22.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb0c35700 1 -- 172.21.15.158:0/2923728338 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782089027 0 0) 0x7fbfac065cd0 con 0x7fbfac0bde20 2023-10-18T17:25:22.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb0c35700 1 -- 172.21.15.158:0/2923728338 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf980033f0 con 0x7fbfac0bde20 2023-10-18T17:25:22.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb0c35700 1 -- 172.21.15.158:0/2923728338 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893517811 0 0) 0x7fbfac154750 con 0x7fbfac067ff0 2023-10-18T17:25:22.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb0c35700 1 -- 172.21.15.158:0/2923728338 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfac065cd0 con 0x7fbfac067ff0 2023-10-18T17:25:22.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb1436700 1 -- 172.21.15.158:0/2923728338 >> v1:172.21.15.183:6789/0 conn(0x7fbfac067ff0 legacy=0x7fbfac0683d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:22.785 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb1436700 1 -- 172.21.15.158:0/2923728338 >> v1:172.21.15.158:6789/0 conn(0x7fbfac0bde20 legacy=0x7fbfac151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:22.785 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb0c35700 1 -- 172.21.15.158:0/2923728338 <== mon.0 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2929560988 0 0) 0x7fbf980033f0 con 0x7fbfac0bde20 2023-10-18T17:25:22.785 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb1436700 1 -- 172.21.15.158:0/2923728338 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac065100 con 0x7fbfac0666b0 2023-10-18T17:25:22.785 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb1436700 1 --2- 172.21.15.158:0/2923728338 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfac0666b0 0x7fbfac0bd930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fbf9c009790 tx=0x7fbf9c009060).ready entity=mon.2 client_cookie=610ab8d489afd6b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:22.786 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb0c35700 1 -- 172.21.15.158:0/2923728338 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4001720 con 0x7fbfac0666b0 2023-10-18T17:25:22.786 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb0c35700 1 -- 172.21.15.158:0/2923728338 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c011400 con 0x7fbfac0666b0 2023-10-18T17:25:22.787 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb0c35700 1 -- 172.21.15.158:0/2923728338 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c011780 con 0x7fbfac0666b0 2023-10-18T17:25:22.787 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb3e9b700 1 -- 172.21.15.158:0/2923728338 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfac0666b0 msgr2=0x7fbfac0bd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:22.787 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb3e9b700 1 --2- 172.21.15.158:0/2923728338 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfac0666b0 0x7fbfac0bd930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fbf9c009790 tx=0x7fbf9c009060).stop 2023-10-18T17:25:22.787 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb3e9b700 1 -- 172.21.15.158:0/2923728338 shutdown_connections 2023-10-18T17:25:22.787 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb3e9b700 1 --2- 172.21.15.158:0/2923728338 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfac0666b0 0x7fbfac0bd930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:22.788 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb3e9b700 1 -- 172.21.15.158:0/2923728338 >> 172.21.15.158:0/2923728338 conn(0x7fbfac0620d0 msgr2=0x7fbfac0624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:22.788 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb3e9b700 1 -- 172.21.15.158:0/2923728338 shutdown_connections 2023-10-18T17:25:22.788 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.781+0000 7fbfb3e9b700 1 -- 172.21.15.158:0/2923728338 wait complete. 2023-10-18T17:25:22.790 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.785+0000 7fbfb3e9b700 1 Processor -- start 2023-10-18T17:25:22.791 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.785+0000 7fbfb3e9b700 1 -- start start 2023-10-18T17:25:22.791 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.785+0000 7fbfb3e9b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfac0666b0 0x7fbfac164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:22.791 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.785+0000 7fbfb3e9b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfac067ff0 0x7fbfac153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:22.791 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.785+0000 7fbfb3e9b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfac0bde20 0x7fbfac0c0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:22.791 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.785+0000 7fbfb3e9b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac0b86b0 con 0x7fbfac0bde20 2023-10-18T17:25:22.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.785+0000 7fbfb3e9b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac165190 con 0x7fbfac0666b0 2023-10-18T17:25:22.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.785+0000 7fbfb3e9b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac14ce70 con 0x7fbfac067ff0 2023-10-18T17:25:22.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.785+0000 7fbfb2438700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfac0bde20 0x7fbfac0c0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:22.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.785+0000 7fbfb2438700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfac0bde20 0x7fbfac0c0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:49566/0 (socket says 172.21.15.158:49566) 2023-10-18T17:25:22.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.785+0000 7fbfb2438700 1 -- 172.21.15.158:0/1263631737 learned_addr learned my addr 172.21.15.158:0/1263631737 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:22.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.785+0000 7fbfb1436700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfac067ff0 0x7fbfac153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:22.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.785+0000 7fbfb1c37700 1 --2- 172.21.15.158:0/1263631737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfac0666b0 0x7fbfac164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:22.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.785+0000 7fbfb2438700 1 -- 172.21.15.158:0/1263631737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfac067ff0 msgr2=0x7fbfac153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:22.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.785+0000 7fbfb2438700 1 --2- 172.21.15.158:0/1263631737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfac067ff0 0x7fbfac153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:22.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.785+0000 7fbfb2438700 1 -- 172.21.15.158:0/1263631737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfac0666b0 msgr2=0x7fbfac164ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:22.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.785+0000 7fbfb2438700 1 --2- 172.21.15.158:0/1263631737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfac0666b0 0x7fbfac164ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:22.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.785+0000 7fbfb2438700 1 -- 172.21.15.158:0/1263631737 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c0092a0 con 0x7fbfac0bde20 2023-10-18T17:25:22.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.789+0000 7fbfb2438700 1 --2- 172.21.15.158:0/1263631737 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfac0bde20 0x7fbfac0c0e90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fbfa400cb70 tx=0x7fbfa4007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:22.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.789+0000 7fbfa1ffb700 1 -- 172.21.15.158:0/1263631737 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa400ce80 con 0x7fbfac0bde20 2023-10-18T17:25:22.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.789+0000 7fbfa1ffb700 1 -- 172.21.15.158:0/1263631737 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa4004c40 con 0x7fbfac0bde20 2023-10-18T17:25:22.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.789+0000 7fbfb3e9b700 1 -- 172.21.15.158:0/1263631737 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfac0b7aa0 con 0x7fbfac0bde20 2023-10-18T17:25:22.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.789+0000 7fbfa1ffb700 1 -- 172.21.15.158:0/1263631737 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4007170 con 0x7fbfac0bde20 2023-10-18T17:25:22.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.789+0000 7fbfb3e9b700 1 -- 172.21.15.158:0/1263631737 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfac0b7ff0 con 0x7fbfac0bde20 2023-10-18T17:25:22.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.789+0000 7fbfb3e9b700 1 -- 172.21.15.158:0/1263631737 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfac06c190 con 0x7fbfac0bde20 2023-10-18T17:25:22.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.789+0000 7fbfa1ffb700 1 -- 172.21.15.158:0/1263631737 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbfa4007520 con 0x7fbfac0bde20 2023-10-18T17:25:22.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.793+0000 7fbfa1ffb700 1 --2- 172.21.15.158:0/1263631737 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fbf9005a4e0 0x7fbf9005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:22.797 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.793+0000 7fbfa1ffb700 1 -- 172.21.15.158:0/1263631737 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6553+0+0 (secure 0 0 0) 0x7fbfa4074900 con 0x7fbfac0bde20 2023-10-18T17:25:22.797 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.793+0000 7fbfb1c37700 1 --2- 172.21.15.158:0/1263631737 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fbf9005a4e0 0x7fbf9005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:22.797 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.793+0000 7fbfb1c37700 1 --2- 172.21.15.158:0/1263631737 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fbf9005a4e0 0x7fbf9005c9a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fbfa8007fd0 tx=0x7fbfa8009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:22.800 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.797+0000 7fbfa1ffb700 1 -- 172.21.15.158:0/1263631737 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fbfa4047e70 con 0x7fbfac0bde20 2023-10-18T17:25:22.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.993+0000 7fbfb3e9b700 1 -- 172.21.15.158:0/1263631737 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbfac063cf0 con 0x7fbfac0bde20 2023-10-18T17:25:22.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:22.997+0000 7fbfa1ffb700 1 -- 172.21.15.158:0/1263631737 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fbfa404b490 con 0x7fbfac0bde20 2023-10-18T17:25:22.998 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:25:23.003 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:23.001+0000 7fbfb3e9b700 1 -- 172.21.15.158:0/1263631737 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fbf9005a4e0 msgr2=0x7fbf9005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:23.003 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:23.001+0000 7fbfb3e9b700 1 --2- 172.21.15.158:0/1263631737 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fbf9005a4e0 0x7fbf9005c9a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fbfa8007fd0 tx=0x7fbfa8009040).stop 2023-10-18T17:25:23.003 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:23.001+0000 7fbfb3e9b700 1 -- 172.21.15.158:0/1263631737 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfac0bde20 msgr2=0x7fbfac0c0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:23.003 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:23.001+0000 7fbfb3e9b700 1 --2- 172.21.15.158:0/1263631737 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfac0bde20 0x7fbfac0c0e90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fbfa400cb70 tx=0x7fbfa4007c20).stop 2023-10-18T17:25:23.004 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:23.001+0000 7fbfb3e9b700 1 -- 172.21.15.158:0/1263631737 shutdown_connections 2023-10-18T17:25:23.004 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:23.001+0000 7fbfb3e9b700 1 --2- 172.21.15.158:0/1263631737 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fbf9005a4e0 0x7fbf9005c9a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:23.004 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:23.001+0000 7fbfb3e9b700 1 --2- 172.21.15.158:0/1263631737 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfac0bde20 0x7fbfac0c0e90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:23.004 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:23.001+0000 7fbfb3e9b700 1 --2- 172.21.15.158:0/1263631737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfac067ff0 0x7fbfac153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:23.004 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:23.001+0000 7fbfb3e9b700 1 --2- 172.21.15.158:0/1263631737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfac0666b0 0x7fbfac164ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:23.005 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:23.001+0000 7fbfb3e9b700 1 -- 172.21.15.158:0/1263631737 >> 172.21.15.158:0/1263631737 conn(0x7fbfac0620d0 msgr2=0x7fbfac0624b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:23.005 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:23.001+0000 7fbfb3e9b700 1 -- 172.21.15.158:0/1263631737 shutdown_connections 2023-10-18T17:25:23.005 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:23.001+0000 7fbfb3e9b700 1 -- 172.21.15.158:0/1263631737 wait complete. 2023-10-18T17:25:23.023 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:25:26.024 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:25:26.187 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.185+0000 7feff9df9700 1 Processor -- start 2023-10-18T17:25:26.187 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.185+0000 7feff9df9700 1 -- start start 2023-10-18T17:25:26.189 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff9df9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7feff41517c0 0x7feff406a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:26.192 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff9df9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff4154b00 con 0x7feff40630e0 2023-10-18T17:25:26.193 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff9df9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff4154f90 con 0x7feff41513e0 2023-10-18T17:25:26.193 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff9df9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff4069380 con 0x7feff41517c0 2023-10-18T17:25:26.194 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff8df7700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7feff41513e0 0x7feff4067d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:46778/0 (socket says 172.21.15.158:46778) 2023-10-18T17:25:26.194 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff8df7700 1 -- 172.21.15.158:0/2955173189 learned_addr learned my addr 172.21.15.158:0/2955173189 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:25:26.194 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff3fff700 1 --2- 172.21.15.158:0/2955173189 >> v2:172.21.15.183:3300/0 conn(0x7feff41517c0 0x7feff406a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:26.195 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff37fe700 1 -- 172.21.15.158:0/2955173189 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010237104 0 0) 0x7feff4154f90 con 0x7feff41513e0 2023-10-18T17:25:26.195 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff37fe700 1 -- 172.21.15.158:0/2955173189 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefe40033f0 con 0x7feff41513e0 2023-10-18T17:25:26.195 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff37fe700 1 -- 172.21.15.158:0/2955173189 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320269713 0 0) 0x7feff4154b00 con 0x7feff40630e0 2023-10-18T17:25:26.196 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff37fe700 1 -- 172.21.15.158:0/2955173189 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feff4154f90 con 0x7feff40630e0 2023-10-18T17:25:26.196 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff3fff700 1 -- 172.21.15.158:0/2955173189 >> v1:172.21.15.183:6789/0 conn(0x7feff41513e0 legacy=0x7feff4067d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:26.196 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff3fff700 1 -- 172.21.15.158:0/2955173189 >> v1:172.21.15.158:6789/0 conn(0x7feff40630e0 legacy=0x7feff4065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:26.197 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff3fff700 1 -- 172.21.15.158:0/2955173189 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff4068570 con 0x7feff41517c0 2023-10-18T17:25:26.197 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff3fff700 1 --2- 172.21.15.158:0/2955173189 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff41517c0 0x7feff406a040 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fefe0009760 tx=0x7fefe0009060).ready entity=mon.1 client_cookie=4720ec81e88c3323 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:26.198 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff37fe700 1 -- 172.21.15.158:0/2955173189 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe000d4a0 con 0x7feff41517c0 2023-10-18T17:25:26.198 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff37fe700 1 -- 172.21.15.158:0/2955173189 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe000d600 con 0x7feff41517c0 2023-10-18T17:25:26.198 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff37fe700 1 -- 172.21.15.158:0/2955173189 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe000d980 con 0x7feff41517c0 2023-10-18T17:25:26.199 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff9df9700 1 -- 172.21.15.158:0/2955173189 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff41517c0 msgr2=0x7feff406a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:26.199 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff9df9700 1 --2- 172.21.15.158:0/2955173189 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff41517c0 0x7feff406a040 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fefe0009760 tx=0x7fefe0009060).stop 2023-10-18T17:25:26.204 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff9df9700 1 -- 172.21.15.158:0/2955173189 shutdown_connections 2023-10-18T17:25:26.204 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff9df9700 1 --2- 172.21.15.158:0/2955173189 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff41517c0 0x7feff406a040 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:26.205 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff9df9700 1 -- 172.21.15.158:0/2955173189 >> 172.21.15.158:0/2955173189 conn(0x7feff4062ba0 msgr2=0x7feff40c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:26.205 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff9df9700 1 -- 172.21.15.158:0/2955173189 shutdown_connections 2023-10-18T17:25:26.206 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.189+0000 7feff9df9700 1 -- 172.21.15.158:0/2955173189 wait complete. 2023-10-18T17:25:26.206 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.193+0000 7feff9df9700 1 Processor -- start 2023-10-18T17:25:26.206 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.193+0000 7feff9df9700 1 -- start start 2023-10-18T17:25:26.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.193+0000 7feff9df9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff40630e0 0x7feff4157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:26.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.193+0000 7feff9df9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feff41513e0 0x7feff40bba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:26.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.193+0000 7feff9df9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff41517c0 0x7feff41554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:26.208 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.193+0000 7feff9df9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff4157e30 con 0x7feff41513e0 2023-10-18T17:25:26.208 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.193+0000 7feff9df9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff4168310 con 0x7feff41517c0 2023-10-18T17:25:26.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.193+0000 7feff9df9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff4167740 con 0x7feff40630e0 2023-10-18T17:25:26.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.193+0000 7feff3fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feff41513e0 0x7feff40bba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:26.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.193+0000 7feff3fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feff41513e0 0x7feff40bba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:49568/0 (socket says 172.21.15.158:49568) 2023-10-18T17:25:26.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.193+0000 7feff3fff700 1 -- 172.21.15.158:0/750873798 learned_addr learned my addr 172.21.15.158:0/750873798 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:26.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.193+0000 7feff8df7700 1 --2- 172.21.15.158:0/750873798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff40630e0 0x7feff4157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:26.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.193+0000 7feff95f8700 1 --2- 172.21.15.158:0/750873798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff41517c0 0x7feff41554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:26.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.197+0000 7feff3fff700 1 -- 172.21.15.158:0/750873798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff40630e0 msgr2=0x7feff4157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:26.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.197+0000 7feff3fff700 1 --2- 172.21.15.158:0/750873798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff40630e0 0x7feff4157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:26.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.197+0000 7feff3fff700 1 -- 172.21.15.158:0/750873798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff41517c0 msgr2=0x7feff41554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:26.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.197+0000 7feff3fff700 1 --2- 172.21.15.158:0/750873798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff41517c0 0x7feff41554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:26.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.197+0000 7feff3fff700 1 -- 172.21.15.158:0/750873798 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe00092a0 con 0x7feff41513e0 2023-10-18T17:25:26.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.197+0000 7feff3fff700 1 --2- 172.21.15.158:0/750873798 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feff41513e0 0x7feff40bba90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fefe0009d50 tx=0x7fefe0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:26.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.197+0000 7feff0ff9700 1 -- 172.21.15.158:0/750873798 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe000dcf0 con 0x7feff41513e0 2023-10-18T17:25:26.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.197+0000 7feff0ff9700 1 -- 172.21.15.158:0/750873798 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe000de50 con 0x7feff41513e0 2023-10-18T17:25:26.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.197+0000 7feff9df9700 1 -- 172.21.15.158:0/750873798 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff4158080 con 0x7feff41513e0 2023-10-18T17:25:26.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.197+0000 7feff0ff9700 1 -- 172.21.15.158:0/750873798 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe000d980 con 0x7feff41513e0 2023-10-18T17:25:26.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.197+0000 7feff9df9700 1 -- 172.21.15.158:0/750873798 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff4167cc0 con 0x7feff41513e0 2023-10-18T17:25:26.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.197+0000 7feff9df9700 1 -- 172.21.15.158:0/750873798 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff41684a0 con 0x7feff41513e0 2023-10-18T17:25:26.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.201+0000 7feff0ff9700 1 -- 172.21.15.158:0/750873798 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fefe001d640 con 0x7feff41513e0 2023-10-18T17:25:26.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.201+0000 7feff0ff9700 1 --2- 172.21.15.158:0/750873798 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fefd805a510 0x7fefd805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:26.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.201+0000 7feff0ff9700 1 -- 172.21.15.158:0/750873798 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6553+0+0 (secure 0 0 0) 0x7fefe0075fb0 con 0x7feff41513e0 2023-10-18T17:25:26.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.201+0000 7feff8df7700 1 --2- 172.21.15.158:0/750873798 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fefd805a510 0x7fefd805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:26.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.201+0000 7feff8df7700 1 --2- 172.21.15.158:0/750873798 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fefd805a510 0x7fefd805c9d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fefe8005750 tx=0x7fefe8009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:26.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.205+0000 7feff0ff9700 1 -- 172.21.15.158:0/750873798 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fefe00a4ac0 con 0x7feff41513e0 2023-10-18T17:25:26.401 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.397+0000 7feff9df9700 1 -- 172.21.15.158:0/750873798 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7feff4046f00 con 0x7feff41513e0 2023-10-18T17:25:26.402 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.401+0000 7feff0ff9700 1 -- 172.21.15.158:0/750873798 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fefe0049580 con 0x7feff41513e0 2023-10-18T17:25:26.402 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:25:26.406 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.405+0000 7feff9df9700 1 -- 172.21.15.158:0/750873798 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fefd805a510 msgr2=0x7fefd805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:26.407 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.405+0000 7feff9df9700 1 --2- 172.21.15.158:0/750873798 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fefd805a510 0x7fefd805c9d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fefe8005750 tx=0x7fefe8009040).stop 2023-10-18T17:25:26.407 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.405+0000 7feff9df9700 1 -- 172.21.15.158:0/750873798 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feff41513e0 msgr2=0x7feff40bba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:26.407 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.405+0000 7feff9df9700 1 --2- 172.21.15.158:0/750873798 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feff41513e0 0x7feff40bba90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fefe0009d50 tx=0x7fefe0016000).stop 2023-10-18T17:25:26.407 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.405+0000 7feff9df9700 1 -- 172.21.15.158:0/750873798 shutdown_connections 2023-10-18T17:25:26.408 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.405+0000 7feff9df9700 1 --2- 172.21.15.158:0/750873798 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fefd805a510 0x7fefd805c9d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:26.408 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.405+0000 7feff9df9700 1 --2- 172.21.15.158:0/750873798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff41517c0 0x7feff41554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:26.408 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.405+0000 7feff9df9700 1 --2- 172.21.15.158:0/750873798 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feff41513e0 0x7feff40bba90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:26.408 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.405+0000 7feff9df9700 1 --2- 172.21.15.158:0/750873798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff40630e0 0x7feff4157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:26.408 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.405+0000 7feff9df9700 1 -- 172.21.15.158:0/750873798 >> 172.21.15.158:0/750873798 conn(0x7feff4062ba0 msgr2=0x7feff40656e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:26.409 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.405+0000 7feff9df9700 1 -- 172.21.15.158:0/750873798 shutdown_connections 2023-10-18T17:25:26.409 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:26.405+0000 7feff9df9700 1 -- 172.21.15.158:0/750873798 wait complete. 2023-10-18T17:25:26.427 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:25:26.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~20s 2023-10-18T17:25:26.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~74s 2023-10-18T17:25:26.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2023-10-18T17:25:26.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~33s 2023-10-18T17:25:29.428 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:25:29.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.589+0000 7f11a7346700 1 Processor -- start 2023-10-18T17:25:29.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.589+0000 7f11a7346700 1 -- start start 2023-10-18T17:25:29.593 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.589+0000 7f11a7346700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11a0067ff0 0x7f11a00683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:29.593 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.589+0000 7f11a7346700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f11a0065e30 0x7f11a00bdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:29.593 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.589+0000 7f11a7346700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a0066900 con 0x7f11a00bca50 2023-10-18T17:25:29.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.589+0000 7f11a7346700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a0068a50 con 0x7f11a0065e30 2023-10-18T17:25:29.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.589+0000 7f11a7346700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a00659a0 con 0x7f11a0067ff0 2023-10-18T17:25:29.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.593+0000 7f11a58e3700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f11a00bca50 0x7f11a0150890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:56018/0 (socket says 172.21.15.158:56018) 2023-10-18T17:25:29.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.593+0000 7f11a58e3700 1 -- 172.21.15.158:0/3752350975 learned_addr learned my addr 172.21.15.158:0/3752350975 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:25:29.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.593+0000 7f11a50e2700 1 --2- 172.21.15.158:0/3752350975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11a0067ff0 0x7f11a00683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:29.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.593+0000 7f11a48e1700 1 --2- 172.21.15.158:0/3752350975 >> v2:172.21.15.158:3300/0 conn(0x7f11a0065e30 0x7f11a00bdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:29.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.593+0000 7f1197fff700 1 -- 172.21.15.158:0/3752350975 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365765456 0 0) 0x7f11a0066900 con 0x7f11a00bca50 2023-10-18T17:25:29.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.593+0000 7f1197fff700 1 -- 172.21.15.158:0/3752350975 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f118c0033f0 con 0x7f11a00bca50 2023-10-18T17:25:29.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.593+0000 7f11a50e2700 1 -- 172.21.15.158:0/3752350975 >> v2:172.21.15.158:3300/0 conn(0x7f11a0065e30 msgr2=0x7f11a00bdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:25:29.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.593+0000 7f11a50e2700 1 --2- 172.21.15.158:0/3752350975 >> v2:172.21.15.158:3300/0 conn(0x7f11a0065e30 0x7f11a00bdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:29.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.593+0000 7f11a50e2700 1 -- 172.21.15.158:0/3752350975 >> v1:172.21.15.158:6789/0 conn(0x7f11a00bca50 legacy=0x7f11a0150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:29.597 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.593+0000 7f11a50e2700 1 -- 172.21.15.158:0/3752350975 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a0066620 con 0x7f11a0067ff0 2023-10-18T17:25:29.597 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.593+0000 7f11a50e2700 1 --2- 172.21.15.158:0/3752350975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11a0067ff0 0x7f11a00683d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f119c009790 tx=0x7f119c009060).ready entity=mon.2 client_cookie=68cbbe908d6abb02 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:29.598 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.593+0000 7f1197fff700 1 -- 172.21.15.158:0/3752350975 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c00f510 con 0x7f11a0067ff0 2023-10-18T17:25:29.598 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.593+0000 7f1197fff700 1 -- 172.21.15.158:0/3752350975 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c00f670 con 0x7f11a0067ff0 2023-10-18T17:25:29.599 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.593+0000 7f1197fff700 1 -- 172.21.15.158:0/3752350975 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c00f9f0 con 0x7f11a0067ff0 2023-10-18T17:25:29.599 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.593+0000 7f11a7346700 1 -- 172.21.15.158:0/3752350975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11a0067ff0 msgr2=0x7f11a00683d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:29.599 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.593+0000 7f11a7346700 1 --2- 172.21.15.158:0/3752350975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11a0067ff0 0x7f11a00683d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f119c009790 tx=0x7f119c009060).stop 2023-10-18T17:25:29.599 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.597+0000 7f11a7346700 1 -- 172.21.15.158:0/3752350975 shutdown_connections 2023-10-18T17:25:29.599 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.597+0000 7f11a7346700 1 --2- 172.21.15.158:0/3752350975 >> v2:172.21.15.158:3300/0 conn(0x7f11a0065e30 0x7f11a00bdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:29.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.597+0000 7f11a7346700 1 --2- 172.21.15.158:0/3752350975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11a0067ff0 0x7f11a00683d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:29.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.597+0000 7f11a7346700 1 -- 172.21.15.158:0/3752350975 >> 172.21.15.158:0/3752350975 conn(0x7f11a00620d0 msgr2=0x7f11a00624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:29.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.597+0000 7f11a7346700 1 -- 172.21.15.158:0/3752350975 shutdown_connections 2023-10-18T17:25:29.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.597+0000 7f11a7346700 1 -- 172.21.15.158:0/3752350975 wait complete. 2023-10-18T17:25:29.601 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.597+0000 7f11a7346700 1 Processor -- start 2023-10-18T17:25:29.602 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a7346700 1 -- start start 2023-10-18T17:25:29.603 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a7346700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11a0065e30 0x7f11a00c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:29.604 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a7346700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11a0067ff0 0x7f11a00c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:29.604 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a7346700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11a00bca50 0x7f11a00ba6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:29.604 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a7346700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a00c1b80 con 0x7f11a00bca50 2023-10-18T17:25:29.604 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a7346700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a00c0620 con 0x7f11a0065e30 2023-10-18T17:25:29.605 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a7346700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a00bbda0 con 0x7f11a0067ff0 2023-10-18T17:25:29.605 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a58e3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11a00bca50 0x7f11a00ba6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:29.605 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a58e3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11a00bca50 0x7f11a00ba6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53016/0 (socket says 172.21.15.158:53016) 2023-10-18T17:25:29.605 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a58e3700 1 -- 172.21.15.158:0/3999265664 learned_addr learned my addr 172.21.15.158:0/3999265664 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:29.605 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a48e1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11a0067ff0 0x7f11a00c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:29.606 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a50e2700 1 --2- 172.21.15.158:0/3999265664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11a0065e30 0x7f11a00c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:29.607 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a58e3700 1 -- 172.21.15.158:0/3999265664 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11a0067ff0 msgr2=0x7f11a00c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:29.607 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a58e3700 1 --2- 172.21.15.158:0/3999265664 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11a0067ff0 0x7f11a00c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:29.608 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a58e3700 1 -- 172.21.15.158:0/3999265664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11a0065e30 msgr2=0x7f11a00c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:29.608 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a58e3700 1 --2- 172.21.15.158:0/3999265664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11a0065e30 0x7f11a00c0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:29.608 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a58e3700 1 -- 172.21.15.158:0/3999265664 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c0092a0 con 0x7f11a00bca50 2023-10-18T17:25:29.608 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a58e3700 1 --2- 172.21.15.158:0/3999265664 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11a00bca50 0x7f11a00ba6e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f119800c790 tx=0x7f1198007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:29.608 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11957fa700 1 -- 172.21.15.158:0/3999265664 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198005d30 con 0x7f11a00bca50 2023-10-18T17:25:29.609 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11957fa700 1 -- 172.21.15.158:0/3999265664 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1198005e90 con 0x7f11a00bca50 2023-10-18T17:25:29.609 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a7346700 1 -- 172.21.15.158:0/3999265664 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a00c1490 con 0x7f11a00bca50 2023-10-18T17:25:29.610 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11957fa700 1 -- 172.21.15.158:0/3999265664 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11980072e0 con 0x7f11a00bca50 2023-10-18T17:25:29.610 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.601+0000 7f11a7346700 1 -- 172.21.15.158:0/3999265664 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a00bc000 con 0x7f11a00bca50 2023-10-18T17:25:29.611 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.605+0000 7f11a7346700 1 -- 172.21.15.158:0/3999265664 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a00bc4d0 con 0x7f11a00bca50 2023-10-18T17:25:29.613 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.609+0000 7f11957fa700 1 -- 172.21.15.158:0/3999265664 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f11980076d0 con 0x7f11a00bca50 2023-10-18T17:25:29.613 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.609+0000 7f11957fa700 1 --2- 172.21.15.158:0/3999265664 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f118405a510 0x7f118405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:29.614 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.609+0000 7f11957fa700 1 -- 172.21.15.158:0/3999265664 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6553+0+0 (secure 0 0 0) 0x7f11980742c0 con 0x7f11a00bca50 2023-10-18T17:25:29.614 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.609+0000 7f11a50e2700 1 --2- 172.21.15.158:0/3999265664 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f118405a510 0x7f118405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:29.614 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.609+0000 7f11a50e2700 1 --2- 172.21.15.158:0/3999265664 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f118405a510 0x7f118405c9d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f119c00ffd0 tx=0x7f119c017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:29.617 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.613+0000 7f11957fa700 1 -- 172.21.15.158:0/3999265664 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f11980478f0 con 0x7f11a00bca50 2023-10-18T17:25:29.812 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.809+0000 7f11a7346700 1 -- 172.21.15.158:0/3999265664 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f11a006c190 con 0x7f11a00bca50 2023-10-18T17:25:29.813 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.809+0000 7f11957fa700 1 -- 172.21.15.158:0/3999265664 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f119804af10 con 0x7f11a00bca50 2023-10-18T17:25:29.813 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:25:29.815 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.813+0000 7f11a7346700 1 -- 172.21.15.158:0/3999265664 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f118405a510 msgr2=0x7f118405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:29.816 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.813+0000 7f11a7346700 1 --2- 172.21.15.158:0/3999265664 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f118405a510 0x7f118405c9d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f119c00ffd0 tx=0x7f119c017000).stop 2023-10-18T17:25:29.816 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.813+0000 7f11a7346700 1 -- 172.21.15.158:0/3999265664 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11a00bca50 msgr2=0x7f11a00ba6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:29.816 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.813+0000 7f11a7346700 1 --2- 172.21.15.158:0/3999265664 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11a00bca50 0x7f11a00ba6e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f119800c790 tx=0x7f1198007f90).stop 2023-10-18T17:25:29.817 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.813+0000 7f11a7346700 1 -- 172.21.15.158:0/3999265664 shutdown_connections 2023-10-18T17:25:29.817 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.813+0000 7f11a7346700 1 --2- 172.21.15.158:0/3999265664 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f118405a510 0x7f118405c9d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:29.818 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.813+0000 7f11a7346700 1 --2- 172.21.15.158:0/3999265664 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11a00bca50 0x7f11a00ba6e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:29.818 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.813+0000 7f11a7346700 1 --2- 172.21.15.158:0/3999265664 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11a0067ff0 0x7f11a00c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:29.818 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.813+0000 7f11a7346700 1 --2- 172.21.15.158:0/3999265664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11a0065e30 0x7f11a00c0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:29.819 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.813+0000 7f11a7346700 1 -- 172.21.15.158:0/3999265664 >> 172.21.15.158:0/3999265664 conn(0x7f11a00620d0 msgr2=0x7f11a014cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:29.819 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.813+0000 7f11a7346700 1 -- 172.21.15.158:0/3999265664 shutdown_connections 2023-10-18T17:25:29.819 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:29.813+0000 7f11a7346700 1 -- 172.21.15.158:0/3999265664 wait complete. 2023-10-18T17:25:29.835 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:25:32.837 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:25:32.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.988+0000 7feceb0e4700 1 Processor -- start 2023-10-18T17:25:32.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.988+0000 7feceb0e4700 1 -- start start 2023-10-18T17:25:32.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.992+0000 7feceb0e4700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fece4067d30 0x7fece40630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:32.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.992+0000 7feceb0e4700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece4068910 con 0x7fece414d170 2023-10-18T17:25:32.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.992+0000 7feceb0e4700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece4150780 con 0x7fece4068180 2023-10-18T17:25:32.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.992+0000 7feceb0e4700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece4150c10 con 0x7fece4067d30 2023-10-18T17:25:32.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.992+0000 7fecea0e2700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fece414d170 0x7fece406a150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:56034/0 (socket says 172.21.15.158:56034) 2023-10-18T17:25:32.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.992+0000 7fecea0e2700 1 -- 172.21.15.158:0/3354097563 learned_addr learned my addr 172.21.15.158:0/3354097563 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:25:32.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.992+0000 7fece98e1700 1 --2- 172.21.15.158:0/3354097563 >> v2:172.21.15.183:3300/0 conn(0x7fece4067d30 0x7fece40630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:32.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.992+0000 7fece90e0700 1 -- 172.21.15.158:0/3354097563 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975366036 0 0) 0x7fece4068910 con 0x7fece414d170 2023-10-18T17:25:32.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.992+0000 7fece90e0700 1 -- 172.21.15.158:0/3354097563 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecd00033f0 con 0x7fece414d170 2023-10-18T17:25:32.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.992+0000 7fece90e0700 1 -- 172.21.15.158:0/3354097563 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924352270 0 0) 0x7fece4150780 con 0x7fece4068180 2023-10-18T17:25:32.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.992+0000 7fece90e0700 1 -- 172.21.15.158:0/3354097563 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fece4068910 con 0x7fece4068180 2023-10-18T17:25:32.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.992+0000 7fece98e1700 1 -- 172.21.15.158:0/3354097563 >> v1:172.21.15.183:6789/0 conn(0x7fece4068180 legacy=0x7fece4065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:32.999 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.992+0000 7fece98e1700 1 -- 172.21.15.158:0/3354097563 >> v1:172.21.15.158:6789/0 conn(0x7fece414d170 legacy=0x7fece406a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:32.999 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.992+0000 7fece98e1700 1 -- 172.21.15.158:0/3354097563 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece4068630 con 0x7fece4067d30 2023-10-18T17:25:32.999 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.992+0000 7fece98e1700 1 --2- 172.21.15.158:0/3354097563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fece4067d30 0x7fece40630e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fecd4009760 tx=0x7fecd4009060).ready entity=mon.1 client_cookie=c76edacae0043b17 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:33.000 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.996+0000 7fece90e0700 1 -- 172.21.15.158:0/3354097563 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd400f510 con 0x7fece4067d30 2023-10-18T17:25:33.000 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.996+0000 7fece90e0700 1 -- 172.21.15.158:0/3354097563 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd400f670 con 0x7fece4067d30 2023-10-18T17:25:33.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.996+0000 7fece90e0700 1 -- 172.21.15.158:0/3354097563 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd400f9f0 con 0x7fece4067d30 2023-10-18T17:25:33.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.996+0000 7feceb0e4700 1 -- 172.21.15.158:0/3354097563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fece4067d30 msgr2=0x7fece40630e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:33.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.996+0000 7feceb0e4700 1 --2- 172.21.15.158:0/3354097563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fece4067d30 0x7fece40630e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fecd4009760 tx=0x7fecd4009060).stop 2023-10-18T17:25:33.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.996+0000 7feceb0e4700 1 -- 172.21.15.158:0/3354097563 shutdown_connections 2023-10-18T17:25:33.002 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.996+0000 7feceb0e4700 1 --2- 172.21.15.158:0/3354097563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fece4067d30 0x7fece40630e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:33.002 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.996+0000 7feceb0e4700 1 -- 172.21.15.158:0/3354097563 >> 172.21.15.158:0/3354097563 conn(0x7fece4062ba0 msgr2=0x7fece40c6330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:33.002 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.996+0000 7feceb0e4700 1 -- 172.21.15.158:0/3354097563 shutdown_connections 2023-10-18T17:25:33.002 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.996+0000 7feceb0e4700 1 -- 172.21.15.158:0/3354097563 wait complete. 2023-10-18T17:25:33.003 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.996+0000 7feceb0e4700 1 Processor -- start 2023-10-18T17:25:33.003 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:32.996+0000 7feceb0e4700 1 -- start start 2023-10-18T17:25:33.005 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7feceb0e4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fece4067d30 0x7fece41534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:33.005 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7feceb0e4700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fece4068180 0x7fece4151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:33.005 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7feceb0e4700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fece414d170 0x7fece4151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:33.005 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7feceb0e4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece4155670 con 0x7fece4067d30 2023-10-18T17:25:33.006 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7feceb0e4700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece4151b20 con 0x7fece414d170 2023-10-18T17:25:33.006 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7feceb0e4700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece4154780 con 0x7fece4068180 2023-10-18T17:25:33.006 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7fecea0e2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fece4067d30 0x7fece41534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:33.006 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7fecea0e2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fece4067d30 0x7fece41534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53026/0 (socket says 172.21.15.158:53026) 2023-10-18T17:25:33.006 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7fecea0e2700 1 -- 172.21.15.158:0/2981268476 learned_addr learned my addr 172.21.15.158:0/2981268476 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:33.007 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7fece98e1700 1 --2- 172.21.15.158:0/2981268476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fece4068180 0x7fece4151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:33.007 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7fecea8e3700 1 --2- 172.21.15.158:0/2981268476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fece414d170 0x7fece4151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:33.007 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7fecea0e2700 1 -- 172.21.15.158:0/2981268476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fece4068180 msgr2=0x7fece4151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:33.007 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7fecea0e2700 1 --2- 172.21.15.158:0/2981268476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fece4068180 0x7fece4151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:33.008 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7fecea0e2700 1 -- 172.21.15.158:0/2981268476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fece414d170 msgr2=0x7fece4151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:33.008 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7fecea0e2700 1 --2- 172.21.15.158:0/2981268476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fece414d170 0x7fece4151630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:33.008 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7fecea0e2700 1 -- 172.21.15.158:0/2981268476 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd40092a0 con 0x7fece4067d30 2023-10-18T17:25:33.008 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7fece98e1700 1 --2- 172.21.15.158:0/2981268476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fece4068180 0x7fece4151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:25:33.009 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7fecea0e2700 1 --2- 172.21.15.158:0/2981268476 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fece4067d30 0x7fece41534b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fece000c490 tx=0x7fece0007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:33.009 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7fecda7fc700 1 -- 172.21.15.158:0/2981268476 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece00070d0 con 0x7fece4067d30 2023-10-18T17:25:33.009 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7fecda7fc700 1 -- 172.21.15.158:0/2981268476 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece0007230 con 0x7fece4067d30 2023-10-18T17:25:33.010 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7feceb0e4700 1 -- 172.21.15.158:0/2981268476 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece4154a60 con 0x7fece4067d30 2023-10-18T17:25:33.010 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7fecda7fc700 1 -- 172.21.15.158:0/2981268476 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece00075b0 con 0x7fece4067d30 2023-10-18T17:25:33.010 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7feceb0e4700 1 -- 172.21.15.158:0/2981268476 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece4155020 con 0x7fece4067d30 2023-10-18T17:25:33.011 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.000+0000 7feceb0e4700 1 -- 172.21.15.158:0/2981268476 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece4046f00 con 0x7fece4067d30 2023-10-18T17:25:33.011 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.004+0000 7fecda7fc700 1 -- 172.21.15.158:0/2981268476 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fece00059b0 con 0x7fece4067d30 2023-10-18T17:25:33.012 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.004+0000 7fecda7fc700 1 --2- 172.21.15.158:0/2981268476 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fecc805a540 0x7fecc805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:33.012 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.004+0000 7fecda7fc700 1 -- 172.21.15.158:0/2981268476 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6553+0+0 (secure 0 0 0) 0x7fece0074110 con 0x7fece4067d30 2023-10-18T17:25:33.012 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.004+0000 7fece98e1700 1 --2- 172.21.15.158:0/2981268476 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fecc805a540 0x7fecc805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:33.012 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.004+0000 7fece98e1700 1 --2- 172.21.15.158:0/2981268476 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fecc805a540 0x7fecc805ca00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fecd4006e00 tx=0x7fecd4017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:33.015 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.012+0000 7fecda7fc700 1 -- 172.21.15.158:0/2981268476 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fece0047680 con 0x7fece4067d30 2023-10-18T17:25:33.116 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~26s 2023-10-18T17:25:33.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~81s 2023-10-18T17:25:33.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~7s 2023-10-18T17:25:33.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~40s 2023-10-18T17:25:33.205 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.200+0000 7feceb0e4700 1 -- 172.21.15.158:0/2981268476 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fece414fe50 con 0x7fece4067d30 2023-10-18T17:25:33.206 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.204+0000 7fecda7fc700 1 -- 172.21.15.158:0/2981268476 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fece0018070 con 0x7fece4067d30 2023-10-18T17:25:33.206 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:25:33.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.204+0000 7feceb0e4700 1 -- 172.21.15.158:0/2981268476 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fecc805a540 msgr2=0x7fecc805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:33.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.204+0000 7feceb0e4700 1 --2- 172.21.15.158:0/2981268476 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fecc805a540 0x7fecc805ca00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fecd4006e00 tx=0x7fecd4017000).stop 2023-10-18T17:25:33.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.204+0000 7feceb0e4700 1 -- 172.21.15.158:0/2981268476 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fece4067d30 msgr2=0x7fece41534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:33.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.204+0000 7feceb0e4700 1 --2- 172.21.15.158:0/2981268476 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fece4067d30 0x7fece41534b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fece000c490 tx=0x7fece0007d00).stop 2023-10-18T17:25:33.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.204+0000 7feceb0e4700 1 -- 172.21.15.158:0/2981268476 shutdown_connections 2023-10-18T17:25:33.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.204+0000 7feceb0e4700 1 --2- 172.21.15.158:0/2981268476 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fecc805a540 0x7fecc805ca00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:33.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.204+0000 7feceb0e4700 1 --2- 172.21.15.158:0/2981268476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fece414d170 0x7fece4151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:33.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.204+0000 7feceb0e4700 1 --2- 172.21.15.158:0/2981268476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fece4068180 0x7fece4151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:33.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.204+0000 7feceb0e4700 1 --2- 172.21.15.158:0/2981268476 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fece4067d30 0x7fece41534b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:33.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.204+0000 7feceb0e4700 1 -- 172.21.15.158:0/2981268476 >> 172.21.15.158:0/2981268476 conn(0x7fece4062ba0 msgr2=0x7fece414e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:33.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.204+0000 7feceb0e4700 1 -- 172.21.15.158:0/2981268476 shutdown_connections 2023-10-18T17:25:33.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:33.204+0000 7feceb0e4700 1 -- 172.21.15.158:0/2981268476 wait complete. 2023-10-18T17:25:33.228 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:25:33.993 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:25:34.001 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:25:35.551 INFO:tasks.ceph.mds.b.smithi183.stderr:terminate called after throwing an instance of 'boost::wrapexcept' 2023-10-18T17:25:35.551 INFO:tasks.ceph.mds.b.smithi183.stderr: what(): boost::bad_get: failed value get using boost::get 2023-10-18T17:25:35.551 INFO:tasks.ceph.mds.b.smithi183.stderr:*** Caught signal (Aborted) ** 2023-10-18T17:25:35.551 INFO:tasks.ceph.mds.b.smithi183.stderr: in thread 7f3f19359700 thread_name:ms_dispatch 2023-10-18T17:25:35.552 INFO:tasks.ceph.mds.b.smithi183.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:25:35.552 INFO:tasks.ceph.mds.b.smithi183.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f3f1e5b8420] 2023-10-18T17:25:35.552 INFO:tasks.ceph.mds.b.smithi183.stderr: 2: gsignal() 2023-10-18T17:25:35.553 INFO:tasks.ceph.mds.b.smithi183.stderr: 3: abort() 2023-10-18T17:25:35.553 INFO:tasks.ceph.mds.b.smithi183.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7f3f1e45a911] 2023-10-18T17:25:35.553 INFO:tasks.ceph.mds.b.smithi183.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7f3f1e46638c] 2023-10-18T17:25:35.553 INFO:tasks.ceph.mds.b.smithi183.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7f3f1e4663f7] 2023-10-18T17:25:35.553 INFO:tasks.ceph.mds.b.smithi183.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7f3f1e4666a9] 2023-10-18T17:25:35.554 INFO:tasks.ceph.mds.b.smithi183.stderr: 8: ceph-mds(+0x185107) [0x56072bf2c107] 2023-10-18T17:25:35.554 INFO:tasks.ceph.mds.b.smithi183.stderr: 9: ceph-mds(+0x18572d) [0x56072bf2c72d] 2023-10-18T17:25:35.554 INFO:tasks.ceph.mds.b.smithi183.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x56072bf9e09f] 2023-10-18T17:25:35.554 INFO:tasks.ceph.mds.b.smithi183.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x56072bf9fa95] 2023-10-18T17:25:35.554 INFO:tasks.ceph.mds.b.smithi183.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x56072bf6ab10] 2023-10-18T17:25:35.555 INFO:tasks.ceph.mds.b.smithi183.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x56072bf6eabf] 2023-10-18T17:25:35.555 INFO:tasks.ceph.mds.b.smithi183.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x56072bf6f456] 2023-10-18T17:25:35.555 INFO:tasks.ceph.mds.b.smithi183.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7f3f1eabe710] 2023-10-18T17:25:35.555 INFO:tasks.ceph.mds.b.smithi183.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7f3f1eabbfaf] 2023-10-18T17:25:35.555 INFO:tasks.ceph.mds.b.smithi183.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f1eb8ab21] 2023-10-18T17:25:35.556 INFO:tasks.ceph.mds.b.smithi183.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f3f1e5ac609] 2023-10-18T17:25:35.556 INFO:tasks.ceph.mds.b.smithi183.stderr: 19: clone() 2023-10-18T17:25:35.556 INFO:tasks.ceph.mds.b.smithi183.stderr:2023-10-18T17:25:35.548+0000 7f3f19359700 -1 *** Caught signal (Aborted) ** 2023-10-18T17:25:35.556 INFO:tasks.ceph.mds.b.smithi183.stderr: in thread 7f3f19359700 thread_name:ms_dispatch 2023-10-18T17:25:35.556 INFO:tasks.ceph.mds.b.smithi183.stderr: 2023-10-18T17:25:35.556 INFO:tasks.ceph.mds.b.smithi183.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:25:35.557 INFO:tasks.ceph.mds.b.smithi183.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f3f1e5b8420] 2023-10-18T17:25:35.557 INFO:tasks.ceph.mds.b.smithi183.stderr: 2: gsignal() 2023-10-18T17:25:35.557 INFO:tasks.ceph.mds.b.smithi183.stderr: 3: abort() 2023-10-18T17:25:35.557 INFO:tasks.ceph.mds.b.smithi183.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7f3f1e45a911] 2023-10-18T17:25:35.557 INFO:tasks.ceph.mds.b.smithi183.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7f3f1e46638c] 2023-10-18T17:25:35.558 INFO:tasks.ceph.mds.b.smithi183.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7f3f1e4663f7] 2023-10-18T17:25:35.558 INFO:tasks.ceph.mds.b.smithi183.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7f3f1e4666a9] 2023-10-18T17:25:35.558 INFO:tasks.ceph.mds.b.smithi183.stderr: 8: ceph-mds(+0x185107) [0x56072bf2c107] 2023-10-18T17:25:35.558 INFO:tasks.ceph.mds.b.smithi183.stderr: 9: ceph-mds(+0x18572d) [0x56072bf2c72d] 2023-10-18T17:25:35.558 INFO:tasks.ceph.mds.b.smithi183.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x56072bf9e09f] 2023-10-18T17:25:35.559 INFO:tasks.ceph.mds.b.smithi183.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x56072bf9fa95] 2023-10-18T17:25:35.559 INFO:tasks.ceph.mds.b.smithi183.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x56072bf6ab10] 2023-10-18T17:25:35.559 INFO:tasks.ceph.mds.b.smithi183.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x56072bf6eabf] 2023-10-18T17:25:35.559 INFO:tasks.ceph.mds.b.smithi183.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x56072bf6f456] 2023-10-18T17:25:35.559 INFO:tasks.ceph.mds.b.smithi183.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7f3f1eabe710] 2023-10-18T17:25:35.560 INFO:tasks.ceph.mds.b.smithi183.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7f3f1eabbfaf] 2023-10-18T17:25:35.560 INFO:tasks.ceph.mds.b.smithi183.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f1eb8ab21] 2023-10-18T17:25:35.560 INFO:tasks.ceph.mds.b.smithi183.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f3f1e5ac609] 2023-10-18T17:25:35.560 INFO:tasks.ceph.mds.b.smithi183.stderr: 19: clone() 2023-10-18T17:25:35.560 INFO:tasks.ceph.mds.b.smithi183.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T17:25:35.560 INFO:tasks.ceph.mds.b.smithi183.stderr: 2023-10-18T17:25:35.561 INFO:tasks.ceph.mds.b.smithi183.stderr: 0> 2023-10-18T17:25:35.548+0000 7f3f19359700 -1 *** Caught signal (Aborted) ** 2023-10-18T17:25:35.561 INFO:tasks.ceph.mds.b.smithi183.stderr: in thread 7f3f19359700 thread_name:ms_dispatch 2023-10-18T17:25:35.561 INFO:tasks.ceph.mds.b.smithi183.stderr: 2023-10-18T17:25:35.562 INFO:tasks.ceph.mds.b.smithi183.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:25:35.562 INFO:tasks.ceph.mds.b.smithi183.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f3f1e5b8420] 2023-10-18T17:25:35.562 INFO:tasks.ceph.mds.b.smithi183.stderr: 2: gsignal() 2023-10-18T17:25:35.562 INFO:tasks.ceph.mds.b.smithi183.stderr: 3: abort() 2023-10-18T17:25:35.563 INFO:tasks.ceph.mds.b.smithi183.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7f3f1e45a911] 2023-10-18T17:25:35.563 INFO:tasks.ceph.mds.b.smithi183.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7f3f1e46638c] 2023-10-18T17:25:35.563 INFO:tasks.ceph.mds.b.smithi183.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7f3f1e4663f7] 2023-10-18T17:25:35.563 INFO:tasks.ceph.mds.b.smithi183.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7f3f1e4666a9] 2023-10-18T17:25:35.563 INFO:tasks.ceph.mds.b.smithi183.stderr: 8: ceph-mds(+0x185107) [0x56072bf2c107] 2023-10-18T17:25:35.563 INFO:tasks.ceph.mds.b.smithi183.stderr: 9: ceph-mds(+0x18572d) [0x56072bf2c72d] 2023-10-18T17:25:35.564 INFO:tasks.ceph.mds.b.smithi183.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x56072bf9e09f] 2023-10-18T17:25:35.564 INFO:tasks.ceph.mds.b.smithi183.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x56072bf9fa95] 2023-10-18T17:25:35.564 INFO:tasks.ceph.mds.b.smithi183.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x56072bf6ab10] 2023-10-18T17:25:35.564 INFO:tasks.ceph.mds.b.smithi183.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x56072bf6eabf] 2023-10-18T17:25:35.564 INFO:tasks.ceph.mds.b.smithi183.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x56072bf6f456] 2023-10-18T17:25:35.566 INFO:tasks.ceph.mds.b.smithi183.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7f3f1eabe710] 2023-10-18T17:25:35.566 INFO:tasks.ceph.mds.b.smithi183.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7f3f1eabbfaf] 2023-10-18T17:25:35.566 INFO:tasks.ceph.mds.b.smithi183.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f1eb8ab21] 2023-10-18T17:25:35.567 INFO:tasks.ceph.mds.b.smithi183.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f3f1e5ac609] 2023-10-18T17:25:35.567 INFO:tasks.ceph.mds.b.smithi183.stderr: 19: clone() 2023-10-18T17:25:35.567 INFO:tasks.ceph.mds.b.smithi183.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T17:25:35.567 INFO:tasks.ceph.mds.b.smithi183.stderr: 2023-10-18T17:25:35.567 INFO:tasks.ceph.mds.b.smithi183.stderr: 0> 2023-10-18T17:25:35.548+0000 7f3f19359700 -1 *** Caught signal (Aborted) ** 2023-10-18T17:25:35.567 INFO:tasks.ceph.mds.b.smithi183.stderr: in thread 7f3f19359700 thread_name:ms_dispatch 2023-10-18T17:25:35.568 INFO:tasks.ceph.mds.b.smithi183.stderr: 2023-10-18T17:25:35.568 INFO:tasks.ceph.mds.b.smithi183.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:25:35.568 INFO:tasks.ceph.mds.b.smithi183.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f3f1e5b8420] 2023-10-18T17:25:35.568 INFO:tasks.ceph.mds.b.smithi183.stderr: 2: gsignal() 2023-10-18T17:25:35.568 INFO:tasks.ceph.mds.b.smithi183.stderr: 3: abort() 2023-10-18T17:25:35.569 INFO:tasks.ceph.mds.b.smithi183.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7f3f1e45a911] 2023-10-18T17:25:35.569 INFO:tasks.ceph.mds.b.smithi183.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7f3f1e46638c] 2023-10-18T17:25:35.569 INFO:tasks.ceph.mds.b.smithi183.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7f3f1e4663f7] 2023-10-18T17:25:35.569 INFO:tasks.ceph.mds.b.smithi183.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7f3f1e4666a9] 2023-10-18T17:25:35.569 INFO:tasks.ceph.mds.b.smithi183.stderr: 8: ceph-mds(+0x185107) [0x56072bf2c107] 2023-10-18T17:25:35.569 INFO:tasks.ceph.mds.b.smithi183.stderr: 9: ceph-mds(+0x18572d) [0x56072bf2c72d] 2023-10-18T17:25:35.570 INFO:tasks.ceph.mds.b.smithi183.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x56072bf9e09f] 2023-10-18T17:25:35.570 INFO:tasks.ceph.mds.b.smithi183.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x56072bf9fa95] 2023-10-18T17:25:35.570 INFO:tasks.ceph.mds.b.smithi183.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x56072bf6ab10] 2023-10-18T17:25:35.570 INFO:tasks.ceph.mds.b.smithi183.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x56072bf6eabf] 2023-10-18T17:25:35.570 INFO:tasks.ceph.mds.b.smithi183.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x56072bf6f456] 2023-10-18T17:25:35.571 INFO:tasks.ceph.mds.b.smithi183.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7f3f1eabe710] 2023-10-18T17:25:35.571 INFO:tasks.ceph.mds.b.smithi183.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7f3f1eabbfaf] 2023-10-18T17:25:35.571 INFO:tasks.ceph.mds.b.smithi183.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f1eb8ab21] 2023-10-18T17:25:35.571 INFO:tasks.ceph.mds.b.smithi183.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f3f1e5ac609] 2023-10-18T17:25:35.571 INFO:tasks.ceph.mds.b.smithi183.stderr: 19: clone() 2023-10-18T17:25:35.572 INFO:tasks.ceph.mds.b.smithi183.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T17:25:35.572 INFO:tasks.ceph.mds.b.smithi183.stderr: 2023-10-18T17:25:35.728 INFO:tasks.ceph.mds.b.smithi183.stderr:daemon-helper: command crashed with signal 6 2023-10-18T17:25:36.229 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:25:36.399 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.396+0000 7f173ec9b700 1 Processor -- start 2023-10-18T17:25:36.399 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.396+0000 7f173ec9b700 1 -- start start 2023-10-18T17:25:36.401 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.396+0000 7f173ec9b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17380666b0 0x7f17380bd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:36.401 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.396+0000 7f173ec9b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1738065cd0 con 0x7f1738067ff0 2023-10-18T17:25:36.401 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.396+0000 7f173ec9b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1738154750 con 0x7f17380bde20 2023-10-18T17:25:36.402 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.396+0000 7f173ec9b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1738066160 con 0x7f17380666b0 2023-10-18T17:25:36.403 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f173d238700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f17380bde20 0x7f1738151410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:38544/0 (socket says 172.21.15.158:38544) 2023-10-18T17:25:36.403 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f173d238700 1 -- 172.21.15.158:0/677484108 learned_addr learned my addr 172.21.15.158:0/677484108 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:25:36.403 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f173ca37700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f1738067ff0 0x7f17380683d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:56042/0 (socket says 172.21.15.158:56042) 2023-10-18T17:25:36.404 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f1737fff700 1 --2- 172.21.15.158:0/677484108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17380666b0 0x7f17380bd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:36.404 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f17377fe700 1 -- 172.21.15.158:0/677484108 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742876932 0 0) 0x7f1738154750 con 0x7f17380bde20 2023-10-18T17:25:36.404 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f17377fe700 1 -- 172.21.15.158:0/677484108 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17280033f0 con 0x7f17380bde20 2023-10-18T17:25:36.404 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f17377fe700 1 -- 172.21.15.158:0/677484108 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348481577 0 0) 0x7f1738065cd0 con 0x7f1738067ff0 2023-10-18T17:25:36.404 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f17377fe700 1 -- 172.21.15.158:0/677484108 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1738154750 con 0x7f1738067ff0 2023-10-18T17:25:36.405 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f17377fe700 1 -- 172.21.15.158:0/677484108 <== mon.0 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1110499933 0 0) 0x7f1738154750 con 0x7f1738067ff0 2023-10-18T17:25:36.405 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f1737fff700 1 -- 172.21.15.158:0/677484108 >> v1:172.21.15.183:6789/0 conn(0x7f17380bde20 legacy=0x7f1738151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:36.405 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f1737fff700 1 -- 172.21.15.158:0/677484108 >> v1:172.21.15.158:6789/0 conn(0x7f1738067ff0 legacy=0x7f17380683d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:36.405 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f1737fff700 1 -- 172.21.15.158:0/677484108 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1738065100 con 0x7f17380666b0 2023-10-18T17:25:36.406 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f1737fff700 1 --2- 172.21.15.158:0/677484108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17380666b0 0x7f17380bd930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f1724009790 tx=0x7f1724009060).ready entity=mon.2 client_cookie=b740295b4db8901c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:36.407 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f17377fe700 1 -- 172.21.15.158:0/677484108 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c001470 con 0x7f17380666b0 2023-10-18T17:25:36.407 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f17377fe700 1 -- 172.21.15.158:0/677484108 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1724011400 con 0x7f17380666b0 2023-10-18T17:25:36.407 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f17377fe700 1 -- 172.21.15.158:0/677484108 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724011780 con 0x7f17380666b0 2023-10-18T17:25:36.407 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f173ec9b700 1 -- 172.21.15.158:0/677484108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17380666b0 msgr2=0x7f17380bd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:36.408 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f173ec9b700 1 --2- 172.21.15.158:0/677484108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17380666b0 0x7f17380bd930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f1724009790 tx=0x7f1724009060).stop 2023-10-18T17:25:36.408 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f173ec9b700 1 -- 172.21.15.158:0/677484108 shutdown_connections 2023-10-18T17:25:36.408 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f173ec9b700 1 --2- 172.21.15.158:0/677484108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17380666b0 0x7f17380bd930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:36.408 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f173ec9b700 1 -- 172.21.15.158:0/677484108 >> 172.21.15.158:0/677484108 conn(0x7f17380620d0 msgr2=0x7f17380624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:36.408 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.400+0000 7f173ec9b700 1 -- 172.21.15.158:0/677484108 shutdown_connections 2023-10-18T17:25:36.408 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.404+0000 7f173ec9b700 1 -- 172.21.15.158:0/677484108 wait complete. 2023-10-18T17:25:36.411 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.404+0000 7f173ec9b700 1 Processor -- start 2023-10-18T17:25:36.411 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.404+0000 7f173ec9b700 1 -- start start 2023-10-18T17:25:36.411 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.404+0000 7f173ec9b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17380666b0 0x7f173814c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:36.412 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.404+0000 7f173ec9b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1738067ff0 0x7f173814ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:36.412 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.404+0000 7f173ec9b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17380bde20 0x7f173814d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:36.412 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.404+0000 7f173ec9b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17380c2d50 con 0x7f1738067ff0 2023-10-18T17:25:36.412 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.404+0000 7f173ec9b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17380c21a0 con 0x7f17380bde20 2023-10-18T17:25:36.412 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.404+0000 7f173ec9b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173814c5f0 con 0x7f17380666b0 2023-10-18T17:25:36.413 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.404+0000 7f1737fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1738067ff0 0x7f173814ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:36.413 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.408+0000 7f173ca37700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17380666b0 0x7f173814c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:36.413 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.408+0000 7f1737fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1738067ff0 0x7f173814ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53036/0 (socket says 172.21.15.158:53036) 2023-10-18T17:25:36.413 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.408+0000 7f1737fff700 1 -- 172.21.15.158:0/4095051147 learned_addr learned my addr 172.21.15.158:0/4095051147 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:36.413 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.408+0000 7f173d238700 1 --2- 172.21.15.158:0/4095051147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17380bde20 0x7f173814d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:36.414 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.408+0000 7f1737fff700 1 -- 172.21.15.158:0/4095051147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17380666b0 msgr2=0x7f173814c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:36.414 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.408+0000 7f1737fff700 1 --2- 172.21.15.158:0/4095051147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17380666b0 0x7f173814c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:36.414 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.408+0000 7f1737fff700 1 -- 172.21.15.158:0/4095051147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17380bde20 msgr2=0x7f173814d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:36.414 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.408+0000 7f1737fff700 1 --2- 172.21.15.158:0/4095051147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17380bde20 0x7f173814d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:36.414 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.408+0000 7f1737fff700 1 -- 172.21.15.158:0/4095051147 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17240092a0 con 0x7f1738067ff0 2023-10-18T17:25:36.415 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.408+0000 7f1737fff700 1 --2- 172.21.15.158:0/4095051147 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1738067ff0 0x7f173814ccc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f1738064ac0 tx=0x7f1724016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:36.415 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.408+0000 7f1734ff9700 1 -- 172.21.15.158:0/4095051147 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724010740 con 0x7f1738067ff0 2023-10-18T17:25:36.415 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.408+0000 7f1734ff9700 1 -- 172.21.15.158:0/4095051147 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17240108a0 con 0x7f1738067ff0 2023-10-18T17:25:36.415 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.408+0000 7f1734ff9700 1 -- 172.21.15.158:0/4095051147 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724010c60 con 0x7f1738067ff0 2023-10-18T17:25:36.415 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.408+0000 7f173ec9b700 1 -- 172.21.15.158:0/4095051147 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17380b6d50 con 0x7f1738067ff0 2023-10-18T17:25:36.416 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.408+0000 7f173ec9b700 1 -- 172.21.15.158:0/4095051147 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17380c2690 con 0x7f1738067ff0 2023-10-18T17:25:36.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.408+0000 7f173ec9b700 1 -- 172.21.15.158:0/4095051147 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17380c2e90 con 0x7f1738067ff0 2023-10-18T17:25:36.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.412+0000 7f1734ff9700 1 -- 172.21.15.158:0/4095051147 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f17240263b0 con 0x7f1738067ff0 2023-10-18T17:25:36.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.412+0000 7f1734ff9700 1 --2- 172.21.15.158:0/4095051147 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f171c05a510 0x7f171c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:36.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.412+0000 7f1734ff9700 1 -- 172.21.15.158:0/4095051147 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6639+0+0 (secure 0 0 0) 0x7f17240755a0 con 0x7f1738067ff0 2023-10-18T17:25:36.418 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.412+0000 7f173ca37700 1 --2- 172.21.15.158:0/4095051147 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f171c05a510 0x7f171c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:36.418 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.416+0000 7f173ca37700 1 --2- 172.21.15.158:0/4095051147 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f171c05a510 0x7f171c05c9d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f172c0011e0 tx=0x7f172c001560).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:36.424 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.420+0000 7f1734ff9700 1 -- 172.21.15.158:0/4095051147 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f17380c2e90 con 0x7f1738067ff0 2023-10-18T17:25:36.615 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.612+0000 7f173ec9b700 1 -- 172.21.15.158:0/4095051147 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f17380c2e90 con 0x7f1738067ff0 2023-10-18T17:25:36.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.612+0000 7f1734ff9700 1 -- 172.21.15.158:0/4095051147 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f17240220e0 con 0x7f1738067ff0 2023-10-18T17:25:36.616 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:25:36.620 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.616+0000 7f173ec9b700 1 -- 172.21.15.158:0/4095051147 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f171c05a510 msgr2=0x7f171c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:36.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.616+0000 7f173ec9b700 1 --2- 172.21.15.158:0/4095051147 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f171c05a510 0x7f171c05c9d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f172c0011e0 tx=0x7f172c001560).stop 2023-10-18T17:25:36.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.616+0000 7f173ec9b700 1 -- 172.21.15.158:0/4095051147 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1738067ff0 msgr2=0x7f173814ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:36.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.616+0000 7f173ec9b700 1 --2- 172.21.15.158:0/4095051147 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1738067ff0 0x7f173814ccc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f1738064ac0 tx=0x7f1724016000).stop 2023-10-18T17:25:36.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.616+0000 7f173ec9b700 1 -- 172.21.15.158:0/4095051147 shutdown_connections 2023-10-18T17:25:36.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.616+0000 7f173ec9b700 1 --2- 172.21.15.158:0/4095051147 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f171c05a510 0x7f171c05c9d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:36.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.616+0000 7f173ec9b700 1 --2- 172.21.15.158:0/4095051147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17380bde20 0x7f173814d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:36.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.616+0000 7f173ec9b700 1 --2- 172.21.15.158:0/4095051147 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1738067ff0 0x7f173814ccc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:36.623 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.616+0000 7f173ec9b700 1 --2- 172.21.15.158:0/4095051147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17380666b0 0x7f173814c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:36.623 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.616+0000 7f173ec9b700 1 -- 172.21.15.158:0/4095051147 >> 172.21.15.158:0/4095051147 conn(0x7f17380620d0 msgr2=0x7f1738155720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:36.623 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.616+0000 7f173ec9b700 1 -- 172.21.15.158:0/4095051147 shutdown_connections 2023-10-18T17:25:36.624 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:36.616+0000 7f173ec9b700 1 -- 172.21.15.158:0/4095051147 wait complete. 2023-10-18T17:25:36.641 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:25:39.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~33s 2023-10-18T17:25:39.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~87s 2023-10-18T17:25:39.530 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~13s 2023-10-18T17:25:39.530 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-18T17:25:39.530 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~46s 2023-10-18T17:25:39.642 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:25:39.802 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.800+0000 7fdb54a79700 1 Processor -- start 2023-10-18T17:25:39.803 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.800+0000 7fdb54a79700 1 -- start start 2023-10-18T17:25:39.805 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.800+0000 7fdb54a79700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb501513e0 0x7fdb50067d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:39.806 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb54a79700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdb500630e0 0x7fdb50065700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:39.806 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb54a79700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb50154b00 con 0x7fdb501517c0 2023-10-18T17:25:39.807 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb54a79700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb50069380 con 0x7fdb500630e0 2023-10-18T17:25:39.807 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb54a79700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5006a750 con 0x7fdb501513e0 2023-10-18T17:25:39.808 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb4effd700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fdb501517c0 0x7fdb5006a040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:37716/0 (socket says 172.21.15.158:37716) 2023-10-18T17:25:39.808 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb4effd700 1 -- 172.21.15.158:0/1279057429 learned_addr learned my addr 172.21.15.158:0/1279057429 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:25:39.808 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb4f7fe700 1 --2- 172.21.15.158:0/1279057429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb501513e0 0x7fdb50067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:39.808 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb4ffff700 1 --2- 172.21.15.158:0/1279057429 >> v2:172.21.15.183:3300/0 conn(0x7fdb500630e0 0x7fdb50065700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:39.809 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb4e7fc700 1 -- 172.21.15.158:0/1279057429 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826554710 0 0) 0x7fdb50154b00 con 0x7fdb501517c0 2023-10-18T17:25:39.809 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb4e7fc700 1 -- 172.21.15.158:0/1279057429 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb380033f0 con 0x7fdb501517c0 2023-10-18T17:25:39.809 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb4f7fe700 1 -- 172.21.15.158:0/1279057429 >> v2:172.21.15.183:3300/0 conn(0x7fdb500630e0 msgr2=0x7fdb50065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:25:39.809 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb4f7fe700 1 --2- 172.21.15.158:0/1279057429 >> v2:172.21.15.183:3300/0 conn(0x7fdb500630e0 0x7fdb50065700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:39.809 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb4f7fe700 1 -- 172.21.15.158:0/1279057429 >> v1:172.21.15.158:6789/0 conn(0x7fdb501517c0 legacy=0x7fdb5006a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:39.809 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb4e7fc700 1 -- 172.21.15.158:0/1279057429 <== mon.0 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2782368310 0 0) 0x7fdb380033f0 con 0x7fdb501517c0 2023-10-18T17:25:39.810 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb4f7fe700 1 -- 172.21.15.158:0/1279057429 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb50154f90 con 0x7fdb501513e0 2023-10-18T17:25:39.811 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb4f7fe700 1 --2- 172.21.15.158:0/1279057429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb501513e0 0x7fdb50067d30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fdb40009760 tx=0x7fdb40009060).ready entity=mon.2 client_cookie=49e5390c2874f3dd server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:39.811 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb4e7fc700 1 -- 172.21.15.158:0/1279057429 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44001470 con 0x7fdb501513e0 2023-10-18T17:25:39.811 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb4e7fc700 1 -- 172.21.15.158:0/1279057429 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb40011400 con 0x7fdb501513e0 2023-10-18T17:25:39.811 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb4e7fc700 1 -- 172.21.15.158:0/1279057429 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40011780 con 0x7fdb501513e0 2023-10-18T17:25:39.812 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb54a79700 1 -- 172.21.15.158:0/1279057429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb501513e0 msgr2=0x7fdb50067d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:39.812 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.804+0000 7fdb54a79700 1 --2- 172.21.15.158:0/1279057429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb501513e0 0x7fdb50067d30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fdb40009760 tx=0x7fdb40009060).stop 2023-10-18T17:25:39.812 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.808+0000 7fdb54a79700 1 -- 172.21.15.158:0/1279057429 shutdown_connections 2023-10-18T17:25:39.812 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.808+0000 7fdb54a79700 1 --2- 172.21.15.158:0/1279057429 >> v2:172.21.15.183:3300/0 conn(0x7fdb500630e0 0x7fdb50065700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:39.812 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.808+0000 7fdb54a79700 1 --2- 172.21.15.158:0/1279057429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb501513e0 0x7fdb50067d30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:39.813 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.808+0000 7fdb54a79700 1 -- 172.21.15.158:0/1279057429 >> 172.21.15.158:0/1279057429 conn(0x7fdb50062ba0 msgr2=0x7fdb500c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:39.813 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.808+0000 7fdb54a79700 1 -- 172.21.15.158:0/1279057429 shutdown_connections 2023-10-18T17:25:39.813 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.808+0000 7fdb54a79700 1 -- 172.21.15.158:0/1279057429 wait complete. 2023-10-18T17:25:39.815 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.808+0000 7fdb54a79700 1 Processor -- start 2023-10-18T17:25:39.815 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.808+0000 7fdb54a79700 1 -- start start 2023-10-18T17:25:39.815 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb54a79700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb500630e0 0x7fdb500a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:39.815 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb54a79700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb501513e0 0x7fdb50159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:39.816 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb54a79700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdb501517c0 0x7fdb50159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:39.816 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb54a79700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5015ad50 con 0x7fdb501517c0 2023-10-18T17:25:39.816 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb54a79700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5015a2f0 con 0x7fdb500630e0 2023-10-18T17:25:39.816 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb54a79700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb500a1ef0 con 0x7fdb501513e0 2023-10-18T17:25:39.816 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb4f7fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb500630e0 0x7fdb500a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:39.816 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb4ffff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdb501517c0 0x7fdb50159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:39.817 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb4f7fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb500630e0 0x7fdb500a1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:49550/0 (socket says 172.21.15.158:49550) 2023-10-18T17:25:39.817 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb4f7fe700 1 -- 172.21.15.158:0/4176958651 learned_addr learned my addr 172.21.15.158:0/4176958651 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:39.817 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb4effd700 1 --2- 172.21.15.158:0/4176958651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb501513e0 0x7fdb50159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:39.817 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb4ffff700 1 -- 172.21.15.158:0/4176958651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb501513e0 msgr2=0x7fdb50159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:39.817 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb4ffff700 1 --2- 172.21.15.158:0/4176958651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb501513e0 0x7fdb50159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:39.818 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb4ffff700 1 -- 172.21.15.158:0/4176958651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb500630e0 msgr2=0x7fdb500a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:39.818 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb4ffff700 1 --2- 172.21.15.158:0/4176958651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb500630e0 0x7fdb500a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:39.818 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb4ffff700 1 -- 172.21.15.158:0/4176958651 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb400092a0 con 0x7fdb501517c0 2023-10-18T17:25:39.818 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb4f7fe700 1 --2- 172.21.15.158:0/4176958651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb500630e0 0x7fdb500a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:25:39.819 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb4ffff700 1 --2- 172.21.15.158:0/4176958651 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdb501517c0 0x7fdb50159e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fdb48009e80 tx=0x7fdb4800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:39.819 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb377fe700 1 -- 172.21.15.158:0/4176958651 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48009bb0 con 0x7fdb501517c0 2023-10-18T17:25:39.820 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb377fe700 1 -- 172.21.15.158:0/4176958651 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4800f040 con 0x7fdb501517c0 2023-10-18T17:25:39.820 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb54a79700 1 -- 172.21.15.158:0/4176958651 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb5015aa50 con 0x7fdb501517c0 2023-10-18T17:25:39.820 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb377fe700 1 -- 172.21.15.158:0/4176958651 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4800ccb0 con 0x7fdb501517c0 2023-10-18T17:25:39.820 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.812+0000 7fdb54a79700 1 -- 172.21.15.158:0/4176958651 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb500a08f0 con 0x7fdb501517c0 2023-10-18T17:25:39.820 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.816+0000 7fdb54a79700 1 -- 172.21.15.158:0/4176958651 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5015af00 con 0x7fdb501517c0 2023-10-18T17:25:39.821 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.816+0000 7fdb377fe700 1 -- 172.21.15.158:0/4176958651 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdb4801d460 con 0x7fdb501517c0 2023-10-18T17:25:39.821 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.816+0000 7fdb377fe700 1 --2- 172.21.15.158:0/4176958651 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fdb3c05a510 0x7fdb3c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:39.821 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.816+0000 7fdb377fe700 1 -- 172.21.15.158:0/4176958651 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6639+0+0 (secure 0 0 0) 0x7fdb48075170 con 0x7fdb501517c0 2023-10-18T17:25:39.822 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.816+0000 7fdb4f7fe700 1 --2- 172.21.15.158:0/4176958651 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fdb3c05a510 0x7fdb3c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:39.822 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.820+0000 7fdb4f7fe700 1 --2- 172.21.15.158:0/4176958651 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fdb3c05a510 0x7fdb3c05c9d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fdb40011fd0 tx=0x7fdb40016000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:39.827 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:39.824+0000 7fdb377fe700 1 -- 172.21.15.158:0/4176958651 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fdb5015af00 con 0x7fdb501517c0 2023-10-18T17:25:40.019 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:40.016+0000 7fdb54a79700 1 -- 172.21.15.158:0/4176958651 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdb5015ae90 con 0x7fdb501517c0 2023-10-18T17:25:40.019 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:40.016+0000 7fdb377fe700 1 -- 172.21.15.158:0/4176958651 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fdb4804c060 con 0x7fdb501517c0 2023-10-18T17:25:40.020 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:25:40.022 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:40.020+0000 7fdb54a79700 1 -- 172.21.15.158:0/4176958651 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fdb3c05a510 msgr2=0x7fdb3c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:40.022 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:40.020+0000 7fdb54a79700 1 --2- 172.21.15.158:0/4176958651 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fdb3c05a510 0x7fdb3c05c9d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fdb40011fd0 tx=0x7fdb40016000).stop 2023-10-18T17:25:40.022 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:40.020+0000 7fdb54a79700 1 -- 172.21.15.158:0/4176958651 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdb501517c0 msgr2=0x7fdb50159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:40.022 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:40.020+0000 7fdb54a79700 1 --2- 172.21.15.158:0/4176958651 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdb501517c0 0x7fdb50159e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fdb48009e80 tx=0x7fdb4800b040).stop 2023-10-18T17:25:40.023 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:40.020+0000 7fdb54a79700 1 -- 172.21.15.158:0/4176958651 shutdown_connections 2023-10-18T17:25:40.023 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:40.020+0000 7fdb54a79700 1 --2- 172.21.15.158:0/4176958651 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fdb3c05a510 0x7fdb3c05c9d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:40.023 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:40.020+0000 7fdb54a79700 1 --2- 172.21.15.158:0/4176958651 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdb501517c0 0x7fdb50159e00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:40.023 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:40.020+0000 7fdb54a79700 1 --2- 172.21.15.158:0/4176958651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb501513e0 0x7fdb50159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:40.023 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:40.020+0000 7fdb54a79700 1 --2- 172.21.15.158:0/4176958651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb500630e0 0x7fdb500a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:40.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:40.020+0000 7fdb54a79700 1 -- 172.21.15.158:0/4176958651 >> 172.21.15.158:0/4176958651 conn(0x7fdb50062ba0 msgr2=0x7fdb500656e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:40.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:40.020+0000 7fdb54a79700 1 -- 172.21.15.158:0/4176958651 shutdown_connections 2023-10-18T17:25:40.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:40.020+0000 7fdb54a79700 1 -- 172.21.15.158:0/4176958651 wait complete. 2023-10-18T17:25:40.044 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:25:43.045 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:25:43.202 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.200+0000 7f031e839700 1 Processor -- start 2023-10-18T17:25:43.202 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.200+0000 7f031e839700 1 -- start start 2023-10-18T17:25:43.203 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.200+0000 7f031e839700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f03181517c0 0x7f031806a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:43.204 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.200+0000 7f031e839700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03180630e0 0x7f0318065700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:43.204 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.200+0000 7f031e839700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0318154b00 con 0x7f03181513e0 2023-10-18T17:25:43.204 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.200+0000 7f031e839700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0318069380 con 0x7f03181517c0 2023-10-18T17:25:43.204 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.200+0000 7f031e839700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0318154f90 con 0x7f03180630e0 2023-10-18T17:25:43.206 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.200+0000 7f031d036700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f03181517c0 0x7f031806a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:43.206 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.200+0000 7f031d837700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f03181513e0 0x7f0318067d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:44104/0 (socket says 172.21.15.158:44104) 2023-10-18T17:25:43.206 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.200+0000 7f031d837700 1 -- 172.21.15.158:0/233544342 learned_addr learned my addr 172.21.15.158:0/233544342 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:25:43.206 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.200+0000 7f031e038700 1 --2- 172.21.15.158:0/233544342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03180630e0 0x7f0318065700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:43.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.200+0000 7f031c835700 1 -- 172.21.15.158:0/233544342 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2472977904 0 0) 0x7f0318154b00 con 0x7f03181513e0 2023-10-18T17:25:43.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.200+0000 7f031c835700 1 -- 172.21.15.158:0/233544342 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03040033f0 con 0x7f03181513e0 2023-10-18T17:25:43.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.200+0000 7f031e038700 1 -- 172.21.15.158:0/233544342 >> v2:172.21.15.183:3300/0 conn(0x7f03181517c0 msgr2=0x7f031806a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:25:43.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.200+0000 7f031e038700 1 --2- 172.21.15.158:0/233544342 >> v2:172.21.15.183:3300/0 conn(0x7f03181517c0 0x7f031806a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:43.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.200+0000 7f031e038700 1 -- 172.21.15.158:0/233544342 >> v1:172.21.15.183:6789/0 conn(0x7f03181513e0 legacy=0x7f0318067d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:43.208 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.200+0000 7f031e038700 1 -- 172.21.15.158:0/233544342 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0318068570 con 0x7f03180630e0 2023-10-18T17:25:43.208 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.200+0000 7f031d036700 1 --2- 172.21.15.158:0/233544342 >> v2:172.21.15.183:3300/0 conn(0x7f03181517c0 0x7f031806a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:25:43.208 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.204+0000 7f031e038700 1 --2- 172.21.15.158:0/233544342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03180630e0 0x7f0318065700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f0310009760 tx=0x7f0310009060).ready entity=mon.2 client_cookie=c819afd77c6b7889 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:43.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.204+0000 7f031c835700 1 -- 172.21.15.158:0/233544342 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031000d4a0 con 0x7f03180630e0 2023-10-18T17:25:43.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.204+0000 7f031c835700 1 -- 172.21.15.158:0/233544342 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031000d600 con 0x7f03180630e0 2023-10-18T17:25:43.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.204+0000 7f031c835700 1 -- 172.21.15.158:0/233544342 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031000d980 con 0x7f03180630e0 2023-10-18T17:25:43.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.204+0000 7f031e839700 1 -- 172.21.15.158:0/233544342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03180630e0 msgr2=0x7f0318065700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:43.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.204+0000 7f031e839700 1 --2- 172.21.15.158:0/233544342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03180630e0 0x7f0318065700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f0310009760 tx=0x7f0310009060).stop 2023-10-18T17:25:43.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.204+0000 7f031e839700 1 -- 172.21.15.158:0/233544342 shutdown_connections 2023-10-18T17:25:43.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.204+0000 7f031e839700 1 --2- 172.21.15.158:0/233544342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03180630e0 0x7f0318065700 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:43.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.204+0000 7f031e839700 1 --2- 172.21.15.158:0/233544342 >> v2:172.21.15.183:3300/0 conn(0x7f03181517c0 0x7f031806a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:43.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.204+0000 7f031e839700 1 -- 172.21.15.158:0/233544342 >> 172.21.15.158:0/233544342 conn(0x7f0318062ba0 msgr2=0x7f03180c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:43.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.204+0000 7f031e839700 1 -- 172.21.15.158:0/233544342 shutdown_connections 2023-10-18T17:25:43.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.204+0000 7f031e839700 1 -- 172.21.15.158:0/233544342 wait complete. 2023-10-18T17:25:43.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.208+0000 7f031e839700 1 Processor -- start 2023-10-18T17:25:43.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.208+0000 7f031e839700 1 -- start start 2023-10-18T17:25:43.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.208+0000 7f031e839700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03180630e0 0x7f031814dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:43.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.208+0000 7f031e839700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03181513e0 0x7f03180c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:43.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.208+0000 7f031e839700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03181517c0 0x7f03180c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:43.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.208+0000 7f031e839700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03180c1970 con 0x7f03180630e0 2023-10-18T17:25:43.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.208+0000 7f031e839700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031814f320 con 0x7f03181517c0 2023-10-18T17:25:43.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.208+0000 7f031e839700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03180c2990 con 0x7f03181513e0 2023-10-18T17:25:43.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.208+0000 7f031d837700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03180630e0 0x7f031814dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:43.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.208+0000 7f031d837700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03180630e0 0x7f031814dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:49814/0 (socket says 172.21.15.158:49814) 2023-10-18T17:25:43.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.208+0000 7f031d837700 1 -- 172.21.15.158:0/537096617 learned_addr learned my addr 172.21.15.158:0/537096617 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:43.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.208+0000 7f031d036700 1 --2- 172.21.15.158:0/537096617 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03181513e0 0x7f03180c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:43.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.208+0000 7f031e038700 1 --2- 172.21.15.158:0/537096617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03181517c0 0x7f03180c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:43.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.212+0000 7f031d837700 1 -- 172.21.15.158:0/537096617 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03181513e0 msgr2=0x7f03180c1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:43.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.212+0000 7f031d837700 1 --2- 172.21.15.158:0/537096617 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03181513e0 0x7f03180c1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:43.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.212+0000 7f031d837700 1 -- 172.21.15.158:0/537096617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03181517c0 msgr2=0x7f03180c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:43.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.212+0000 7f031d837700 1 --2- 172.21.15.158:0/537096617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03181517c0 0x7f03180c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:43.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.212+0000 7f031d837700 1 -- 172.21.15.158:0/537096617 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03080092a0 con 0x7f03180630e0 2023-10-18T17:25:43.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.212+0000 7f031d837700 1 --2- 172.21.15.158:0/537096617 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03180630e0 0x7f031814dc80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f031400c820 tx=0x7f0314001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:43.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.212+0000 7f030dffb700 1 -- 172.21.15.158:0/537096617 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0314005d30 con 0x7f03180630e0 2023-10-18T17:25:43.218 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.212+0000 7f030dffb700 1 -- 172.21.15.158:0/537096617 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0314005e90 con 0x7f03180630e0 2023-10-18T17:25:43.218 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.212+0000 7f030dffb700 1 -- 172.21.15.158:0/537096617 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0314007340 con 0x7f03180630e0 2023-10-18T17:25:43.218 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.212+0000 7f031e839700 1 -- 172.21.15.158:0/537096617 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03100092a0 con 0x7f03180630e0 2023-10-18T17:25:43.218 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.212+0000 7f031e839700 1 -- 172.21.15.158:0/537096617 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f031814e670 con 0x7f03180630e0 2023-10-18T17:25:43.219 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.212+0000 7f031e839700 1 -- 172.21.15.158:0/537096617 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0318046f00 con 0x7f03180630e0 2023-10-18T17:25:43.219 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.216+0000 7f030dffb700 1 -- 172.21.15.158:0/537096617 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f03140076f0 con 0x7f03180630e0 2023-10-18T17:25:43.220 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.216+0000 7f030dffb700 1 --2- 172.21.15.158:0/537096617 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f02fc05a510 0x7f02fc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:43.220 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.216+0000 7f030dffb700 1 -- 172.21.15.158:0/537096617 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6639+0+0 (secure 0 0 0) 0x7f0314074a50 con 0x7f03180630e0 2023-10-18T17:25:43.220 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.216+0000 7f031d036700 1 --2- 172.21.15.158:0/537096617 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f02fc05a510 0x7f02fc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:43.221 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.216+0000 7f031d036700 1 --2- 172.21.15.158:0/537096617 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f02fc05a510 0x7f02fc05c9d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f03180be7e0 tx=0x7f0308009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:43.226 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.224+0000 7f030dffb700 1 -- 172.21.15.158:0/537096617 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f0314047f70 con 0x7f03180630e0 2023-10-18T17:25:43.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.412+0000 7f031e839700 1 -- 172.21.15.158:0/537096617 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f03181541d0 con 0x7f03180630e0 2023-10-18T17:25:43.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.412+0000 7f030dffb700 1 -- 172.21.15.158:0/537096617 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f03140079a0 con 0x7f03180630e0 2023-10-18T17:25:43.418 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:25:43.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.416+0000 7f031e839700 1 -- 172.21.15.158:0/537096617 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f02fc05a510 msgr2=0x7f02fc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:43.421 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.416+0000 7f031e839700 1 --2- 172.21.15.158:0/537096617 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f02fc05a510 0x7f02fc05c9d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f03180be7e0 tx=0x7f0308009060).stop 2023-10-18T17:25:43.421 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.416+0000 7f031e839700 1 -- 172.21.15.158:0/537096617 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03180630e0 msgr2=0x7f031814dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:43.421 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.416+0000 7f031e839700 1 --2- 172.21.15.158:0/537096617 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03180630e0 0x7f031814dc80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f031400c820 tx=0x7f0314001650).stop 2023-10-18T17:25:43.421 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.416+0000 7f031e839700 1 -- 172.21.15.158:0/537096617 shutdown_connections 2023-10-18T17:25:43.422 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.416+0000 7f031e839700 1 --2- 172.21.15.158:0/537096617 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f02fc05a510 0x7f02fc05c9d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:43.422 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.416+0000 7f031e839700 1 --2- 172.21.15.158:0/537096617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03181517c0 0x7f03180c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:43.422 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.416+0000 7f031e839700 1 --2- 172.21.15.158:0/537096617 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03181513e0 0x7f03180c1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:43.422 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.416+0000 7f031e839700 1 --2- 172.21.15.158:0/537096617 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f03180630e0 0x7f031814dc80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:43.422 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.416+0000 7f031e839700 1 -- 172.21.15.158:0/537096617 >> 172.21.15.158:0/537096617 conn(0x7f0318062ba0 msgr2=0x7f03180bdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:43.422 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.416+0000 7f031e839700 1 -- 172.21.15.158:0/537096617 shutdown_connections 2023-10-18T17:25:43.423 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:43.416+0000 7f031e839700 1 -- 172.21.15.158:0/537096617 wait complete. 2023-10-18T17:25:43.439 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:25:45.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~39s 2023-10-18T17:25:45.941 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~94s 2023-10-18T17:25:45.941 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~19s 2023-10-18T17:25:45.941 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~6s 2023-10-18T17:25:45.941 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~53s 2023-10-18T17:25:46.441 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:25:46.602 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.600+0000 7f5a92907700 1 Processor -- start 2023-10-18T17:25:46.603 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.600+0000 7f5a92907700 1 -- start start 2023-10-18T17:25:46.606 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a92907700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5a8c1513e0 0x7f5a8c067d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:46.606 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a92907700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8c154b00 con 0x7f5a8c1517c0 2023-10-18T17:25:46.607 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a92907700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8c06a750 con 0x7f5a8c0630e0 2023-10-18T17:25:46.607 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a92907700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8c069380 con 0x7f5a8c1513e0 2023-10-18T17:25:46.607 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a91104700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f5a8c1517c0 0x7f5a8c06a040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:37718/0 (socket says 172.21.15.158:37718) 2023-10-18T17:25:46.607 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a91104700 1 -- 172.21.15.158:0/699616637 learned_addr learned my addr 172.21.15.158:0/699616637 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:25:46.607 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a92106700 1 --1- 172.21.15.158:0/699616637 >> v1:172.21.15.183:6789/0 conn(0x7f5a8c0630e0 0x7f5a8c065700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:44118/0 (socket says 172.21.15.158:44118) 2023-10-18T17:25:46.608 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a91905700 1 --2- 172.21.15.158:0/699616637 >> v2:172.21.15.158:3300/0 conn(0x7f5a8c1513e0 0x7f5a8c067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:46.609 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a90903700 1 -- 172.21.15.158:0/699616637 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286174718 0 0) 0x7f5a8c06a750 con 0x7f5a8c0630e0 2023-10-18T17:25:46.609 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a90903700 1 -- 172.21.15.158:0/699616637 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a780033f0 con 0x7f5a8c0630e0 2023-10-18T17:25:46.610 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a90903700 1 -- 172.21.15.158:0/699616637 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397970505 0 0) 0x7f5a8c154b00 con 0x7f5a8c1517c0 2023-10-18T17:25:46.610 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a90903700 1 -- 172.21.15.158:0/699616637 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a8c06a750 con 0x7f5a8c1517c0 2023-10-18T17:25:46.610 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a91905700 1 -- 172.21.15.158:0/699616637 >> v1:172.21.15.183:6789/0 conn(0x7f5a8c0630e0 legacy=0x7f5a8c065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:46.610 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a91905700 1 -- 172.21.15.158:0/699616637 >> v1:172.21.15.158:6789/0 conn(0x7f5a8c1517c0 legacy=0x7f5a8c06a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:46.610 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a91905700 1 -- 172.21.15.158:0/699616637 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c154f90 con 0x7f5a8c1513e0 2023-10-18T17:25:46.611 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a91905700 1 --2- 172.21.15.158:0/699616637 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a8c1513e0 0x7f5a8c067d30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f5a88009760 tx=0x7f5a88009060).ready entity=mon.0 client_cookie=3abc4660d270ba96 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:46.611 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a90903700 1 -- 172.21.15.158:0/699616637 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8800f510 con 0x7f5a8c1513e0 2023-10-18T17:25:46.611 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a90903700 1 -- 172.21.15.158:0/699616637 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8800f670 con 0x7f5a8c1513e0 2023-10-18T17:25:46.611 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a90903700 1 -- 172.21.15.158:0/699616637 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8800f9f0 con 0x7f5a8c1513e0 2023-10-18T17:25:46.611 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a92907700 1 -- 172.21.15.158:0/699616637 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a8c1513e0 msgr2=0x7f5a8c067d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:46.612 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a92907700 1 --2- 172.21.15.158:0/699616637 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a8c1513e0 0x7f5a8c067d30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f5a88009760 tx=0x7f5a88009060).stop 2023-10-18T17:25:46.612 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a92907700 1 -- 172.21.15.158:0/699616637 shutdown_connections 2023-10-18T17:25:46.612 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a92907700 1 --2- 172.21.15.158:0/699616637 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a8c1513e0 0x7f5a8c067d30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:46.612 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.604+0000 7f5a92907700 1 -- 172.21.15.158:0/699616637 >> 172.21.15.158:0/699616637 conn(0x7f5a8c062ba0 msgr2=0x7f5a8c0c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:46.615 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.608+0000 7f5a92907700 1 -- 172.21.15.158:0/699616637 shutdown_connections 2023-10-18T17:25:46.615 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.608+0000 7f5a92907700 1 -- 172.21.15.158:0/699616637 wait complete. 2023-10-18T17:25:46.615 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.608+0000 7f5a92907700 1 Processor -- start 2023-10-18T17:25:46.615 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.608+0000 7f5a92907700 1 -- start start 2023-10-18T17:25:46.615 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.608+0000 7f5a92907700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a8c0630e0 0x7f5a8c165010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:46.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.608+0000 7f5a92907700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a8c1513e0 0x7f5a8c1584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:46.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.608+0000 7f5a92907700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a8c1517c0 0x7f5a8c0c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:46.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.608+0000 7f5a92907700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c165500 con 0x7f5a8c1517c0 2023-10-18T17:25:46.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.608+0000 7f5a92907700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c157a10 con 0x7f5a8c0630e0 2023-10-18T17:25:46.616 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.608+0000 7f5a92907700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c14c040 con 0x7f5a8c1513e0 2023-10-18T17:25:46.617 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.608+0000 7f5a91905700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a8c0630e0 0x7f5a8c165010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:46.617 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.608+0000 7f5a91905700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a8c0630e0 0x7f5a8c165010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:49578/0 (socket says 172.21.15.158:49578) 2023-10-18T17:25:46.617 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.608+0000 7f5a91905700 1 -- 172.21.15.158:0/1319435513 learned_addr learned my addr 172.21.15.158:0/1319435513 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:46.617 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.608+0000 7f5a92106700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a8c1517c0 0x7f5a8c0c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:46.617 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.608+0000 7f5a91104700 1 --2- 172.21.15.158:0/1319435513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a8c1513e0 0x7f5a8c1584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:46.618 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.608+0000 7f5a91905700 1 -- 172.21.15.158:0/1319435513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a8c1513e0 msgr2=0x7f5a8c1584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:46.618 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.608+0000 7f5a91905700 1 --2- 172.21.15.158:0/1319435513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a8c1513e0 0x7f5a8c1584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:46.618 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.608+0000 7f5a91905700 1 -- 172.21.15.158:0/1319435513 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a8c1517c0 msgr2=0x7f5a8c0c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:46.618 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.608+0000 7f5a91905700 1 --2- 172.21.15.158:0/1319435513 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a8c1517c0 0x7f5a8c0c20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:46.618 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.612+0000 7f5a91905700 1 -- 172.21.15.158:0/1319435513 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a880092a0 con 0x7f5a8c0630e0 2023-10-18T17:25:46.619 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.612+0000 7f5a91104700 1 --2- 172.21.15.158:0/1319435513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a8c1513e0 0x7f5a8c1584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:25:46.620 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.612+0000 7f5a91905700 1 --2- 172.21.15.158:0/1319435513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a8c0630e0 0x7f5a8c165010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f5a8c067180 tx=0x7f5a88017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:46.620 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.612+0000 7f5a81ffb700 1 -- 172.21.15.158:0/1319435513 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a88011550 con 0x7f5a8c0630e0 2023-10-18T17:25:46.620 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.612+0000 7f5a81ffb700 1 -- 172.21.15.158:0/1319435513 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8801e070 con 0x7f5a8c0630e0 2023-10-18T17:25:46.620 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.612+0000 7f5a81ffb700 1 -- 172.21.15.158:0/1319435513 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a880118c0 con 0x7f5a8c0630e0 2023-10-18T17:25:46.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.612+0000 7f5a92907700 1 -- 172.21.15.158:0/1319435513 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8c14c320 con 0x7f5a8c0630e0 2023-10-18T17:25:46.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.612+0000 7f5a92907700 1 -- 172.21.15.158:0/1319435513 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8c157cd0 con 0x7f5a8c0630e0 2023-10-18T17:25:46.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.612+0000 7f5a92907700 1 -- 172.21.15.158:0/1319435513 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8c046f00 con 0x7f5a8c0630e0 2023-10-18T17:25:46.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.616+0000 7f5a81ffb700 1 -- 172.21.15.158:0/1319435513 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5a88020030 con 0x7f5a8c0630e0 2023-10-18T17:25:46.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.616+0000 7f5a81ffb700 1 --2- 172.21.15.158:0/1319435513 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f5a7005a4e0 0x7f5a7005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:46.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.616+0000 7f5a81ffb700 1 -- 172.21.15.158:0/1319435513 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6639+0+0 (secure 0 0 0) 0x7f5a880752e0 con 0x7f5a8c0630e0 2023-10-18T17:25:46.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.616+0000 7f5a91104700 1 --2- 172.21.15.158:0/1319435513 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f5a7005a4e0 0x7f5a7005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:46.623 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.616+0000 7f5a91104700 1 --2- 172.21.15.158:0/1319435513 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f5a7005a4e0 0x7f5a7005c9a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f5a7c007fd0 tx=0x7f5a7c009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:46.628 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.624+0000 7f5a81ffb700 1 -- 172.21.15.158:0/1319435513 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f5a88048800 con 0x7f5a8c0630e0 2023-10-18T17:25:46.829 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.824+0000 7f5a92907700 1 -- 172.21.15.158:0/1319435513 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5a8c068570 con 0x7f5a8c0630e0 2023-10-18T17:25:46.829 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.824+0000 7f5a81ffb700 1 -- 172.21.15.158:0/1319435513 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f5a88029080 con 0x7f5a8c0630e0 2023-10-18T17:25:46.830 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:25:46.834 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.832+0000 7f5a92907700 1 -- 172.21.15.158:0/1319435513 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f5a7005a4e0 msgr2=0x7f5a7005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:46.834 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.832+0000 7f5a92907700 1 --2- 172.21.15.158:0/1319435513 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f5a7005a4e0 0x7f5a7005c9a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f5a7c007fd0 tx=0x7f5a7c009040).stop 2023-10-18T17:25:46.834 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.832+0000 7f5a92907700 1 -- 172.21.15.158:0/1319435513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a8c0630e0 msgr2=0x7f5a8c165010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:46.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.832+0000 7f5a92907700 1 --2- 172.21.15.158:0/1319435513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a8c0630e0 0x7f5a8c165010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f5a8c067180 tx=0x7f5a88017000).stop 2023-10-18T17:25:46.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.832+0000 7f5a92907700 1 -- 172.21.15.158:0/1319435513 shutdown_connections 2023-10-18T17:25:46.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.832+0000 7f5a92907700 1 --2- 172.21.15.158:0/1319435513 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f5a7005a4e0 0x7f5a7005c9a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:46.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.832+0000 7f5a92907700 1 --2- 172.21.15.158:0/1319435513 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a8c1517c0 0x7f5a8c0c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:46.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.832+0000 7f5a92907700 1 --2- 172.21.15.158:0/1319435513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a8c1513e0 0x7f5a8c1584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:46.836 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.832+0000 7f5a92907700 1 --2- 172.21.15.158:0/1319435513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a8c0630e0 0x7f5a8c165010 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:46.836 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.832+0000 7f5a92907700 1 -- 172.21.15.158:0/1319435513 >> 172.21.15.158:0/1319435513 conn(0x7f5a8c062ba0 msgr2=0x7f5a8c156cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:46.836 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.832+0000 7f5a92907700 1 -- 172.21.15.158:0/1319435513 shutdown_connections 2023-10-18T17:25:46.836 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:46.832+0000 7f5a92907700 1 -- 172.21.15.158:0/1319435513 wait complete. 2023-10-18T17:25:46.854 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:25:49.855 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:25:50.013 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.008+0000 7f4f254db700 1 Processor -- start 2023-10-18T17:25:50.013 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.008+0000 7f4f254db700 1 -- start start 2023-10-18T17:25:50.014 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.012+0000 7f4f254db700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f2014b1d0 0x7f4f2014e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:50.015 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.012+0000 7f4f254db700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4f2014b5b0 0x7f4f200bcd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:50.015 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.012+0000 7f4f254db700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2014dd30 con 0x7f4f200bf8d0 2023-10-18T17:25:50.015 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.012+0000 7f4f254db700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f20062430 con 0x7f4f2014b5b0 2023-10-18T17:25:50.015 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.012+0000 7f4f254db700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f20062710 con 0x7f4f2014b1d0 2023-10-18T17:25:50.017 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.012+0000 7f4f1e7fc700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4f2014b5b0 0x7f4f200bcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:50.017 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.012+0000 7f4f1e7fc700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4f2014b5b0 0x7f4f200bcd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:52118/0 (socket says 172.21.15.158:52118) 2023-10-18T17:25:50.017 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.012+0000 7f4f1e7fc700 1 -- 172.21.15.158:0/2968012416 learned_addr learned my addr 172.21.15.158:0/2968012416 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:50.018 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.012+0000 7f4f1effd700 1 --2- 172.21.15.158:0/2968012416 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f2014b1d0 0x7f4f2014e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:50.018 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.012+0000 7f4f1e7fc700 1 -- 172.21.15.158:0/2968012416 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f2014b1d0 msgr2=0x7f4f2014e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:25:50.018 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.012+0000 7f4f1e7fc700 1 --2- 172.21.15.158:0/2968012416 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f2014b1d0 0x7f4f2014e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:50.018 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.012+0000 7f4f1e7fc700 1 -- 172.21.15.158:0/2968012416 >> v1:172.21.15.183:6789/0 conn(0x7f4f200bf8d0 legacy=0x7f4f20151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:50.018 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.012+0000 7f4f1e7fc700 1 -- 172.21.15.158:0/2968012416 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f200629f0 con 0x7f4f2014b5b0 2023-10-18T17:25:50.019 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.012+0000 7f4f1e7fc700 1 --2- 172.21.15.158:0/2968012416 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f2014b5b0 0x7f4f200bcd70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f4f14009810 tx=0x7f4f14009060).ready entity=mon.0 client_cookie=339c7516fb2555e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:50.019 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.012+0000 7f4f1dffb700 1 -- 172.21.15.158:0/2968012416 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f14005880 con 0x7f4f2014b5b0 2023-10-18T17:25:50.019 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.012+0000 7f4f1dffb700 1 -- 172.21.15.158:0/2968012416 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f140059e0 con 0x7f4f2014b5b0 2023-10-18T17:25:50.019 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.012+0000 7f4f1dffb700 1 -- 172.21.15.158:0/2968012416 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f14005d60 con 0x7f4f2014b5b0 2023-10-18T17:25:50.020 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.016+0000 7f4f254db700 1 -- 172.21.15.158:0/2968012416 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f2014b5b0 msgr2=0x7f4f200bcd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:50.020 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.016+0000 7f4f254db700 1 --2- 172.21.15.158:0/2968012416 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f2014b5b0 0x7f4f200bcd70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f4f14009810 tx=0x7f4f14009060).stop 2023-10-18T17:25:50.020 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.016+0000 7f4f254db700 1 -- 172.21.15.158:0/2968012416 shutdown_connections 2023-10-18T17:25:50.020 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.016+0000 7f4f254db700 1 --2- 172.21.15.158:0/2968012416 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f2014b5b0 0x7f4f200bcd70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:50.021 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.016+0000 7f4f254db700 1 --2- 172.21.15.158:0/2968012416 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f2014b1d0 0x7f4f2014e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:50.021 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.016+0000 7f4f254db700 1 -- 172.21.15.158:0/2968012416 >> 172.21.15.158:0/2968012416 conn(0x7f4f200699e0 msgr2=0x7f4f20069df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:50.021 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.016+0000 7f4f254db700 1 -- 172.21.15.158:0/2968012416 shutdown_connections 2023-10-18T17:25:50.021 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.016+0000 7f4f254db700 1 -- 172.21.15.158:0/2968012416 wait complete. 2023-10-18T17:25:50.023 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.016+0000 7f4f254db700 1 Processor -- start 2023-10-18T17:25:50.023 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.016+0000 7f4f254db700 1 -- start start 2023-10-18T17:25:50.023 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f254db700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f200bf8d0 0x7f4f200b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:50.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f254db700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f2014b1d0 0x7f4f20163e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:50.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f254db700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f20163520 0x7f4f200c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:50.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f254db700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f200b76b0 con 0x7f4f200bf8d0 2023-10-18T17:25:50.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f254db700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f200b5640 con 0x7f4f2014b1d0 2023-10-18T17:25:50.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f254db700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f200b5920 con 0x7f4f20163520 2023-10-18T17:25:50.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f1effd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f200bf8d0 0x7f4f200b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:50.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f1e7fc700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f2014b1d0 0x7f4f20163e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:50.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f1e7fc700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f2014b1d0 0x7f4f20163e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:36026/0 (socket says 172.21.15.158:36026) 2023-10-18T17:25:50.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f1e7fc700 1 -- 172.21.15.158:0/3395819631 learned_addr learned my addr 172.21.15.158:0/3395819631 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:50.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f1ffff700 1 --2- 172.21.15.158:0/3395819631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f20163520 0x7f4f200c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:50.026 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f1e7fc700 1 -- 172.21.15.158:0/3395819631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f20163520 msgr2=0x7f4f200c2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:50.026 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f1e7fc700 1 --2- 172.21.15.158:0/3395819631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f20163520 0x7f4f200c2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:50.026 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f1e7fc700 1 -- 172.21.15.158:0/3395819631 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f200bf8d0 msgr2=0x7f4f200b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:50.026 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f1e7fc700 1 --2- 172.21.15.158:0/3395819631 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f200bf8d0 0x7f4f200b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:50.026 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f1e7fc700 1 -- 172.21.15.158:0/3395819631 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f14009300 con 0x7f4f2014b1d0 2023-10-18T17:25:50.027 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f1e7fc700 1 --2- 172.21.15.158:0/3395819631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f2014b1d0 0x7f4f20163e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f4f200689e0 tx=0x7f4f14016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:50.028 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f06ffd700 1 -- 172.21.15.158:0/3395819631 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1400b580 con 0x7f4f2014b1d0 2023-10-18T17:25:50.029 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f06ffd700 1 -- 172.21.15.158:0/3395819631 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1400b6e0 con 0x7f4f2014b1d0 2023-10-18T17:25:50.029 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f254db700 1 -- 172.21.15.158:0/3395819631 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f200b5c00 con 0x7f4f2014b1d0 2023-10-18T17:25:50.029 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f06ffd700 1 -- 172.21.15.158:0/3395819631 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1400ba80 con 0x7f4f2014b1d0 2023-10-18T17:25:50.030 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f254db700 1 -- 172.21.15.158:0/3395819631 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f200b7950 con 0x7f4f2014b1d0 2023-10-18T17:25:50.030 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.020+0000 7f4f254db700 1 -- 172.21.15.158:0/3395819631 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f200b7b70 con 0x7f4f2014b1d0 2023-10-18T17:25:50.030 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.024+0000 7f4f06ffd700 1 -- 172.21.15.158:0/3395819631 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4f14026670 con 0x7f4f2014b1d0 2023-10-18T17:25:50.030 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.024+0000 7f4f06ffd700 1 --2- 172.21.15.158:0/3395819631 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f4f0c05a510 0x7f4f0c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:50.030 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.024+0000 7f4f06ffd700 1 -- 172.21.15.158:0/3395819631 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6639+0+0 (secure 0 0 0) 0x7f4f140767b0 con 0x7f4f2014b1d0 2023-10-18T17:25:50.031 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.024+0000 7f4f1effd700 1 --2- 172.21.15.158:0/3395819631 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f4f0c05a510 0x7f4f0c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:50.031 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.024+0000 7f4f1effd700 1 --2- 172.21.15.158:0/3395819631 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f4f0c05a510 0x7f4f0c05c9d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f4f10009b90 tx=0x7f4f10009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:50.036 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.032+0000 7f4f06ffd700 1 -- 172.21.15.158:0/3395819631 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f4f14049d50 con 0x7f4f2014b1d0 2023-10-18T17:25:50.228 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.224+0000 7f4f254db700 1 -- 172.21.15.158:0/3395819631 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4f2006c190 con 0x7f4f2014b1d0 2023-10-18T17:25:50.229 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.224+0000 7f4f06ffd700 1 -- 172.21.15.158:0/3395819631 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f4f1404d2f0 con 0x7f4f2014b1d0 2023-10-18T17:25:50.229 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:25:50.233 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.228+0000 7f4f254db700 1 -- 172.21.15.158:0/3395819631 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f4f0c05a510 msgr2=0x7f4f0c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:50.233 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.228+0000 7f4f254db700 1 --2- 172.21.15.158:0/3395819631 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f4f0c05a510 0x7f4f0c05c9d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f4f10009b90 tx=0x7f4f10009060).stop 2023-10-18T17:25:50.233 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.228+0000 7f4f254db700 1 -- 172.21.15.158:0/3395819631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f2014b1d0 msgr2=0x7f4f20163e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:50.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.228+0000 7f4f254db700 1 --2- 172.21.15.158:0/3395819631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f2014b1d0 0x7f4f20163e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f4f200689e0 tx=0x7f4f14016000).stop 2023-10-18T17:25:50.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.228+0000 7f4f254db700 1 -- 172.21.15.158:0/3395819631 shutdown_connections 2023-10-18T17:25:50.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.228+0000 7f4f254db700 1 --2- 172.21.15.158:0/3395819631 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f4f0c05a510 0x7f4f0c05c9d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:50.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.228+0000 7f4f254db700 1 --2- 172.21.15.158:0/3395819631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f20163520 0x7f4f200c2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:50.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.228+0000 7f4f254db700 1 --2- 172.21.15.158:0/3395819631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f2014b1d0 0x7f4f20163e10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:50.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.228+0000 7f4f254db700 1 --2- 172.21.15.158:0/3395819631 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4f200bf8d0 0x7f4f200b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:50.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.228+0000 7f4f254db700 1 -- 172.21.15.158:0/3395819631 >> 172.21.15.158:0/3395819631 conn(0x7f4f200699e0 msgr2=0x7f4f2014baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:50.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.228+0000 7f4f254db700 1 -- 172.21.15.158:0/3395819631 shutdown_connections 2023-10-18T17:25:50.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:50.228+0000 7f4f254db700 1 -- 172.21.15.158:0/3395819631 wait complete. 2023-10-18T17:25:50.255 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:25:50.559 INFO:tasks.ceph.mds.f.smithi183.stderr:terminate called after throwing an instance of 'boost::wrapexcept' 2023-10-18T17:25:50.560 INFO:tasks.ceph.mds.f.smithi183.stderr: what(): boost::bad_get: failed value get using boost::get 2023-10-18T17:25:50.560 INFO:tasks.ceph.mds.f.smithi183.stderr:*** Caught signal (Aborted) ** 2023-10-18T17:25:50.560 INFO:tasks.ceph.mds.f.smithi183.stderr: in thread 7fd9a944e700 thread_name:ms_dispatch 2023-10-18T17:25:50.561 INFO:tasks.ceph.mds.f.smithi183.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:25:50.561 INFO:tasks.ceph.mds.f.smithi183.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fd9ae6ad420] 2023-10-18T17:25:50.562 INFO:tasks.ceph.mds.f.smithi183.stderr: 2: gsignal() 2023-10-18T17:25:50.562 INFO:tasks.ceph.mds.f.smithi183.stderr: 3: abort() 2023-10-18T17:25:50.562 INFO:tasks.ceph.mds.f.smithi183.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7fd9ae54f911] 2023-10-18T17:25:50.562 INFO:tasks.ceph.mds.f.smithi183.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7fd9ae55b38c] 2023-10-18T17:25:50.562 INFO:tasks.ceph.mds.f.smithi183.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7fd9ae55b3f7] 2023-10-18T17:25:50.563 INFO:tasks.ceph.mds.f.smithi183.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7fd9ae55b6a9] 2023-10-18T17:25:50.563 INFO:tasks.ceph.mds.f.smithi183.stderr: 8: ceph-mds(+0x185107) [0x561895074107] 2023-10-18T17:25:50.563 INFO:tasks.ceph.mds.f.smithi183.stderr: 9: ceph-mds(+0x18572d) [0x56189507472d] 2023-10-18T17:25:50.563 INFO:tasks.ceph.mds.f.smithi183.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x5618950e609f] 2023-10-18T17:25:50.563 INFO:tasks.ceph.mds.f.smithi183.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x5618950e7a95] 2023-10-18T17:25:50.564 INFO:tasks.ceph.mds.f.smithi183.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x5618950b2b10] 2023-10-18T17:25:50.564 INFO:tasks.ceph.mds.f.smithi183.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x5618950b6abf] 2023-10-18T17:25:50.564 INFO:tasks.ceph.mds.f.smithi183.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x5618950b7456] 2023-10-18T17:25:50.564 INFO:tasks.ceph.mds.f.smithi183.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7fd9aebb3710] 2023-10-18T17:25:50.565 INFO:tasks.ceph.mds.f.smithi183.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7fd9aebb0faf] 2023-10-18T17:25:50.565 INFO:tasks.ceph.mds.f.smithi183.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd9aec7fb21] 2023-10-18T17:25:50.565 INFO:tasks.ceph.mds.f.smithi183.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fd9ae6a1609] 2023-10-18T17:25:50.565 INFO:tasks.ceph.mds.f.smithi183.stderr: 19: clone() 2023-10-18T17:25:50.566 INFO:tasks.ceph.mds.f.smithi183.stderr:2023-10-18T17:25:50.556+0000 7fd9a944e700 -1 *** Caught signal (Aborted) ** 2023-10-18T17:25:50.566 INFO:tasks.ceph.mds.f.smithi183.stderr: in thread 7fd9a944e700 thread_name:ms_dispatch 2023-10-18T17:25:50.567 INFO:tasks.ceph.mds.f.smithi183.stderr: 2023-10-18T17:25:50.567 INFO:tasks.ceph.mds.f.smithi183.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:25:50.567 INFO:tasks.ceph.mds.f.smithi183.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fd9ae6ad420] 2023-10-18T17:25:50.567 INFO:tasks.ceph.mds.f.smithi183.stderr: 2: gsignal() 2023-10-18T17:25:50.567 INFO:tasks.ceph.mds.f.smithi183.stderr: 3: abort() 2023-10-18T17:25:50.568 INFO:tasks.ceph.mds.f.smithi183.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7fd9ae54f911] 2023-10-18T17:25:50.568 INFO:tasks.ceph.mds.f.smithi183.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7fd9ae55b38c] 2023-10-18T17:25:50.568 INFO:tasks.ceph.mds.f.smithi183.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7fd9ae55b3f7] 2023-10-18T17:25:50.568 INFO:tasks.ceph.mds.f.smithi183.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7fd9ae55b6a9] 2023-10-18T17:25:50.568 INFO:tasks.ceph.mds.f.smithi183.stderr: 8: ceph-mds(+0x185107) [0x561895074107] 2023-10-18T17:25:50.569 INFO:tasks.ceph.mds.f.smithi183.stderr: 9: ceph-mds(+0x18572d) [0x56189507472d] 2023-10-18T17:25:50.569 INFO:tasks.ceph.mds.f.smithi183.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x5618950e609f] 2023-10-18T17:25:50.569 INFO:tasks.ceph.mds.f.smithi183.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x5618950e7a95] 2023-10-18T17:25:50.569 INFO:tasks.ceph.mds.f.smithi183.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x5618950b2b10] 2023-10-18T17:25:50.569 INFO:tasks.ceph.mds.f.smithi183.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x5618950b6abf] 2023-10-18T17:25:50.570 INFO:tasks.ceph.mds.f.smithi183.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x5618950b7456] 2023-10-18T17:25:50.570 INFO:tasks.ceph.mds.f.smithi183.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7fd9aebb3710] 2023-10-18T17:25:50.570 INFO:tasks.ceph.mds.f.smithi183.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7fd9aebb0faf] 2023-10-18T17:25:50.570 INFO:tasks.ceph.mds.f.smithi183.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd9aec7fb21] 2023-10-18T17:25:50.570 INFO:tasks.ceph.mds.f.smithi183.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fd9ae6a1609] 2023-10-18T17:25:50.571 INFO:tasks.ceph.mds.f.smithi183.stderr: 19: clone() 2023-10-18T17:25:50.571 INFO:tasks.ceph.mds.f.smithi183.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T17:25:50.571 INFO:tasks.ceph.mds.f.smithi183.stderr: 2023-10-18T17:25:50.571 INFO:tasks.ceph.mds.f.smithi183.stderr: 0> 2023-10-18T17:25:50.556+0000 7fd9a944e700 -1 *** Caught signal (Aborted) ** 2023-10-18T17:25:50.571 INFO:tasks.ceph.mds.f.smithi183.stderr: in thread 7fd9a944e700 thread_name:ms_dispatch 2023-10-18T17:25:50.572 INFO:tasks.ceph.mds.f.smithi183.stderr: 2023-10-18T17:25:50.572 INFO:tasks.ceph.mds.f.smithi183.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:25:50.572 INFO:tasks.ceph.mds.f.smithi183.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fd9ae6ad420] 2023-10-18T17:25:50.572 INFO:tasks.ceph.mds.f.smithi183.stderr: 2: gsignal() 2023-10-18T17:25:50.572 INFO:tasks.ceph.mds.f.smithi183.stderr: 3: abort() 2023-10-18T17:25:50.573 INFO:tasks.ceph.mds.f.smithi183.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7fd9ae54f911] 2023-10-18T17:25:50.573 INFO:tasks.ceph.mds.f.smithi183.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7fd9ae55b38c] 2023-10-18T17:25:50.573 INFO:tasks.ceph.mds.f.smithi183.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7fd9ae55b3f7] 2023-10-18T17:25:50.573 INFO:tasks.ceph.mds.f.smithi183.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7fd9ae55b6a9] 2023-10-18T17:25:50.573 INFO:tasks.ceph.mds.f.smithi183.stderr: 8: ceph-mds(+0x185107) [0x561895074107] 2023-10-18T17:25:50.573 INFO:tasks.ceph.mds.f.smithi183.stderr: 9: ceph-mds(+0x18572d) [0x56189507472d] 2023-10-18T17:25:50.574 INFO:tasks.ceph.mds.f.smithi183.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x5618950e609f] 2023-10-18T17:25:50.574 INFO:tasks.ceph.mds.f.smithi183.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x5618950e7a95] 2023-10-18T17:25:50.574 INFO:tasks.ceph.mds.f.smithi183.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x5618950b2b10] 2023-10-18T17:25:50.574 INFO:tasks.ceph.mds.f.smithi183.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x5618950b6abf] 2023-10-18T17:25:50.574 INFO:tasks.ceph.mds.f.smithi183.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x5618950b7456] 2023-10-18T17:25:50.575 INFO:tasks.ceph.mds.f.smithi183.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7fd9aebb3710] 2023-10-18T17:25:50.575 INFO:tasks.ceph.mds.f.smithi183.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7fd9aebb0faf] 2023-10-18T17:25:50.575 INFO:tasks.ceph.mds.f.smithi183.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd9aec7fb21] 2023-10-18T17:25:50.575 INFO:tasks.ceph.mds.f.smithi183.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fd9ae6a1609] 2023-10-18T17:25:50.575 INFO:tasks.ceph.mds.f.smithi183.stderr: 19: clone() 2023-10-18T17:25:50.576 INFO:tasks.ceph.mds.f.smithi183.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T17:25:50.576 INFO:tasks.ceph.mds.f.smithi183.stderr: 2023-10-18T17:25:50.576 INFO:tasks.ceph.mds.f.smithi183.stderr: 0> 2023-10-18T17:25:50.556+0000 7fd9a944e700 -1 *** Caught signal (Aborted) ** 2023-10-18T17:25:50.576 INFO:tasks.ceph.mds.f.smithi183.stderr: in thread 7fd9a944e700 thread_name:ms_dispatch 2023-10-18T17:25:50.576 INFO:tasks.ceph.mds.f.smithi183.stderr: 2023-10-18T17:25:50.577 INFO:tasks.ceph.mds.f.smithi183.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T17:25:50.577 INFO:tasks.ceph.mds.f.smithi183.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fd9ae6ad420] 2023-10-18T17:25:50.577 INFO:tasks.ceph.mds.f.smithi183.stderr: 2: gsignal() 2023-10-18T17:25:50.577 INFO:tasks.ceph.mds.f.smithi183.stderr: 3: abort() 2023-10-18T17:25:50.577 INFO:tasks.ceph.mds.f.smithi183.stderr: 4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911) [0x7fd9ae54f911] 2023-10-18T17:25:50.578 INFO:tasks.ceph.mds.f.smithi183.stderr: 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c) [0x7fd9ae55b38c] 2023-10-18T17:25:50.578 INFO:tasks.ceph.mds.f.smithi183.stderr: 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7) [0x7fd9ae55b3f7] 2023-10-18T17:25:50.578 INFO:tasks.ceph.mds.f.smithi183.stderr: 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9) [0x7fd9ae55b6a9] 2023-10-18T17:25:50.578 INFO:tasks.ceph.mds.f.smithi183.stderr: 8: ceph-mds(+0x185107) [0x561895074107] 2023-10-18T17:25:50.578 INFO:tasks.ceph.mds.f.smithi183.stderr: 9: ceph-mds(+0x18572d) [0x56189507472d] 2023-10-18T17:25:50.579 INFO:tasks.ceph.mds.f.smithi183.stderr: 10: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x20f) [0x5618950e609f] 2023-10-18T17:25:50.579 INFO:tasks.ceph.mds.f.smithi183.stderr: 11: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x115) [0x5618950e7a95] 2023-10-18T17:25:50.579 INFO:tasks.ceph.mds.f.smithi183.stderr: 12: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1530) [0x5618950b2b10] 2023-10-18T17:25:50.579 INFO:tasks.ceph.mds.f.smithi183.stderr: 13: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x3df) [0x5618950b6abf] 2023-10-18T17:25:50.580 INFO:tasks.ceph.mds.f.smithi183.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x186) [0x5618950b7456] 2023-10-18T17:25:50.580 INFO:tasks.ceph.mds.f.smithi183.stderr: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7fd9aebb3710] 2023-10-18T17:25:50.580 INFO:tasks.ceph.mds.f.smithi183.stderr: 16: (DispatchQueue::entry()+0x58f) [0x7fd9aebb0faf] 2023-10-18T17:25:50.580 INFO:tasks.ceph.mds.f.smithi183.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd9aec7fb21] 2023-10-18T17:25:50.580 INFO:tasks.ceph.mds.f.smithi183.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fd9ae6a1609] 2023-10-18T17:25:50.581 INFO:tasks.ceph.mds.f.smithi183.stderr: 19: clone() 2023-10-18T17:25:50.581 INFO:tasks.ceph.mds.f.smithi183.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T17:25:50.581 INFO:tasks.ceph.mds.f.smithi183.stderr: 2023-10-18T17:25:50.748 INFO:tasks.ceph.mds.f.smithi183.stderr:daemon-helper: command crashed with signal 6 2023-10-18T17:25:52.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~46s 2023-10-18T17:25:52.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~100s 2023-10-18T17:25:52.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~26s 2023-10-18T17:25:52.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~13s 2023-10-18T17:25:52.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~59s 2023-10-18T17:25:52.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2023-10-18T17:25:53.256 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:25:53.418 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.416+0000 7f9ff1a1b700 1 Processor -- start 2023-10-18T17:25:53.418 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.416+0000 7f9ff1a1b700 1 -- start start 2023-10-18T17:25:53.419 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.416+0000 7f9ff1a1b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fec1518e0 0x7f9fec067ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:53.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.416+0000 7f9ff1a1b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9fec0c4200 0x7f9fec0c3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:53.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.416+0000 7f9ff1a1b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fec1582d0 con 0x7f9fec0c3b20 2023-10-18T17:25:53.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.416+0000 7f9ff1a1b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fec154550 con 0x7f9fec0c4200 2023-10-18T17:25:53.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.416+0000 7f9ff1a1b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec1585b0 con 0x7f9fec1518e0 2023-10-18T17:25:53.422 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.416+0000 7f9febfff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f9fec0c3b20 0x7f9fec1549a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:46384/0 (socket says 172.21.15.158:46384) 2023-10-18T17:25:53.422 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.416+0000 7f9febfff700 1 -- 172.21.15.158:0/2139482184 learned_addr learned my addr 172.21.15.158:0/2139482184 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:25:53.423 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.416+0000 7f9fe27fc700 1 --2- 172.21.15.158:0/2139482184 >> v2:172.21.15.183:3300/0 conn(0x7f9fec0c4200 0x7f9fec0c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:53.423 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.416+0000 7f9feaffd700 1 --2- 172.21.15.158:0/2139482184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fec1518e0 0x7f9fec067ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:53.423 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.416+0000 7f9fea7fc700 1 -- 172.21.15.158:0/2139482184 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814828498 0 0) 0x7f9fec1582d0 con 0x7f9fec0c3b20 2023-10-18T17:25:53.423 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.416+0000 7f9feaffd700 1 -- 172.21.15.158:0/2139482184 >> v2:172.21.15.183:3300/0 conn(0x7f9fec0c4200 msgr2=0x7f9fec0c3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:25:53.423 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.416+0000 7f9feaffd700 1 --2- 172.21.15.158:0/2139482184 >> v2:172.21.15.183:3300/0 conn(0x7f9fec0c4200 0x7f9fec0c3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:53.424 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.416+0000 7f9feaffd700 1 -- 172.21.15.158:0/2139482184 >> v1:172.21.15.158:6789/0 conn(0x7f9fec0c3b20 legacy=0x7f9fec1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:53.424 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.416+0000 7f9feaffd700 1 -- 172.21.15.158:0/2139482184 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec0be260 con 0x7f9fec1518e0 2023-10-18T17:25:53.424 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.416+0000 7f9fe27fc700 1 --2- 172.21.15.158:0/2139482184 >> v2:172.21.15.183:3300/0 conn(0x7f9fec0c4200 0x7f9fec0c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:25:53.424 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.416+0000 7f9feaffd700 1 --2- 172.21.15.158:0/2139482184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fec1518e0 0x7f9fec067ae0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f9fdc009760 tx=0x7f9fdc009060).ready entity=mon.2 client_cookie=b97c38f82f14386 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:53.424 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.416+0000 7f9fea7fc700 1 -- 172.21.15.158:0/2139482184 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc00b590 con 0x7f9fec1518e0 2023-10-18T17:25:53.425 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.420+0000 7f9fea7fc700 1 -- 172.21.15.158:0/2139482184 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc00b6f0 con 0x7f9fec1518e0 2023-10-18T17:25:53.425 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.420+0000 7f9fea7fc700 1 -- 172.21.15.158:0/2139482184 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc00ba70 con 0x7f9fec1518e0 2023-10-18T17:25:53.426 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.420+0000 7f9ff1a1b700 1 -- 172.21.15.158:0/2139482184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fec1518e0 msgr2=0x7f9fec067ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:53.426 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.420+0000 7f9ff1a1b700 1 --2- 172.21.15.158:0/2139482184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fec1518e0 0x7f9fec067ae0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f9fdc009760 tx=0x7f9fdc009060).stop 2023-10-18T17:25:53.427 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.420+0000 7f9ff1a1b700 1 -- 172.21.15.158:0/2139482184 shutdown_connections 2023-10-18T17:25:53.427 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.420+0000 7f9ff1a1b700 1 --2- 172.21.15.158:0/2139482184 >> v2:172.21.15.183:3300/0 conn(0x7f9fec0c4200 0x7f9fec0c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:53.427 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.420+0000 7f9ff1a1b700 1 --2- 172.21.15.158:0/2139482184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fec1518e0 0x7f9fec067ae0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:53.427 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.420+0000 7f9ff1a1b700 1 -- 172.21.15.158:0/2139482184 >> 172.21.15.158:0/2139482184 conn(0x7f9fec0699e0 msgr2=0x7f9fec069df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:53.427 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.420+0000 7f9ff1a1b700 1 -- 172.21.15.158:0/2139482184 shutdown_connections 2023-10-18T17:25:53.428 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.420+0000 7f9ff1a1b700 1 -- 172.21.15.158:0/2139482184 wait complete. 2023-10-18T17:25:53.428 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.420+0000 7f9ff1a1b700 1 Processor -- start 2023-10-18T17:25:53.428 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.420+0000 7f9ff1a1b700 1 -- start start 2023-10-18T17:25:53.431 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9ff1a1b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fec0c3b20 0x7f9fec1521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:53.431 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9ff1a1b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fec0c4200 0x7f9fec1526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:53.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9ff1a1b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fec1518e0 0x7f9fec0b74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:53.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9ff1a1b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec0af710 con 0x7f9fec0c3b20 2023-10-18T17:25:53.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9ff1a1b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec0af100 con 0x7f9fec0c4200 2023-10-18T17:25:53.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9ff1a1b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec0b8030 con 0x7f9fec1518e0 2023-10-18T17:25:53.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9feaffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fec0c3b20 0x7f9fec1521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:53.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9feaffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fec0c3b20 0x7f9fec1521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:52134/0 (socket says 172.21.15.158:52134) 2023-10-18T17:25:53.433 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9feaffd700 1 -- 172.21.15.158:0/137294215 learned_addr learned my addr 172.21.15.158:0/137294215 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:53.433 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9fe27fc700 1 --2- 172.21.15.158:0/137294215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fec0c4200 0x7f9fec1526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:53.433 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9febfff700 1 --2- 172.21.15.158:0/137294215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fec1518e0 0x7f9fec0b74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:53.433 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9feaffd700 1 -- 172.21.15.158:0/137294215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fec1518e0 msgr2=0x7f9fec0b74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:53.433 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9feaffd700 1 --2- 172.21.15.158:0/137294215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fec1518e0 0x7f9fec0b74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:53.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9feaffd700 1 -- 172.21.15.158:0/137294215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fec0c4200 msgr2=0x7f9fec1526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:53.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9feaffd700 1 --2- 172.21.15.158:0/137294215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fec0c4200 0x7f9fec1526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:53.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9feaffd700 1 -- 172.21.15.158:0/137294215 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd4009a20 con 0x7f9fec0c3b20 2023-10-18T17:25:53.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9febfff700 1 --2- 172.21.15.158:0/137294215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fec1518e0 0x7f9fec0b74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:25:53.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9feaffd700 1 --2- 172.21.15.158:0/137294215 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fec0c3b20 0x7f9fec1521d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f9fdc009e00 tx=0x7f9fdc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:53.435 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9fe37fe700 1 -- 172.21.15.158:0/137294215 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc00b860 con 0x7f9fec0c3b20 2023-10-18T17:25:53.435 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9fe37fe700 1 -- 172.21.15.158:0/137294215 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc00b9c0 con 0x7f9fec0c3b20 2023-10-18T17:25:53.435 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9fe37fe700 1 -- 172.21.15.158:0/137294215 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc01b660 con 0x7f9fec0c3b20 2023-10-18T17:25:53.436 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9ff1a1b700 1 -- 172.21.15.158:0/137294215 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fdc0092a0 con 0x7f9fec0c3b20 2023-10-18T17:25:53.436 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.424+0000 7f9ff1a1b700 1 -- 172.21.15.158:0/137294215 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fec0b85f0 con 0x7f9fec0c3b20 2023-10-18T17:25:53.436 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.428+0000 7f9ff1a1b700 1 -- 172.21.15.158:0/137294215 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fec06c190 con 0x7f9fec0c3b20 2023-10-18T17:25:53.437 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.428+0000 7f9fe37fe700 1 -- 172.21.15.158:0/137294215 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9fdc01ba50 con 0x7f9fec0c3b20 2023-10-18T17:25:53.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.428+0000 7f9fe37fe700 1 --2- 172.21.15.158:0/137294215 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9fcc05a4e0 0x7f9fcc05c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:53.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.428+0000 7f9fe37fe700 1 -- 172.21.15.158:0/137294215 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f9fdc075880 con 0x7f9fec0c3b20 2023-10-18T17:25:53.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.428+0000 7f9fe27fc700 1 --2- 172.21.15.158:0/137294215 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9fcc05a4e0 0x7f9fcc05c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:53.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.428+0000 7f9fe27fc700 1 --2- 172.21.15.158:0/137294215 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9fcc05a4e0 0x7f9fcc05c9a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f9fd4009fd0 tx=0x7f9fd400b040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:53.440 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.436+0000 7f9fe37fe700 1 -- 172.21.15.158:0/137294215 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f9fdc048e00 con 0x7f9fec0c3b20 2023-10-18T17:25:53.632 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.628+0000 7f9ff1a1b700 1 -- 172.21.15.158:0/137294215 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9fec0be540 con 0x7f9fec0c3b20 2023-10-18T17:25:53.633 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.628+0000 7f9fe37fe700 1 -- 172.21.15.158:0/137294215 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f9fdc021080 con 0x7f9fec0c3b20 2023-10-18T17:25:53.633 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:25:53.636 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.632+0000 7f9ff1a1b700 1 -- 172.21.15.158:0/137294215 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9fcc05a4e0 msgr2=0x7f9fcc05c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:53.636 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.632+0000 7f9ff1a1b700 1 --2- 172.21.15.158:0/137294215 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9fcc05a4e0 0x7f9fcc05c9a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f9fd4009fd0 tx=0x7f9fd400b040).stop 2023-10-18T17:25:53.636 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.632+0000 7f9ff1a1b700 1 -- 172.21.15.158:0/137294215 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fec0c3b20 msgr2=0x7f9fec1521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:53.636 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.632+0000 7f9ff1a1b700 1 --2- 172.21.15.158:0/137294215 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fec0c3b20 0x7f9fec1521d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f9fdc009e00 tx=0x7f9fdc017000).stop 2023-10-18T17:25:53.636 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.632+0000 7f9ff1a1b700 1 -- 172.21.15.158:0/137294215 shutdown_connections 2023-10-18T17:25:53.637 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.632+0000 7f9ff1a1b700 1 --2- 172.21.15.158:0/137294215 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9fcc05a4e0 0x7f9fcc05c9a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:53.637 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.632+0000 7f9ff1a1b700 1 --2- 172.21.15.158:0/137294215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fec1518e0 0x7f9fec0b74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:53.637 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.632+0000 7f9ff1a1b700 1 --2- 172.21.15.158:0/137294215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fec0c4200 0x7f9fec1526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:53.637 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.632+0000 7f9ff1a1b700 1 --2- 172.21.15.158:0/137294215 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fec0c3b20 0x7f9fec1521d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:53.637 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.632+0000 7f9ff1a1b700 1 -- 172.21.15.158:0/137294215 >> 172.21.15.158:0/137294215 conn(0x7f9fec0699e0 msgr2=0x7f9fec153430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:53.638 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.632+0000 7f9ff1a1b700 1 -- 172.21.15.158:0/137294215 shutdown_connections 2023-10-18T17:25:53.639 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:53.632+0000 7f9ff1a1b700 1 -- 172.21.15.158:0/137294215 wait complete. 2023-10-18T17:25:53.655 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:25:56.656 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:25:56.826 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.820+0000 7fdaa131b700 1 Processor -- start 2023-10-18T17:25:56.826 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.824+0000 7fdaa131b700 1 -- start start 2023-10-18T17:25:56.828 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.824+0000 7fdaa131b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda9c0b9690 0x7fda9c0b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:56.828 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.824+0000 7fdaa131b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fda9c065d30 0x7fda9c14dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:56.829 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.824+0000 7fdaa131b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c0bc480 con 0x7fda9c0bca50 2023-10-18T17:25:56.829 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.824+0000 7fdaa131b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c065190 con 0x7fda9c065d30 2023-10-18T17:25:56.829 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.824+0000 7fdaa131b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0bb920 con 0x7fda9c0b9690 2023-10-18T17:25:56.829 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.824+0000 7fda93fff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fda9c0bca50 0x7fda9c065620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:46390/0 (socket says 172.21.15.158:46390) 2023-10-18T17:25:56.830 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.824+0000 7fda93fff700 1 -- 172.21.15.158:0/2232164529 learned_addr learned my addr 172.21.15.158:0/2232164529 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:25:56.830 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.824+0000 7fda9b7fe700 1 --2- 172.21.15.158:0/2232164529 >> v2:172.21.15.158:3300/0 conn(0x7fda9c065d30 0x7fda9c14dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:56.830 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.824+0000 7fda9affd700 1 --2- 172.21.15.158:0/2232164529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda9c0b9690 0x7fda9c0b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:56.833 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.824+0000 7fda9a7fc700 1 -- 172.21.15.158:0/2232164529 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050265516 0 0) 0x7fda9c0bc480 con 0x7fda9c0bca50 2023-10-18T17:25:56.833 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.824+0000 7fda9a7fc700 1 -- 172.21.15.158:0/2232164529 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda880033f0 con 0x7fda9c0bca50 2023-10-18T17:25:56.833 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.824+0000 7fda9a7fc700 1 -- 172.21.15.158:0/2232164529 <== mon.0 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1790461114 0 0) 0x7fda880033f0 con 0x7fda9c0bca50 2023-10-18T17:25:56.834 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.824+0000 7fda9a7fc700 1 -- 172.21.15.158:0/2232164529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda9c0b9690 msgr2=0x7fda9c0b9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:25:56.834 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.824+0000 7fda9a7fc700 1 --2- 172.21.15.158:0/2232164529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda9c0b9690 0x7fda9c0b9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:56.834 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.824+0000 7fda9a7fc700 1 -- 172.21.15.158:0/2232164529 >> v2:172.21.15.158:3300/0 conn(0x7fda9c065d30 msgr2=0x7fda9c14dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:25:56.834 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.824+0000 7fda9a7fc700 1 --2- 172.21.15.158:0/2232164529 >> v2:172.21.15.158:3300/0 conn(0x7fda9c065d30 0x7fda9c14dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:56.834 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9a7fc700 1 -- 172.21.15.158:0/2232164529 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c0bbbe0 con 0x7fda9c0bca50 2023-10-18T17:25:56.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9a7fc700 1 -- 172.21.15.158:0/2232164529 <== mon.0 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2074596555 0 0) 0x7fda84001470 con 0x7fda9c0bca50 2023-10-18T17:25:56.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9b7fe700 1 --2- 172.21.15.158:0/2232164529 >> v2:172.21.15.158:3300/0 conn(0x7fda9c065d30 0x7fda9c14dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:25:56.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9a7fc700 1 -- 172.21.15.158:0/2232164529 >> v1:172.21.15.158:6789/0 conn(0x7fda9c0bca50 legacy=0x7fda9c065620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:56.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9a7fc700 1 --2- 172.21.15.158:0/2232164529 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda88003960 0x7fda88003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:56.836 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9a7fc700 1 --2- 172.21.15.158:0/2232164529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda9c0b9690 0x7fda88004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:56.838 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9a7fc700 1 --2- 172.21.15.158:0/2232164529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda88004b80 0x7fda88005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:56.838 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9a7fc700 1 -- 172.21.15.158:0/2232164529 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c065190 con 0x7fda88003960 2023-10-18T17:25:56.839 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9a7fc700 1 -- 172.21.15.158:0/2232164529 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0bb920 con 0x7fda88004b80 2023-10-18T17:25:56.839 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9a7fc700 1 -- 172.21.15.158:0/2232164529 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8800b8e0 con 0x7fda9c0b9690 2023-10-18T17:25:56.839 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9affd700 1 --2- 172.21.15.158:0/2232164529 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda88003960 0x7fda88003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:56.839 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda93fff700 1 --2- 172.21.15.158:0/2232164529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda9c0b9690 0x7fda88004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:56.839 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9b7fe700 1 --2- 172.21.15.158:0/2232164529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda88004b80 0x7fda88005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:56.840 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9affd700 1 -- 172.21.15.158:0/2232164529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda9c0b9690 msgr2=0x7fda88004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:25:56.840 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9affd700 1 --2- 172.21.15.158:0/2232164529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda9c0b9690 0x7fda88004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:56.840 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9affd700 1 -- 172.21.15.158:0/2232164529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda88004b80 msgr2=0x7fda88005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:25:56.840 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9affd700 1 --2- 172.21.15.158:0/2232164529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda88004b80 0x7fda88005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:56.840 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9affd700 1 -- 172.21.15.158:0/2232164529 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda880033f0 con 0x7fda88003960 2023-10-18T17:25:56.841 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda93fff700 1 --2- 172.21.15.158:0/2232164529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda9c0b9690 0x7fda88004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:25:56.841 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9b7fe700 1 --2- 172.21.15.158:0/2232164529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda88004b80 0x7fda88005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T17:25:56.841 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9affd700 1 --2- 172.21.15.158:0/2232164529 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda88003960 0x7fda88003d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fda8c009a80 tx=0x7fda8c009060).ready entity=mon.0 client_cookie=1b93a5b48679a19d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:56.841 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9a7fc700 1 -- 172.21.15.158:0/2232164529 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c009430 con 0x7fda88003960 2023-10-18T17:25:56.841 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9a7fc700 1 -- 172.21.15.158:0/2232164529 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c00e640 con 0x7fda88003960 2023-10-18T17:25:56.842 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9a7fc700 1 -- 172.21.15.158:0/2232164529 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c00e9c0 con 0x7fda88003960 2023-10-18T17:25:56.842 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fdaa131b700 1 -- 172.21.15.158:0/2232164529 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda88003960 msgr2=0x7fda88003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:56.842 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fdaa131b700 1 --2- 172.21.15.158:0/2232164529 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda88003960 0x7fda88003d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fda8c009a80 tx=0x7fda8c009060).stop 2023-10-18T17:25:56.842 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fda9b7fe700 1 -- 172.21.15.158:0/2232164529 reap_dead start 2023-10-18T17:25:56.842 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fdaa131b700 1 -- 172.21.15.158:0/2232164529 shutdown_connections 2023-10-18T17:25:56.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fdaa131b700 1 -- 172.21.15.158:0/2232164529 >> 172.21.15.158:0/2232164529 conn(0x7fda9c0620d0 msgr2=0x7fda9c0624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:56.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fdaa131b700 1 -- 172.21.15.158:0/2232164529 shutdown_connections 2023-10-18T17:25:56.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.828+0000 7fdaa131b700 1 -- 172.21.15.158:0/2232164529 wait complete. 2023-10-18T17:25:56.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.832+0000 7fdaa131b700 1 Processor -- start 2023-10-18T17:25:56.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.832+0000 7fdaa131b700 1 -- start start 2023-10-18T17:25:56.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.832+0000 7fdaa131b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda88003960 0x7fda9c0c16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:56.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.832+0000 7fdaa131b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda9c160ce0 0x7fda9c14be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:56.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.832+0000 7fdaa131b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda9c0c11e0 0x7fda9c164220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:56.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.832+0000 7fdaa131b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c161250 con 0x7fda9c160ce0 2023-10-18T17:25:56.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.832+0000 7fdaa131b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c163d90 con 0x7fda9c0c11e0 2023-10-18T17:25:56.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.832+0000 7fdaa131b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c14c350 con 0x7fda88003960 2023-10-18T17:25:56.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.832+0000 7fda93fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda9c160ce0 0x7fda9c14be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:56.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.832+0000 7fda9affd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda88003960 0x7fda9c0c16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:56.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.832+0000 7fda93fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda9c160ce0 0x7fda9c14be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:52154/0 (socket says 172.21.15.158:52154) 2023-10-18T17:25:56.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.832+0000 7fda93fff700 1 -- 172.21.15.158:0/3378544387 learned_addr learned my addr 172.21.15.158:0/3378544387 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:25:56.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.832+0000 7fda9b7fe700 1 --2- 172.21.15.158:0/3378544387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda9c0c11e0 0x7fda9c164220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:56.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.832+0000 7fda93fff700 1 -- 172.21.15.158:0/3378544387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda88003960 msgr2=0x7fda9c0c16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:56.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.832+0000 7fda93fff700 1 --2- 172.21.15.158:0/3378544387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda88003960 0x7fda9c0c16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:56.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.832+0000 7fda93fff700 1 -- 172.21.15.158:0/3378544387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda9c0c11e0 msgr2=0x7fda9c164220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:56.849 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.832+0000 7fda93fff700 1 --2- 172.21.15.158:0/3378544387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda9c0c11e0 0x7fda9c164220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:56.849 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.836+0000 7fda93fff700 1 -- 172.21.15.158:0/3378544387 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c164710 con 0x7fda9c160ce0 2023-10-18T17:25:56.849 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.836+0000 7fda93fff700 1 --2- 172.21.15.158:0/3378544387 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda9c160ce0 0x7fda9c14be60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fda84001010 tx=0x7fda9c14b970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:56.849 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.836+0000 7fda92ffd700 1 -- 172.21.15.158:0/3378544387 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda84010520 con 0x7fda9c160ce0 2023-10-18T17:25:56.849 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.836+0000 7fda92ffd700 1 -- 172.21.15.158:0/3378544387 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda84010680 con 0x7fda9c160ce0 2023-10-18T17:25:56.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.836+0000 7fdaa131b700 1 -- 172.21.15.158:0/3378544387 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c149130 con 0x7fda9c160ce0 2023-10-18T17:25:56.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.836+0000 7fda92ffd700 1 -- 172.21.15.158:0/3378544387 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda84010a00 con 0x7fda9c160ce0 2023-10-18T17:25:56.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.836+0000 7fdaa131b700 1 -- 172.21.15.158:0/3378544387 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c163a20 con 0x7fda9c160ce0 2023-10-18T17:25:56.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.836+0000 7fdaa131b700 1 -- 172.21.15.158:0/3378544387 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c163880 con 0x7fda9c160ce0 2023-10-18T17:25:56.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.836+0000 7fda92ffd700 1 -- 172.21.15.158:0/3378544387 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fda84014430 con 0x7fda9c160ce0 2023-10-18T17:25:56.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.840+0000 7fda92ffd700 1 --2- 172.21.15.158:0/3378544387 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fda7c05a540 0x7fda7c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:25:56.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.840+0000 7fda92ffd700 1 -- 172.21.15.158:0/3378544387 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fda84074ae0 con 0x7fda9c160ce0 2023-10-18T17:25:56.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.840+0000 7fda9affd700 1 --2- 172.21.15.158:0/3378544387 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fda7c05a540 0x7fda7c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:25:56.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.840+0000 7fda9affd700 1 --2- 172.21.15.158:0/3378544387 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fda7c05a540 0x7fda7c05ca00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fda8c009a80 tx=0x7fda8c01a000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:25:56.852 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:56.844+0000 7fda92ffd700 1 -- 172.21.15.158:0/3378544387 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fda9c163880 con 0x7fda9c160ce0 2023-10-18T17:25:57.043 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:57.040+0000 7fdaa131b700 1 -- 172.21.15.158:0/3378544387 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fda9c163880 con 0x7fda9c160ce0 2023-10-18T17:25:57.044 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:57.040+0000 7fda92ffd700 1 -- 172.21.15.158:0/3378544387 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fda9c163880 con 0x7fda9c160ce0 2023-10-18T17:25:57.044 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:25:57.046 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:57.044+0000 7fdaa131b700 1 -- 172.21.15.158:0/3378544387 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fda7c05a540 msgr2=0x7fda7c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:57.046 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:57.044+0000 7fdaa131b700 1 --2- 172.21.15.158:0/3378544387 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fda7c05a540 0x7fda7c05ca00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fda8c009a80 tx=0x7fda8c01a000).stop 2023-10-18T17:25:57.046 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:57.044+0000 7fdaa131b700 1 -- 172.21.15.158:0/3378544387 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda9c160ce0 msgr2=0x7fda9c14be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:25:57.047 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:57.044+0000 7fdaa131b700 1 --2- 172.21.15.158:0/3378544387 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda9c160ce0 0x7fda9c14be60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fda84001010 tx=0x7fda9c14b970).stop 2023-10-18T17:25:57.047 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:57.044+0000 7fdaa131b700 1 -- 172.21.15.158:0/3378544387 shutdown_connections 2023-10-18T17:25:57.048 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:57.044+0000 7fdaa131b700 1 --2- 172.21.15.158:0/3378544387 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fda7c05a540 0x7fda7c05ca00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:57.048 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:57.044+0000 7fdaa131b700 1 --2- 172.21.15.158:0/3378544387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda9c0c11e0 0x7fda9c164220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:57.048 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:57.044+0000 7fdaa131b700 1 --2- 172.21.15.158:0/3378544387 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda9c160ce0 0x7fda9c14be60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:57.048 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:57.044+0000 7fdaa131b700 1 --2- 172.21.15.158:0/3378544387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda88003960 0x7fda9c0c16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:25:57.048 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:57.044+0000 7fdaa131b700 1 -- 172.21.15.158:0/3378544387 >> 172.21.15.158:0/3378544387 conn(0x7fda9c0620d0 msgr2=0x7fda9c14d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:25:57.049 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:57.044+0000 7fdaa131b700 1 -- 172.21.15.158:0/3378544387 shutdown_connections 2023-10-18T17:25:57.049 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:25:57.044+0000 7fdaa131b700 1 -- 172.21.15.158:0/3378544387 wait complete. 2023-10-18T17:25:57.065 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:25:58.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~52s 2023-10-18T17:25:58.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~106s 2023-10-18T17:25:58.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~32s 2023-10-18T17:25:58.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~19s 2023-10-18T17:25:58.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~65s 2023-10-18T17:25:58.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~6s 2023-10-18T17:26:00.066 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:26:00.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.228+0000 7f67b79db700 1 Processor -- start 2023-10-18T17:26:00.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.228+0000 7f67b79db700 1 -- start start 2023-10-18T17:26:00.236 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.232+0000 7f67b79db700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f67b00688c0 0x7f67b0068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:00.237 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.232+0000 7f67b79db700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67b0063380 0x7f67b01511c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:00.237 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.232+0000 7f67b79db700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b005e310 con 0x7f67b0154b10 2023-10-18T17:26:00.238 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.232+0000 7f67b79db700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b0069800 con 0x7f67b00688c0 2023-10-18T17:26:00.238 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.232+0000 7f67b79db700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b00620d0 con 0x7f67b0063380 2023-10-18T17:26:00.238 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.232+0000 7f67b5f78700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67b0063380 0x7f67b01511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:00.238 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.232+0000 7f67b5777700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f67b00688c0 0x7f67b0068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:00.238 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.232+0000 7f67b5f78700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67b0063380 0x7f67b01511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:50882/0 (socket says 172.21.15.158:50882) 2023-10-18T17:26:00.239 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.232+0000 7f67b5f78700 1 -- 172.21.15.158:0/2390526480 learned_addr learned my addr 172.21.15.158:0/2390526480 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:00.239 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.232+0000 7f67b4f76700 1 --1- 172.21.15.158:0/2390526480 >> v1:172.21.15.183:6789/0 conn(0x7f67b0154b10 0x7f67b00bfaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:53798/0 (socket says 172.21.15.158:53798) 2023-10-18T17:26:00.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.236+0000 7f67b5f78700 1 -- 172.21.15.158:0/2390526480 >> v2:172.21.15.183:3300/0 conn(0x7f67b00688c0 msgr2=0x7f67b0068ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:26:00.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.236+0000 7f67b5f78700 1 --2- 172.21.15.158:0/2390526480 >> v2:172.21.15.183:3300/0 conn(0x7f67b00688c0 0x7f67b0068ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:00.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.236+0000 7f67b5f78700 1 -- 172.21.15.158:0/2390526480 >> v1:172.21.15.183:6789/0 conn(0x7f67b0154b10 legacy=0x7f67b00bfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:00.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.236+0000 7f67b5f78700 1 -- 172.21.15.158:0/2390526480 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b0062ef0 con 0x7f67b0063380 2023-10-18T17:26:00.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.236+0000 7f67b5f78700 1 --2- 172.21.15.158:0/2390526480 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67b0063380 0x7f67b01511c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f67a8009f20 tx=0x7f67a8009840).ready entity=mon.2 client_cookie=f8234711c79491de server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:00.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.236+0000 7f67a7fff700 1 -- 172.21.15.158:0/2390526480 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a800e070 con 0x7f67b0063380 2023-10-18T17:26:00.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.236+0000 7f67a7fff700 1 -- 172.21.15.158:0/2390526480 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a800ba60 con 0x7f67b0063380 2023-10-18T17:26:00.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.236+0000 7f67a7fff700 1 -- 172.21.15.158:0/2390526480 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a800bde0 con 0x7f67b0063380 2023-10-18T17:26:00.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.236+0000 7f67b79db700 1 -- 172.21.15.158:0/2390526480 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67b0063380 msgr2=0x7f67b01511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:00.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.236+0000 7f67b79db700 1 --2- 172.21.15.158:0/2390526480 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67b0063380 0x7f67b01511c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f67a8009f20 tx=0x7f67a8009840).stop 2023-10-18T17:26:00.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.236+0000 7f67b79db700 1 -- 172.21.15.158:0/2390526480 shutdown_connections 2023-10-18T17:26:00.243 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.236+0000 7f67b79db700 1 --2- 172.21.15.158:0/2390526480 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67b0063380 0x7f67b01511c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:00.243 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.236+0000 7f67b79db700 1 --2- 172.21.15.158:0/2390526480 >> v2:172.21.15.183:3300/0 conn(0x7f67b00688c0 0x7f67b0068ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:00.243 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.236+0000 7f67b79db700 1 -- 172.21.15.158:0/2390526480 >> 172.21.15.158:0/2390526480 conn(0x7f67b00c3410 msgr2=0x7f67b00bf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:00.243 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.236+0000 7f67b79db700 1 -- 172.21.15.158:0/2390526480 shutdown_connections 2023-10-18T17:26:00.243 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.236+0000 7f67b79db700 1 -- 172.21.15.158:0/2390526480 wait complete. 2023-10-18T17:26:00.244 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.240+0000 7f67b79db700 1 Processor -- start 2023-10-18T17:26:00.244 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.240+0000 7f67b79db700 1 -- start start 2023-10-18T17:26:00.246 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.240+0000 7f67b79db700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67b0063380 0x7f67b00aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:00.246 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.240+0000 7f67b79db700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f67b00688c0 0x7f67b00bf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:00.246 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.240+0000 7f67b79db700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67b0154b10 0x7f67b014caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:00.246 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.240+0000 7f67b79db700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b01644f0 con 0x7f67b00688c0 2023-10-18T17:26:00.247 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.240+0000 7f67b79db700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b01652f0 con 0x7f67b0063380 2023-10-18T17:26:00.247 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.240+0000 7f67b79db700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b01646e0 con 0x7f67b0154b10 2023-10-18T17:26:00.247 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.244+0000 7f67b4f76700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f67b00688c0 0x7f67b00bf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:00.247 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.244+0000 7f67b5777700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67b0063380 0x7f67b00aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:00.248 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.244+0000 7f67b5777700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67b0063380 0x7f67b00aeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:53498/0 (socket says 172.21.15.158:53498) 2023-10-18T17:26:00.249 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.244+0000 7f67b4f76700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f67b00688c0 0x7f67b00bf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:38802/0 (socket says 172.21.15.158:38802) 2023-10-18T17:26:00.249 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.244+0000 7f67b5f78700 1 --2- 172.21.15.158:0/3250503786 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67b0154b10 0x7f67b014caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:00.249 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.244+0000 7f67b5777700 1 -- 172.21.15.158:0/3250503786 learned_addr learned my addr 172.21.15.158:0/3250503786 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:00.249 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.244+0000 7f67b4f76700 1 -- 172.21.15.158:0/3250503786 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67b0154b10 msgr2=0x7f67b014caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:00.250 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.244+0000 7f67b4f76700 1 --2- 172.21.15.158:0/3250503786 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67b0154b10 0x7f67b014caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:00.250 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.244+0000 7f67b4f76700 1 -- 172.21.15.158:0/3250503786 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67b0063380 msgr2=0x7f67b00aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:00.250 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.244+0000 7f67b4f76700 1 --2- 172.21.15.158:0/3250503786 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67b0063380 0x7f67b00aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:00.250 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.244+0000 7f67b4f76700 1 -- 172.21.15.158:0/3250503786 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a8009ae0 con 0x7f67b00688c0 2023-10-18T17:26:00.250 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.244+0000 7f67b4f76700 1 --2- 172.21.15.158:0/3250503786 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f67b00688c0 0x7f67b00bf510 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f67a000c410 tx=0x7f67a0007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:00.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.244+0000 7f67a57fa700 1 -- 172.21.15.158:0/3250503786 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a00070d0 con 0x7f67b00688c0 2023-10-18T17:26:00.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.244+0000 7f67a57fa700 1 -- 172.21.15.158:0/3250503786 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a0007230 con 0x7f67b00688c0 2023-10-18T17:26:00.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.244+0000 7f67b79db700 1 -- 172.21.15.158:0/3250503786 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b01649c0 con 0x7f67b00688c0 2023-10-18T17:26:00.252 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.244+0000 7f67a57fa700 1 -- 172.21.15.158:0/3250503786 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a00075b0 con 0x7f67b00688c0 2023-10-18T17:26:00.252 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.244+0000 7f67b79db700 1 -- 172.21.15.158:0/3250503786 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b0164f80 con 0x7f67b00688c0 2023-10-18T17:26:00.253 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.244+0000 7f67b79db700 1 -- 172.21.15.158:0/3250503786 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b0165430 con 0x7f67b00688c0 2023-10-18T17:26:00.253 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.248+0000 7f67a57fa700 1 -- 172.21.15.158:0/3250503786 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f67a00058f0 con 0x7f67b00688c0 2023-10-18T17:26:00.253 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.248+0000 7f67a57fa700 1 --2- 172.21.15.158:0/3250503786 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f679405a510 0x7f679405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:00.254 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.248+0000 7f67a57fa700 1 -- 172.21.15.158:0/3250503786 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f67a0073f20 con 0x7f67b00688c0 2023-10-18T17:26:00.254 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.248+0000 7f67b5777700 1 --2- 172.21.15.158:0/3250503786 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f679405a510 0x7f679405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:00.254 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.252+0000 7f67b5777700 1 --2- 172.21.15.158:0/3250503786 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f679405a510 0x7f679405c9d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f67ac006920 tx=0x7f67ac006f40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:00.258 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.256+0000 7f67a57fa700 1 -- 172.21.15.158:0/3250503786 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f67b0165430 con 0x7f67b00688c0 2023-10-18T17:26:00.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.448+0000 7f67b79db700 1 -- 172.21.15.158:0/3250503786 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f67b006c190 con 0x7f67b00688c0 2023-10-18T17:26:00.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.448+0000 7f67a57fa700 1 -- 172.21.15.158:0/3250503786 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f67a0018070 con 0x7f67b00688c0 2023-10-18T17:26:00.454 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:26:00.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.452+0000 7f67b79db700 1 -- 172.21.15.158:0/3250503786 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f679405a510 msgr2=0x7f679405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:00.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.452+0000 7f67b79db700 1 --2- 172.21.15.158:0/3250503786 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f679405a510 0x7f679405c9d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f67ac006920 tx=0x7f67ac006f40).stop 2023-10-18T17:26:00.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.452+0000 7f67b79db700 1 -- 172.21.15.158:0/3250503786 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f67b00688c0 msgr2=0x7f67b00bf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:00.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.452+0000 7f67b79db700 1 --2- 172.21.15.158:0/3250503786 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f67b00688c0 0x7f67b00bf510 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f67a000c410 tx=0x7f67a0007d30).stop 2023-10-18T17:26:00.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.452+0000 7f67b79db700 1 -- 172.21.15.158:0/3250503786 shutdown_connections 2023-10-18T17:26:00.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.452+0000 7f67b79db700 1 --2- 172.21.15.158:0/3250503786 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f679405a510 0x7f679405c9d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:00.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.452+0000 7f67b79db700 1 --2- 172.21.15.158:0/3250503786 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67b0154b10 0x7f67b014caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:00.459 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.452+0000 7f67b79db700 1 --2- 172.21.15.158:0/3250503786 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f67b00688c0 0x7f67b00bf510 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:00.459 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.452+0000 7f67b79db700 1 --2- 172.21.15.158:0/3250503786 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67b0063380 0x7f67b00aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:00.459 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.452+0000 7f67b79db700 1 -- 172.21.15.158:0/3250503786 >> 172.21.15.158:0/3250503786 conn(0x7f67b00c3410 msgr2=0x7f67b00c0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:00.459 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.452+0000 7f67b79db700 1 -- 172.21.15.158:0/3250503786 shutdown_connections 2023-10-18T17:26:00.459 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:00.452+0000 7f67b79db700 1 -- 172.21.15.158:0/3250503786 wait complete. 2023-10-18T17:26:00.476 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:26:03.477 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:26:03.640 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.636+0000 7fb89e479700 1 Processor -- start 2023-10-18T17:26:03.640 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.636+0000 7fb89e479700 1 -- start start 2023-10-18T17:26:03.642 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb89e479700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb89814d170 0x7fb89806a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:03.643 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb89e479700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb898067d30 0x7fb8980630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:03.643 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb89e479700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb898068910 con 0x7fb898068180 2023-10-18T17:26:03.643 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb89e479700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb898150c10 con 0x7fb898067d30 2023-10-18T17:26:03.643 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb89e479700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb898150780 con 0x7fb89814d170 2023-10-18T17:26:03.644 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb89cc76700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb898067d30 0x7fb8980630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:03.644 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb89d477700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb89814d170 0x7fb89806a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:03.645 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb89dc78700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fb898068180 0x7fb898065700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:53808/0 (socket says 172.21.15.158:53808) 2023-10-18T17:26:03.645 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb89dc78700 1 -- 172.21.15.158:0/2096849060 learned_addr learned my addr 172.21.15.158:0/2096849060 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:26:03.645 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb89cc76700 1 -- 172.21.15.158:0/2096849060 >> v2:172.21.15.183:3300/0 conn(0x7fb89814d170 msgr2=0x7fb89806a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:26:03.645 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb89cc76700 1 --2- 172.21.15.158:0/2096849060 >> v2:172.21.15.183:3300/0 conn(0x7fb89814d170 0x7fb89806a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:03.645 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb88ffff700 1 -- 172.21.15.158:0/2096849060 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866956966 0 0) 0x7fb898068910 con 0x7fb898068180 2023-10-18T17:26:03.646 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb89cc76700 1 -- 172.21.15.158:0/2096849060 >> v1:172.21.15.183:6789/0 conn(0x7fb898068180 legacy=0x7fb898065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:03.646 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb89cc76700 1 -- 172.21.15.158:0/2096849060 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb898068630 con 0x7fb898067d30 2023-10-18T17:26:03.646 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb89cc76700 1 --2- 172.21.15.158:0/2096849060 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb898067d30 0x7fb8980630e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fb898063070 tx=0x7fb888009060).ready entity=mon.0 client_cookie=98f28844d1d91b60 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:03.647 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb88ffff700 1 -- 172.21.15.158:0/2096849060 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88800f510 con 0x7fb898067d30 2023-10-18T17:26:03.648 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb88ffff700 1 -- 172.21.15.158:0/2096849060 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88800f670 con 0x7fb898067d30 2023-10-18T17:26:03.648 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb88ffff700 1 -- 172.21.15.158:0/2096849060 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88800f9f0 con 0x7fb898067d30 2023-10-18T17:26:03.649 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb89e479700 1 -- 172.21.15.158:0/2096849060 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb898067d30 msgr2=0x7fb8980630e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:03.649 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.640+0000 7fb89e479700 1 --2- 172.21.15.158:0/2096849060 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb898067d30 0x7fb8980630e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fb898063070 tx=0x7fb888009060).stop 2023-10-18T17:26:03.649 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.644+0000 7fb89e479700 1 -- 172.21.15.158:0/2096849060 shutdown_connections 2023-10-18T17:26:03.649 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.644+0000 7fb89e479700 1 --2- 172.21.15.158:0/2096849060 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb898067d30 0x7fb8980630e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:03.649 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.644+0000 7fb89e479700 1 --2- 172.21.15.158:0/2096849060 >> v2:172.21.15.183:3300/0 conn(0x7fb89814d170 0x7fb89806a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:03.650 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.644+0000 7fb89e479700 1 -- 172.21.15.158:0/2096849060 >> 172.21.15.158:0/2096849060 conn(0x7fb898062ba0 msgr2=0x7fb8980c6330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:03.650 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.644+0000 7fb89e479700 1 -- 172.21.15.158:0/2096849060 shutdown_connections 2023-10-18T17:26:03.650 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.644+0000 7fb89e479700 1 -- 172.21.15.158:0/2096849060 wait complete. 2023-10-18T17:26:03.651 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.644+0000 7fb89e479700 1 Processor -- start 2023-10-18T17:26:03.651 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.644+0000 7fb89e479700 1 -- start start 2023-10-18T17:26:03.652 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb89e479700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb898067d30 0x7fb898151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:03.652 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb89e479700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb898068180 0x7fb898153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:03.653 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb89e479700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb89814d170 0x7fb898152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:03.653 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb89e479700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8980bf500 con 0x7fb89814d170 2023-10-18T17:26:03.653 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb89e479700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb898160f80 con 0x7fb898067d30 2023-10-18T17:26:03.653 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb89e479700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb898161200 con 0x7fb898068180 2023-10-18T17:26:03.653 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb89d477700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb898067d30 0x7fb898151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:03.654 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb89d477700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb898067d30 0x7fb898151c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:53526/0 (socket says 172.21.15.158:53526) 2023-10-18T17:26:03.654 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb89d477700 1 -- 172.21.15.158:0/2237722265 learned_addr learned my addr 172.21.15.158:0/2237722265 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:03.654 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb89cc76700 1 --2- 172.21.15.158:0/2237722265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb898068180 0x7fb898153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:03.654 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb89dc78700 1 --2- 172.21.15.158:0/2237722265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb89814d170 0x7fb898152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:03.656 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb89d477700 1 -- 172.21.15.158:0/2237722265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb898068180 msgr2=0x7fb898153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:03.656 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb89d477700 1 --2- 172.21.15.158:0/2237722265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb898068180 0x7fb898153ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:03.656 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb89d477700 1 -- 172.21.15.158:0/2237722265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb89814d170 msgr2=0x7fb898152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:03.656 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb89d477700 1 --2- 172.21.15.158:0/2237722265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb89814d170 0x7fb898152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:03.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb89d477700 1 -- 172.21.15.158:0/2237722265 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8880092a0 con 0x7fb898067d30 2023-10-18T17:26:03.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb89d477700 1 --2- 172.21.15.158:0/2237722265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb898067d30 0x7fb898151c10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fb89400e900 tx=0x7fb894009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:03.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb88d7fa700 1 -- 172.21.15.158:0/2237722265 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894012600 con 0x7fb898067d30 2023-10-18T17:26:03.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb88d7fa700 1 -- 172.21.15.158:0/2237722265 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb894012760 con 0x7fb898067d30 2023-10-18T17:26:03.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.648+0000 7fb89e479700 1 -- 172.21.15.158:0/2237722265 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8980c0260 con 0x7fb898067d30 2023-10-18T17:26:03.658 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.652+0000 7fb88d7fa700 1 -- 172.21.15.158:0/2237722265 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894012ae0 con 0x7fb898067d30 2023-10-18T17:26:03.658 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.652+0000 7fb89e479700 1 -- 172.21.15.158:0/2237722265 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8981532b0 con 0x7fb898067d30 2023-10-18T17:26:03.659 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.652+0000 7fb89e479700 1 -- 172.21.15.158:0/2237722265 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb898046f00 con 0x7fb898067d30 2023-10-18T17:26:03.659 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.652+0000 7fb88d7fa700 1 -- 172.21.15.158:0/2237722265 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb89401b400 con 0x7fb898067d30 2023-10-18T17:26:03.660 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.656+0000 7fb88d7fa700 1 --2- 172.21.15.158:0/2237722265 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb87c05a510 0x7fb87c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:03.660 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.656+0000 7fb88d7fa700 1 -- 172.21.15.158:0/2237722265 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fb894074e90 con 0x7fb898067d30 2023-10-18T17:26:03.660 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.656+0000 7fb89cc76700 1 --2- 172.21.15.158:0/2237722265 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb87c05a510 0x7fb87c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:03.660 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.656+0000 7fb89cc76700 1 --2- 172.21.15.158:0/2237722265 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb87c05a510 0x7fb87c05c9d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fb8980beeb0 tx=0x7fb888017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:03.670 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.668+0000 7fb88d7fa700 1 -- 172.21.15.158:0/2237722265 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fb8940482f0 con 0x7fb898067d30 2023-10-18T17:26:03.875 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.872+0000 7fb89e479700 1 -- 172.21.15.158:0/2237722265 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb8980661a0 con 0x7fb898067d30 2023-10-18T17:26:03.876 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.872+0000 7fb88d7fa700 1 -- 172.21.15.158:0/2237722265 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fb8940760e0 con 0x7fb898067d30 2023-10-18T17:26:03.876 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:26:03.879 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.876+0000 7fb89e479700 1 -- 172.21.15.158:0/2237722265 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb87c05a510 msgr2=0x7fb87c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:03.879 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.876+0000 7fb89e479700 1 --2- 172.21.15.158:0/2237722265 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb87c05a510 0x7fb87c05c9d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fb8980beeb0 tx=0x7fb888017000).stop 2023-10-18T17:26:03.879 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.876+0000 7fb89e479700 1 -- 172.21.15.158:0/2237722265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb898067d30 msgr2=0x7fb898151c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:03.879 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.876+0000 7fb89e479700 1 --2- 172.21.15.158:0/2237722265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb898067d30 0x7fb898151c10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fb89400e900 tx=0x7fb894009060).stop 2023-10-18T17:26:03.880 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.876+0000 7fb89e479700 1 -- 172.21.15.158:0/2237722265 shutdown_connections 2023-10-18T17:26:03.880 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.876+0000 7fb89e479700 1 --2- 172.21.15.158:0/2237722265 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb87c05a510 0x7fb87c05c9d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:03.881 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.876+0000 7fb89e479700 1 --2- 172.21.15.158:0/2237722265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb89814d170 0x7fb898152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:03.881 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.876+0000 7fb89e479700 1 --2- 172.21.15.158:0/2237722265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb898068180 0x7fb898153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:03.881 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.876+0000 7fb89e479700 1 --2- 172.21.15.158:0/2237722265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb898067d30 0x7fb898151c10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:03.881 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.876+0000 7fb89e479700 1 -- 172.21.15.158:0/2237722265 >> 172.21.15.158:0/2237722265 conn(0x7fb898062ba0 msgr2=0x7fb898069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:03.881 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.876+0000 7fb89e479700 1 -- 172.21.15.158:0/2237722265 shutdown_connections 2023-10-18T17:26:03.882 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:03.876+0000 7fb89e479700 1 -- 172.21.15.158:0/2237722265 wait complete. 2023-10-18T17:26:03.897 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:26:04.062 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:26:04.070 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:26:04.875 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~58s 2023-10-18T17:26:04.875 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~113s 2023-10-18T17:26:04.875 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~38s 2023-10-18T17:26:04.875 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~25s 2023-10-18T17:26:04.876 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~72s 2023-10-18T17:26:04.876 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~13s 2023-10-18T17:26:06.899 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:26:07.064 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.060+0000 7f074da39700 1 Processor -- start 2023-10-18T17:26:07.064 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.060+0000 7f074da39700 1 -- start start 2023-10-18T17:26:07.065 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.060+0000 7f074da39700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0748150fe0 0x7f0748069740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:07.065 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.060+0000 7f074da39700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f07480c0000 0x7f07480c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:07.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.060+0000 7f074da39700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0748068960 con 0x7f07481513c0 2023-10-18T17:26:07.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.060+0000 7f074da39700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0748063ab0 con 0x7f0748150fe0 2023-10-18T17:26:07.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.060+0000 7f074da39700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0748069c30 con 0x7f07480c0000 2023-10-18T17:26:07.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f074ca37700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0748150fe0 0x7f0748069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:07.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f074d238700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f07481513c0 0x7f074814dc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:53818/0 (socket says 172.21.15.158:53818) 2023-10-18T17:26:07.068 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f074d238700 1 -- 172.21.15.158:0/3954342300 learned_addr learned my addr 172.21.15.158:0/3954342300 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:26:07.068 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f073ffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f07480c0000 0x7f07480c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:07.068 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f074ca37700 1 -- 172.21.15.158:0/3954342300 >> v2:172.21.15.183:3300/0 conn(0x7f07480c0000 msgr2=0x7f07480c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:26:07.069 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f074ca37700 1 --2- 172.21.15.158:0/3954342300 >> v2:172.21.15.183:3300/0 conn(0x7f07480c0000 0x7f07480c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:07.069 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f074ca37700 1 -- 172.21.15.158:0/3954342300 >> v1:172.21.15.183:6789/0 conn(0x7f07481513c0 legacy=0x7f074814dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:07.069 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f074ca37700 1 -- 172.21.15.158:0/3954342300 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0748064000 con 0x7f0748150fe0 2023-10-18T17:26:07.069 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f073f7fe700 1 -- 172.21.15.158:0/3954342300 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257669566 0 0) 0x7f0748068960 con 0x7f07481513c0 2023-10-18T17:26:07.069 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f074ca37700 1 --2- 172.21.15.158:0/3954342300 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0748150fe0 0x7f0748069740 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f07480be6f0 tx=0x7f0744009780).ready entity=mon.0 client_cookie=19ff252613c38b4d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:07.070 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f073f7fe700 1 -- 172.21.15.158:0/3954342300 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074400e070 con 0x7f0748150fe0 2023-10-18T17:26:07.070 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f073f7fe700 1 -- 172.21.15.158:0/3954342300 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074400bb60 con 0x7f0748150fe0 2023-10-18T17:26:07.070 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f073f7fe700 1 -- 172.21.15.158:0/3954342300 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0744012410 con 0x7f0748150fe0 2023-10-18T17:26:07.071 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f074da39700 1 -- 172.21.15.158:0/3954342300 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0748150fe0 msgr2=0x7f0748069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:07.071 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f074da39700 1 --2- 172.21.15.158:0/3954342300 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0748150fe0 0x7f0748069740 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f07480be6f0 tx=0x7f0744009780).stop 2023-10-18T17:26:07.072 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f074da39700 1 -- 172.21.15.158:0/3954342300 shutdown_connections 2023-10-18T17:26:07.072 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f074da39700 1 --2- 172.21.15.158:0/3954342300 >> v2:172.21.15.183:3300/0 conn(0x7f07480c0000 0x7f07480c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:07.072 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f074da39700 1 --2- 172.21.15.158:0/3954342300 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0748150fe0 0x7f0748069740 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:07.072 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f074da39700 1 -- 172.21.15.158:0/3954342300 >> 172.21.15.158:0/3954342300 conn(0x7f0748062b50 msgr2=0x7f0748067b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:07.073 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f074da39700 1 -- 172.21.15.158:0/3954342300 shutdown_connections 2023-10-18T17:26:07.073 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.064+0000 7f074da39700 1 -- 172.21.15.158:0/3954342300 wait complete. 2023-10-18T17:26:07.073 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.068+0000 7f074da39700 1 Processor -- start 2023-10-18T17:26:07.074 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.068+0000 7f074da39700 1 -- start start 2023-10-18T17:26:07.075 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.068+0000 7f074da39700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07480c0000 0x7f07480c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:07.075 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.068+0000 7f074da39700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0748150fe0 0x7f0748149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:07.075 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f074da39700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f07481513c0 0x7f07481462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:07.076 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f074da39700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07480bb0b0 con 0x7f07481513c0 2023-10-18T17:26:07.076 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f074da39700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07480c50f0 con 0x7f07480c0000 2023-10-18T17:26:07.076 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f074da39700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07480bcba0 con 0x7f0748150fe0 2023-10-18T17:26:07.076 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f074ca37700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07480c0000 0x7f07480c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:07.076 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f074ca37700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07480c0000 0x7f07480c4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:53546/0 (socket says 172.21.15.158:53546) 2023-10-18T17:26:07.077 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f074ca37700 1 -- 172.21.15.158:0/2945727988 learned_addr learned my addr 172.21.15.158:0/2945727988 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:07.077 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f074d238700 1 --2- 172.21.15.158:0/2945727988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f07481513c0 0x7f07481462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:07.077 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f073ffff700 1 --2- 172.21.15.158:0/2945727988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0748150fe0 0x7f0748149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:07.079 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f074d238700 1 -- 172.21.15.158:0/2945727988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0748150fe0 msgr2=0x7f0748149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:07.079 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f074d238700 1 --2- 172.21.15.158:0/2945727988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0748150fe0 0x7f0748149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:07.079 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f074d238700 1 -- 172.21.15.158:0/2945727988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07480c0000 msgr2=0x7f07480c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:07.079 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f074d238700 1 --2- 172.21.15.158:0/2945727988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07480c0000 0x7f07480c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:07.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f074d238700 1 -- 172.21.15.158:0/2945727988 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0744009a20 con 0x7f07481513c0 2023-10-18T17:26:07.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f074ca37700 1 --2- 172.21.15.158:0/2945727988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07480c0000 0x7f07480c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:26:07.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f074d238700 1 --2- 172.21.15.158:0/2945727988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f07481513c0 0x7f07481462a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f074000c4f0 tx=0x7f0740007d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:07.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f073cff9700 1 -- 172.21.15.158:0/2945727988 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07400070d0 con 0x7f07481513c0 2023-10-18T17:26:07.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f073cff9700 1 -- 172.21.15.158:0/2945727988 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0740007230 con 0x7f07481513c0 2023-10-18T17:26:07.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f073cff9700 1 -- 172.21.15.158:0/2945727988 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07400075d0 con 0x7f07481513c0 2023-10-18T17:26:07.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f074da39700 1 -- 172.21.15.158:0/2945727988 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07480c4e80 con 0x7f07481513c0 2023-10-18T17:26:07.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.072+0000 7f074da39700 1 -- 172.21.15.158:0/2945727988 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07480bc300 con 0x7f07481513c0 2023-10-18T17:26:07.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.076+0000 7f074da39700 1 -- 172.21.15.158:0/2945727988 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0748046f00 con 0x7f07481513c0 2023-10-18T17:26:07.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.076+0000 7f073cff9700 1 -- 172.21.15.158:0/2945727988 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f07400059b0 con 0x7f07481513c0 2023-10-18T17:26:07.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.076+0000 7f073cff9700 1 --2- 172.21.15.158:0/2945727988 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f073405a510 0x7f073405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:07.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.076+0000 7f073cff9700 1 -- 172.21.15.158:0/2945727988 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f0740073f50 con 0x7f07481513c0 2023-10-18T17:26:07.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.076+0000 7f074ca37700 1 --2- 172.21.15.158:0/2945727988 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f073405a510 0x7f073405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:07.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.076+0000 7f074ca37700 1 --2- 172.21.15.158:0/2945727988 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f073405a510 0x7f073405c9d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f07440097c0 tx=0x7f074814d8f0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:07.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.084+0000 7f073cff9700 1 -- 172.21.15.158:0/2945727988 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f07400474d0 con 0x7f07481513c0 2023-10-18T17:26:07.279 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.276+0000 7f074da39700 1 -- 172.21.15.158:0/2945727988 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0748067220 con 0x7f07481513c0 2023-10-18T17:26:07.280 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.276+0000 7f073cff9700 1 -- 172.21.15.158:0/2945727988 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f074004aaf0 con 0x7f07481513c0 2023-10-18T17:26:07.280 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:26:07.282 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.280+0000 7f074da39700 1 -- 172.21.15.158:0/2945727988 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f073405a510 msgr2=0x7f073405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:07.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.280+0000 7f074da39700 1 --2- 172.21.15.158:0/2945727988 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f073405a510 0x7f073405c9d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f07440097c0 tx=0x7f074814d8f0).stop 2023-10-18T17:26:07.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.280+0000 7f074da39700 1 -- 172.21.15.158:0/2945727988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f07481513c0 msgr2=0x7f07481462a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:07.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.280+0000 7f074da39700 1 --2- 172.21.15.158:0/2945727988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f07481513c0 0x7f07481462a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f074000c4f0 tx=0x7f0740007d50).stop 2023-10-18T17:26:07.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.280+0000 7f074da39700 1 -- 172.21.15.158:0/2945727988 shutdown_connections 2023-10-18T17:26:07.284 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.280+0000 7f074da39700 1 --2- 172.21.15.158:0/2945727988 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f073405a510 0x7f073405c9d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:07.284 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.280+0000 7f074da39700 1 --2- 172.21.15.158:0/2945727988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f07481513c0 0x7f07481462a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:07.284 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.280+0000 7f074da39700 1 --2- 172.21.15.158:0/2945727988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0748150fe0 0x7f0748149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:07.284 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.280+0000 7f074da39700 1 --2- 172.21.15.158:0/2945727988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07480c0000 0x7f07480c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:07.284 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.280+0000 7f074da39700 1 -- 172.21.15.158:0/2945727988 >> 172.21.15.158:0/2945727988 conn(0x7f0748062b50 msgr2=0x7f07480bf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:07.285 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.280+0000 7f074da39700 1 -- 172.21.15.158:0/2945727988 shutdown_connections 2023-10-18T17:26:07.285 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:07.280+0000 7f074da39700 1 -- 172.21.15.158:0/2945727988 wait complete. 2023-10-18T17:26:07.301 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:26:10.302 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:26:10.466 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.464+0000 7fa885769700 1 Processor -- start 2023-10-18T17:26:10.467 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.464+0000 7fa885769700 1 -- start start 2023-10-18T17:26:10.468 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.464+0000 7fa885769700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa88014b5b0 0x7fa8800bcd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:10.468 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.464+0000 7fa885769700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa8800bf8d0 0x7fa8800bd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:10.468 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.464+0000 7fa885769700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88014dd30 con 0x7fa88014b1d0 2023-10-18T17:26:10.468 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.464+0000 7fa885769700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa880062430 con 0x7fa8800bf8d0 2023-10-18T17:26:10.468 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.464+0000 7fa885769700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa880062710 con 0x7fa88014b5b0 2023-10-18T17:26:10.470 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.464+0000 7fa87ffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa8800bf8d0 0x7fa8800bd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:10.470 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.464+0000 7fa87ffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa8800bf8d0 0x7fa8800bd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:46164/0 (socket says 172.21.15.158:46164) 2023-10-18T17:26:10.470 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.464+0000 7fa87ffff700 1 -- 172.21.15.158:0/3968209361 learned_addr learned my addr 172.21.15.158:0/3968209361 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:10.471 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.464+0000 7fa877fff700 1 --2- 172.21.15.158:0/3968209361 >> v2:172.21.15.183:3300/0 conn(0x7fa88014b5b0 0x7fa8800bcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:10.471 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.464+0000 7fa87ffff700 1 -- 172.21.15.158:0/3968209361 >> v2:172.21.15.183:3300/0 conn(0x7fa88014b5b0 msgr2=0x7fa8800bcd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:26:10.471 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.464+0000 7fa87ffff700 1 --2- 172.21.15.158:0/3968209361 >> v2:172.21.15.183:3300/0 conn(0x7fa88014b5b0 0x7fa8800bcd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:10.471 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.464+0000 7fa87ffff700 1 -- 172.21.15.158:0/3968209361 >> v1:172.21.15.183:6789/0 conn(0x7fa88014b1d0 legacy=0x7fa88014e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:10.472 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.464+0000 7fa87ffff700 1 -- 172.21.15.158:0/3968209361 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8800629f0 con 0x7fa8800bf8d0 2023-10-18T17:26:10.472 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.464+0000 7fa87ffff700 1 --2- 172.21.15.158:0/3968209361 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8800bf8d0 0x7fa8800bd260 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fa880066aa0 tx=0x7fa878009840).ready entity=mon.0 client_cookie=74cdb6b987f97e2d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:10.472 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.464+0000 7fa87e7fc700 1 -- 172.21.15.158:0/3968209361 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87800e070 con 0x7fa8800bf8d0 2023-10-18T17:26:10.472 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.464+0000 7fa87e7fc700 1 -- 172.21.15.158:0/3968209361 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87800ba50 con 0x7fa8800bf8d0 2023-10-18T17:26:10.473 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.464+0000 7fa87e7fc700 1 -- 172.21.15.158:0/3968209361 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87800bdd0 con 0x7fa8800bf8d0 2023-10-18T17:26:10.474 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.468+0000 7fa885769700 1 -- 172.21.15.158:0/3968209361 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8800bf8d0 msgr2=0x7fa8800bd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:10.474 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.468+0000 7fa885769700 1 --2- 172.21.15.158:0/3968209361 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8800bf8d0 0x7fa8800bd260 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fa880066aa0 tx=0x7fa878009840).stop 2023-10-18T17:26:10.474 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.468+0000 7fa885769700 1 -- 172.21.15.158:0/3968209361 shutdown_connections 2023-10-18T17:26:10.474 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.468+0000 7fa885769700 1 --2- 172.21.15.158:0/3968209361 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8800bf8d0 0x7fa8800bd260 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:10.475 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.468+0000 7fa885769700 1 --2- 172.21.15.158:0/3968209361 >> v2:172.21.15.183:3300/0 conn(0x7fa88014b5b0 0x7fa8800bcd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:10.475 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.468+0000 7fa885769700 1 -- 172.21.15.158:0/3968209361 >> 172.21.15.158:0/3968209361 conn(0x7fa8800699e0 msgr2=0x7fa880069df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:10.475 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.468+0000 7fa885769700 1 -- 172.21.15.158:0/3968209361 shutdown_connections 2023-10-18T17:26:10.475 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.468+0000 7fa885769700 1 -- 172.21.15.158:0/3968209361 wait complete. 2023-10-18T17:26:10.476 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa885769700 1 Processor -- start 2023-10-18T17:26:10.478 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa885769700 1 -- start start 2023-10-18T17:26:10.478 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa885769700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8800bf8d0 0x7fa880151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:10.478 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa885769700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa88014b1d0 0x7fa880161d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:10.478 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa885769700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa880063560 0x7fa880150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:10.479 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa885769700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa880162240 con 0x7fa8800bf8d0 2023-10-18T17:26:10.479 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa885769700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa880150190 con 0x7fa880063560 2023-10-18T17:26:10.479 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa885769700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa880151b20 con 0x7fa88014b1d0 2023-10-18T17:26:10.479 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa87effd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8800bf8d0 0x7fa880151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:10.480 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa87effd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8800bf8d0 0x7fa880151310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:46176/0 (socket says 172.21.15.158:46176) 2023-10-18T17:26:10.480 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa87effd700 1 -- 172.21.15.158:0/1526666196 learned_addr learned my addr 172.21.15.158:0/1526666196 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:10.480 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa87ffff700 1 --2- 172.21.15.158:0/1526666196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa880063560 0x7fa880150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:10.480 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa877fff700 1 --2- 172.21.15.158:0/1526666196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa88014b1d0 0x7fa880161d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:10.480 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa87effd700 1 -- 172.21.15.158:0/1526666196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa88014b1d0 msgr2=0x7fa880161d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:10.481 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa87effd700 1 --2- 172.21.15.158:0/1526666196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa88014b1d0 0x7fa880161d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:10.481 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa87effd700 1 -- 172.21.15.158:0/1526666196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa880063560 msgr2=0x7fa880150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:10.481 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa87effd700 1 --2- 172.21.15.158:0/1526666196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa880063560 0x7fa880150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:10.481 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa87effd700 1 -- 172.21.15.158:0/1526666196 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa878009ae0 con 0x7fa8800bf8d0 2023-10-18T17:26:10.481 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa87effd700 1 --2- 172.21.15.158:0/1526666196 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8800bf8d0 0x7fa880151310 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fa87000c440 tx=0x7fa870007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:10.482 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa876ffd700 1 -- 172.21.15.158:0/1526666196 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87000ce40 con 0x7fa8800bf8d0 2023-10-18T17:26:10.482 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa876ffd700 1 -- 172.21.15.158:0/1526666196 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa870007020 con 0x7fa8800bf8d0 2023-10-18T17:26:10.482 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.472+0000 7fa876ffd700 1 -- 172.21.15.158:0/1526666196 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8700073e0 con 0x7fa8800bf8d0 2023-10-18T17:26:10.482 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.476+0000 7fa885769700 1 -- 172.21.15.158:0/1526666196 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8801520c0 con 0x7fa8800bf8d0 2023-10-18T17:26:10.482 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.476+0000 7fa885769700 1 -- 172.21.15.158:0/1526666196 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8800b9e80 con 0x7fa8800bf8d0 2023-10-18T17:26:10.483 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.476+0000 7fa885769700 1 -- 172.21.15.158:0/1526666196 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88006c190 con 0x7fa8800bf8d0 2023-10-18T17:26:10.484 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.476+0000 7fa876ffd700 1 -- 172.21.15.158:0/1526666196 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa8700068b0 con 0x7fa8800bf8d0 2023-10-18T17:26:10.484 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.476+0000 7fa876ffd700 1 --2- 172.21.15.158:0/1526666196 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fa86005a540 0x7fa86005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:10.484 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.480+0000 7fa876ffd700 1 -- 172.21.15.158:0/1526666196 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fa870073c50 con 0x7fa8800bf8d0 2023-10-18T17:26:10.484 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.480+0000 7fa877fff700 1 --2- 172.21.15.158:0/1526666196 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fa86005a540 0x7fa86005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:10.484 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.480+0000 7fa877fff700 1 --2- 172.21.15.158:0/1526666196 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fa86005a540 0x7fa86005ca00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fa868006920 tx=0x7fa868008040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:10.491 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.488+0000 7fa876ffd700 1 -- 172.21.15.158:0/1526666196 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fa870079020 con 0x7fa8800bf8d0 2023-10-18T17:26:10.696 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.692+0000 7fa885769700 1 -- 172.21.15.158:0/1526666196 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa8800c0880 con 0x7fa8800bf8d0 2023-10-18T17:26:10.697 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.692+0000 7fa876ffd700 1 -- 172.21.15.158:0/1526666196 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fa8700471d0 con 0x7fa8800bf8d0 2023-10-18T17:26:10.697 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:26:10.700 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.696+0000 7fa885769700 1 -- 172.21.15.158:0/1526666196 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fa86005a540 msgr2=0x7fa86005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:10.700 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.696+0000 7fa885769700 1 --2- 172.21.15.158:0/1526666196 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fa86005a540 0x7fa86005ca00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fa868006920 tx=0x7fa868008040).stop 2023-10-18T17:26:10.700 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.696+0000 7fa885769700 1 -- 172.21.15.158:0/1526666196 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8800bf8d0 msgr2=0x7fa880151310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:10.700 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.696+0000 7fa885769700 1 --2- 172.21.15.158:0/1526666196 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8800bf8d0 0x7fa880151310 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fa87000c440 tx=0x7fa870007e00).stop 2023-10-18T17:26:10.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.696+0000 7fa885769700 1 -- 172.21.15.158:0/1526666196 shutdown_connections 2023-10-18T17:26:10.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.696+0000 7fa885769700 1 --2- 172.21.15.158:0/1526666196 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fa86005a540 0x7fa86005ca00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:10.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.696+0000 7fa885769700 1 --2- 172.21.15.158:0/1526666196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa880063560 0x7fa880150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:10.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.696+0000 7fa885769700 1 --2- 172.21.15.158:0/1526666196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa88014b1d0 0x7fa880161d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:10.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.696+0000 7fa885769700 1 --2- 172.21.15.158:0/1526666196 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8800bf8d0 0x7fa880151310 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:10.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.696+0000 7fa885769700 1 -- 172.21.15.158:0/1526666196 >> 172.21.15.158:0/1526666196 conn(0x7fa8800699e0 msgr2=0x7fa88014a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:10.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.696+0000 7fa885769700 1 -- 172.21.15.158:0/1526666196 shutdown_connections 2023-10-18T17:26:10.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:10.696+0000 7fa885769700 1 -- 172.21.15.158:0/1526666196 wait complete. 2023-10-18T17:26:10.720 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:26:11.188 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~65s 2023-10-18T17:26:11.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~119s 2023-10-18T17:26:11.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~45s 2023-10-18T17:26:11.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~32s 2023-10-18T17:26:11.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~78s 2023-10-18T17:26:11.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~19s 2023-10-18T17:26:13.721 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:26:13.882 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.880+0000 7f93bf3b9700 1 Processor -- start 2023-10-18T17:26:13.883 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.880+0000 7f93bf3b9700 1 -- start start 2023-10-18T17:26:13.884 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.880+0000 7f93bf3b9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f93b80658a0 0x7f93b8065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:13.885 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.880+0000 7f93bf3b9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f93b80c2bf0 0x7f93b80630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:13.885 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.880+0000 7f93bf3b9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93b80635d0 0x7f93b8151290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:13.885 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.880+0000 7f93bf3b9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b80bda80 con 0x7f93b80658a0 2023-10-18T17:26:13.885 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.880+0000 7f93bf3b9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b806a7c0 con 0x7f93b80c2bf0 2023-10-18T17:26:13.885 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.880+0000 7f93bf3b9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b80be2e0 con 0x7f93b80635d0 2023-10-18T17:26:13.886 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.880+0000 7f93be3b7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f93b80658a0 0x7f93b8065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:13.886 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.880+0000 7f93be3b7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f93b80658a0 0x7f93b8065c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:46178/0 (socket says 172.21.15.158:46178) 2023-10-18T17:26:13.886 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.880+0000 7f93be3b7700 1 -- 172.21.15.158:0/959256753 learned_addr learned my addr 172.21.15.158:0/959256753 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:13.886 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.880+0000 7f93bdbb6700 1 --2- 172.21.15.158:0/959256753 >> v2:172.21.15.183:3300/0 conn(0x7f93b80c2bf0 0x7f93b80630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:13.888 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.880+0000 7f93bebb8700 1 --2- 172.21.15.158:0/959256753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93b80635d0 0x7f93b8151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:13.888 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.880+0000 7f93be3b7700 1 -- 172.21.15.158:0/959256753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93b80635d0 msgr2=0x7f93b8151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:26:13.888 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.880+0000 7f93be3b7700 1 --2- 172.21.15.158:0/959256753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93b80635d0 0x7f93b8151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:13.888 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.880+0000 7f93be3b7700 1 -- 172.21.15.158:0/959256753 >> v2:172.21.15.183:3300/0 conn(0x7f93b80c2bf0 msgr2=0x7f93b80630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:26:13.888 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.880+0000 7f93be3b7700 1 --2- 172.21.15.158:0/959256753 >> v2:172.21.15.183:3300/0 conn(0x7f93b80c2bf0 0x7f93b80630e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:13.889 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.880+0000 7f93be3b7700 1 -- 172.21.15.158:0/959256753 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b80be770 con 0x7f93b80658a0 2023-10-18T17:26:13.889 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.880+0000 7f93be3b7700 1 --2- 172.21.15.158:0/959256753 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93b80658a0 0x7f93b8065c80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f93b8066170 tx=0x7f93b40090f0).ready entity=mon.0 client_cookie=fe498dd6a4dbdc1f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:13.889 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.884+0000 7f93bd3b5700 1 -- 172.21.15.158:0/959256753 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b400b520 con 0x7f93b80658a0 2023-10-18T17:26:13.889 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.884+0000 7f93bd3b5700 1 -- 172.21.15.158:0/959256753 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b400b680 con 0x7f93b80658a0 2023-10-18T17:26:13.889 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.884+0000 7f93bd3b5700 1 -- 172.21.15.158:0/959256753 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b400ba00 con 0x7f93b80658a0 2023-10-18T17:26:13.890 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.884+0000 7f93bf3b9700 1 -- 172.21.15.158:0/959256753 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93b80658a0 msgr2=0x7f93b8065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:13.890 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.884+0000 7f93bf3b9700 1 --2- 172.21.15.158:0/959256753 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93b80658a0 0x7f93b8065c80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f93b8066170 tx=0x7f93b40090f0).stop 2023-10-18T17:26:13.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.884+0000 7f93bf3b9700 1 -- 172.21.15.158:0/959256753 shutdown_connections 2023-10-18T17:26:13.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.884+0000 7f93bf3b9700 1 --2- 172.21.15.158:0/959256753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93b80635d0 0x7f93b8151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:13.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.884+0000 7f93bf3b9700 1 --2- 172.21.15.158:0/959256753 >> v2:172.21.15.183:3300/0 conn(0x7f93b80c2bf0 0x7f93b80630e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:13.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.884+0000 7f93bf3b9700 1 --2- 172.21.15.158:0/959256753 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93b80658a0 0x7f93b8065c80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:13.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.884+0000 7f93bf3b9700 1 -- 172.21.15.158:0/959256753 >> 172.21.15.158:0/959256753 conn(0x7f93b8062ba0 msgr2=0x7f93b80c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:13.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.884+0000 7f93bf3b9700 1 -- 172.21.15.158:0/959256753 shutdown_connections 2023-10-18T17:26:13.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.884+0000 7f93bf3b9700 1 -- 172.21.15.158:0/959256753 wait complete. 2023-10-18T17:26:13.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.888+0000 7f93bf3b9700 1 Processor -- start 2023-10-18T17:26:13.893 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.888+0000 7f93bf3b9700 1 -- start start 2023-10-18T17:26:13.894 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.888+0000 7f93bf3b9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93b80635d0 0x7f93b8162070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:13.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93bf3b9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93b80658a0 0x7f93b80a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:13.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93bf3b9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93b80c2bf0 0x7f93b81513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:13.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93bf3b9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b8150eb0 con 0x7f93b80c2bf0 2023-10-18T17:26:13.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93bf3b9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b8162560 con 0x7f93b80658a0 2023-10-18T17:26:13.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93bf3b9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b80a1b30 con 0x7f93b80635d0 2023-10-18T17:26:13.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93be3b7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93b80635d0 0x7f93b8162070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:13.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93be3b7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93b80635d0 0x7f93b8162070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:55070/0 (socket says 172.21.15.158:55070) 2023-10-18T17:26:13.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93be3b7700 1 -- 172.21.15.158:0/2925459389 learned_addr learned my addr 172.21.15.158:0/2925459389 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:13.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93bdbb6700 1 --2- 172.21.15.158:0/2925459389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93b80658a0 0x7f93b80a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:13.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93bebb8700 1 --2- 172.21.15.158:0/2925459389 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93b80c2bf0 0x7f93b81513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:13.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93be3b7700 1 -- 172.21.15.158:0/2925459389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93b80658a0 msgr2=0x7f93b80a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:13.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93be3b7700 1 --2- 172.21.15.158:0/2925459389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93b80658a0 0x7f93b80a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:13.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93be3b7700 1 -- 172.21.15.158:0/2925459389 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93b80c2bf0 msgr2=0x7f93b81513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:13.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93be3b7700 1 --2- 172.21.15.158:0/2925459389 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93b80c2bf0 0x7f93b81513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:13.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93be3b7700 1 -- 172.21.15.158:0/2925459389 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b4009370 con 0x7f93b80635d0 2023-10-18T17:26:13.899 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93be3b7700 1 --2- 172.21.15.158:0/2925459389 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93b80635d0 0x7f93b8162070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f93b8067180 tx=0x7f93b4017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:13.899 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93ae7fc700 1 -- 172.21.15.158:0/2925459389 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4000bc0 con 0x7f93b80635d0 2023-10-18T17:26:13.899 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93ae7fc700 1 -- 172.21.15.158:0/2925459389 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b400b7f0 con 0x7f93b80635d0 2023-10-18T17:26:13.899 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93bf3b9700 1 -- 172.21.15.158:0/2925459389 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b8150bf0 con 0x7f93b80635d0 2023-10-18T17:26:13.900 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93ae7fc700 1 -- 172.21.15.158:0/2925459389 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4000d20 con 0x7f93b80635d0 2023-10-18T17:26:13.900 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.892+0000 7f93bf3b9700 1 -- 172.21.15.158:0/2925459389 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b80a14e0 con 0x7f93b80635d0 2023-10-18T17:26:13.900 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.896+0000 7f93bf3b9700 1 -- 172.21.15.158:0/2925459389 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b8046f00 con 0x7f93b80635d0 2023-10-18T17:26:13.901 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.896+0000 7f93ae7fc700 1 -- 172.21.15.158:0/2925459389 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f93b401c8c0 con 0x7f93b80635d0 2023-10-18T17:26:13.901 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.896+0000 7f93ae7fc700 1 --2- 172.21.15.158:0/2925459389 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f939c05a510 0x7f939c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:13.902 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.896+0000 7f93ae7fc700 1 -- 172.21.15.158:0/2925459389 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f93b4076550 con 0x7f93b80635d0 2023-10-18T17:26:13.902 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.900+0000 7f93bdbb6700 1 --2- 172.21.15.158:0/2925459389 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f939c05a510 0x7f939c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:13.903 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.900+0000 7f93bdbb6700 1 --2- 172.21.15.158:0/2925459389 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f939c05a510 0x7f939c05c9d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f93b80bc390 tx=0x7f93a8009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:13.911 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:13.908+0000 7f93ae7fc700 1 -- 172.21.15.158:0/2925459389 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f93b4049a10 con 0x7f93b80635d0 2023-10-18T17:26:14.110 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:14.103+0000 7f93bf3b9700 1 -- 172.21.15.158:0/2925459389 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f93b80a8050 con 0x7f93b80635d0 2023-10-18T17:26:14.111 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:14.107+0000 7f93ae7fc700 1 -- 172.21.15.158:0/2925459389 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f93b404d030 con 0x7f93b80635d0 2023-10-18T17:26:14.111 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:26:14.115 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:14.111+0000 7f93bf3b9700 1 -- 172.21.15.158:0/2925459389 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f939c05a510 msgr2=0x7f939c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:14.116 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:14.111+0000 7f93bf3b9700 1 --2- 172.21.15.158:0/2925459389 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f939c05a510 0x7f939c05c9d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f93b80bc390 tx=0x7f93a8009060).stop 2023-10-18T17:26:14.116 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:14.111+0000 7f93bf3b9700 1 -- 172.21.15.158:0/2925459389 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93b80635d0 msgr2=0x7f93b8162070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:14.116 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:14.111+0000 7f93bf3b9700 1 --2- 172.21.15.158:0/2925459389 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93b80635d0 0x7f93b8162070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f93b8067180 tx=0x7f93b4017000).stop 2023-10-18T17:26:14.116 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:14.111+0000 7f93bf3b9700 1 -- 172.21.15.158:0/2925459389 shutdown_connections 2023-10-18T17:26:14.116 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:14.111+0000 7f93bf3b9700 1 --2- 172.21.15.158:0/2925459389 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f939c05a510 0x7f939c05c9d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:14.117 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:14.111+0000 7f93bf3b9700 1 --2- 172.21.15.158:0/2925459389 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93b80c2bf0 0x7f93b81513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:14.117 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:14.111+0000 7f93bf3b9700 1 --2- 172.21.15.158:0/2925459389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93b80658a0 0x7f93b80a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:14.117 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:14.111+0000 7f93bf3b9700 1 --2- 172.21.15.158:0/2925459389 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93b80635d0 0x7f93b8162070 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:14.117 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:14.111+0000 7f93bf3b9700 1 -- 172.21.15.158:0/2925459389 >> 172.21.15.158:0/2925459389 conn(0x7f93b8062ba0 msgr2=0x7f93b80b8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:14.117 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:14.111+0000 7f93bf3b9700 1 -- 172.21.15.158:0/2925459389 shutdown_connections 2023-10-18T17:26:14.118 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:14.111+0000 7f93bf3b9700 1 -- 172.21.15.158:0/2925459389 wait complete. 2023-10-18T17:26:14.136 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:26:17.138 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:26:17.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.299+0000 7f235aae4700 1 Processor -- start 2023-10-18T17:26:17.303 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.299+0000 7f235aae4700 1 -- start start 2023-10-18T17:26:17.306 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f235aae4700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f23540be300 0x7f23540bc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:17.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f235aae4700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23540bd1a0 con 0x7f23540686b0 2023-10-18T17:26:17.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f235aae4700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23540bd480 con 0x7f23540bdf20 2023-10-18T17:26:17.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f235aae4700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2354069e70 con 0x7f23540be300 2023-10-18T17:26:17.308 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f2359ae2700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f23540bdf20 0x7f23540c2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:60350/0 (socket says 172.21.15.158:60350) 2023-10-18T17:26:17.308 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f2359ae2700 1 -- 172.21.15.158:0/3647071402 learned_addr learned my addr 172.21.15.158:0/3647071402 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:26:17.308 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f23592e1700 1 --2- 172.21.15.158:0/3647071402 >> v2:172.21.15.183:3300/0 conn(0x7f23540be300 0x7f23540bc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:17.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f2358ae0700 1 -- 172.21.15.158:0/3647071402 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972560926 0 0) 0x7f23540bd480 con 0x7f23540bdf20 2023-10-18T17:26:17.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f2358ae0700 1 -- 172.21.15.158:0/3647071402 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23400033f0 con 0x7f23540bdf20 2023-10-18T17:26:17.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f23592e1700 1 -- 172.21.15.158:0/3647071402 >> v1:172.21.15.183:6789/0 conn(0x7f23540bdf20 legacy=0x7f23540c2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:17.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f23592e1700 1 -- 172.21.15.158:0/3647071402 >> v1:172.21.15.158:6789/0 conn(0x7f23540686b0 legacy=0x7f2354068af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:17.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f2358ae0700 1 -- 172.21.15.158:0/3647071402 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93340436 0 0) 0x7f23540bd1a0 con 0x7f23540686b0 2023-10-18T17:26:17.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f23592e1700 1 -- 172.21.15.158:0/3647071402 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23540bd760 con 0x7f23540be300 2023-10-18T17:26:17.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f23592e1700 1 --2- 172.21.15.158:0/3647071402 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23540be300 0x7f23540bc8c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f2344009760 tx=0x7f2344009060).ready entity=mon.1 client_cookie=2f88e2a1c98b1ce3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:17.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f2358ae0700 1 -- 172.21.15.158:0/3647071402 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234400f510 con 0x7f23540be300 2023-10-18T17:26:17.312 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f2358ae0700 1 -- 172.21.15.158:0/3647071402 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234400f670 con 0x7f23540be300 2023-10-18T17:26:17.312 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f2358ae0700 1 -- 172.21.15.158:0/3647071402 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234400f9f0 con 0x7f23540be300 2023-10-18T17:26:17.312 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f235aae4700 1 -- 172.21.15.158:0/3647071402 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23540be300 msgr2=0x7f23540bc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:17.312 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f235aae4700 1 --2- 172.21.15.158:0/3647071402 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23540be300 0x7f23540bc8c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f2344009760 tx=0x7f2344009060).stop 2023-10-18T17:26:17.312 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f235aae4700 1 -- 172.21.15.158:0/3647071402 shutdown_connections 2023-10-18T17:26:17.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f235aae4700 1 --2- 172.21.15.158:0/3647071402 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23540be300 0x7f23540bc8c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:17.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f235aae4700 1 -- 172.21.15.158:0/3647071402 >> 172.21.15.158:0/3647071402 conn(0x7f2354062ba0 msgr2=0x7f23540c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:17.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f235aae4700 1 -- 172.21.15.158:0/3647071402 shutdown_connections 2023-10-18T17:26:17.313 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.303+0000 7f235aae4700 1 -- 172.21.15.158:0/3647071402 wait complete. 2023-10-18T17:26:17.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.307+0000 7f235aae4700 1 Processor -- start 2023-10-18T17:26:17.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.307+0000 7f235aae4700 1 -- start start 2023-10-18T17:26:17.315 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.307+0000 7f235aae4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23540686b0 0x7f23540a72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:17.315 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.307+0000 7f235aae4700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23540bdf20 0x7f2354161220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:17.315 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.307+0000 7f235aae4700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23540be300 0x7f2354065ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:17.315 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.307+0000 7f235aae4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23541641b0 con 0x7f23540686b0 2023-10-18T17:26:17.316 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.307+0000 7f235aae4700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2354163ed0 con 0x7f23540bdf20 2023-10-18T17:26:17.316 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.307+0000 7f235aae4700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23540a85a0 con 0x7f23540be300 2023-10-18T17:26:17.316 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.311+0000 7f23592e1700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23540bdf20 0x7f2354161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:17.316 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.311+0000 7f2359ae2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23540686b0 0x7f23540a72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:17.316 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.311+0000 7f23592e1700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23540bdf20 0x7f2354161220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:43548/0 (socket says 172.21.15.158:43548) 2023-10-18T17:26:17.316 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.311+0000 7f23592e1700 1 -- 172.21.15.158:0/998242763 learned_addr learned my addr 172.21.15.158:0/998242763 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:17.317 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.311+0000 7f235a2e3700 1 --2- 172.21.15.158:0/998242763 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23540be300 0x7f2354065ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:17.318 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.311+0000 7f2359ae2700 1 -- 172.21.15.158:0/998242763 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23540be300 msgr2=0x7f2354065ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:17.318 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.311+0000 7f2359ae2700 1 --2- 172.21.15.158:0/998242763 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23540be300 0x7f2354065ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:17.319 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.311+0000 7f2359ae2700 1 -- 172.21.15.158:0/998242763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23540bdf20 msgr2=0x7f2354161220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:17.319 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.311+0000 7f2359ae2700 1 --2- 172.21.15.158:0/998242763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23540bdf20 0x7f2354161220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:17.319 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.311+0000 7f2359ae2700 1 -- 172.21.15.158:0/998242763 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23440092a0 con 0x7f23540686b0 2023-10-18T17:26:17.319 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.311+0000 7f23592e1700 1 --2- 172.21.15.158:0/998242763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23540bdf20 0x7f2354161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:26:17.319 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.311+0000 7f2359ae2700 1 --2- 172.21.15.158:0/998242763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23540686b0 0x7f23540a72c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f2350001ed0 tx=0x7f2350007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:17.320 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.311+0000 7f2349ffb700 1 -- 172.21.15.158:0/998242763 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235000ce20 con 0x7f23540686b0 2023-10-18T17:26:17.320 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.311+0000 7f2349ffb700 1 -- 172.21.15.158:0/998242763 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23500072e0 con 0x7f23540686b0 2023-10-18T17:26:17.320 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.311+0000 7f235aae4700 1 -- 172.21.15.158:0/998242763 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23540a8880 con 0x7f23540686b0 2023-10-18T17:26:17.320 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.311+0000 7f2349ffb700 1 -- 172.21.15.158:0/998242763 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23500057a0 con 0x7f23540686b0 2023-10-18T17:26:17.320 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.311+0000 7f235aae4700 1 -- 172.21.15.158:0/998242763 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23540a8e40 con 0x7f23540686b0 2023-10-18T17:26:17.321 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.315+0000 7f235aae4700 1 -- 172.21.15.158:0/998242763 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23540a9000 con 0x7f23540686b0 2023-10-18T17:26:17.322 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.315+0000 7f2349ffb700 1 -- 172.21.15.158:0/998242763 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2350005b90 con 0x7f23540686b0 2023-10-18T17:26:17.322 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.315+0000 7f2349ffb700 1 --2- 172.21.15.158:0/998242763 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f233805a510 0x7f233805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:17.322 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.315+0000 7f2349ffb700 1 -- 172.21.15.158:0/998242763 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f2350074150 con 0x7f23540686b0 2023-10-18T17:26:17.322 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.315+0000 7f23592e1700 1 --2- 172.21.15.158:0/998242763 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f233805a510 0x7f233805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:17.323 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.319+0000 7f23592e1700 1 --2- 172.21.15.158:0/998242763 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f233805a510 0x7f233805c9d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f23540b9000 tx=0x7f2344017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:17.327 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.323+0000 7f2349ffb700 1 -- 172.21.15.158:0/998242763 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f2350047610 con 0x7f23540686b0 2023-10-18T17:26:17.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~71s 2023-10-18T17:26:17.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~125s 2023-10-18T17:26:17.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~51s 2023-10-18T17:26:17.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~38s 2023-10-18T17:26:17.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~84s 2023-10-18T17:26:17.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~25s 2023-10-18T17:26:17.517 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.511+0000 7f235aae4700 1 -- 172.21.15.158:0/998242763 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2354046f00 con 0x7f23540686b0 2023-10-18T17:26:17.517 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.511+0000 7f2349ffb700 1 -- 172.21.15.158:0/998242763 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f235004ac30 con 0x7f23540686b0 2023-10-18T17:26:17.518 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:26:17.520 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.515+0000 7f235aae4700 1 -- 172.21.15.158:0/998242763 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f233805a510 msgr2=0x7f233805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:17.520 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.515+0000 7f235aae4700 1 --2- 172.21.15.158:0/998242763 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f233805a510 0x7f233805c9d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f23540b9000 tx=0x7f2344017000).stop 2023-10-18T17:26:17.521 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.515+0000 7f235aae4700 1 -- 172.21.15.158:0/998242763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23540686b0 msgr2=0x7f23540a72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:17.521 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.515+0000 7f235aae4700 1 --2- 172.21.15.158:0/998242763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23540686b0 0x7f23540a72c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f2350001ed0 tx=0x7f2350007bd0).stop 2023-10-18T17:26:17.521 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.515+0000 7f235aae4700 1 -- 172.21.15.158:0/998242763 shutdown_connections 2023-10-18T17:26:17.521 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.515+0000 7f235aae4700 1 --2- 172.21.15.158:0/998242763 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f233805a510 0x7f233805c9d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:17.521 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.515+0000 7f235aae4700 1 --2- 172.21.15.158:0/998242763 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23540be300 0x7f2354065ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:17.522 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.515+0000 7f235aae4700 1 --2- 172.21.15.158:0/998242763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23540bdf20 0x7f2354161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:17.522 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.515+0000 7f235aae4700 1 --2- 172.21.15.158:0/998242763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f23540686b0 0x7f23540a72c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:17.522 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.515+0000 7f235aae4700 1 -- 172.21.15.158:0/998242763 >> 172.21.15.158:0/998242763 conn(0x7f2354062ba0 msgr2=0x7f23540b9920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:17.522 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.515+0000 7f235aae4700 1 -- 172.21.15.158:0/998242763 shutdown_connections 2023-10-18T17:26:17.522 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:17.515+0000 7f235aae4700 1 -- 172.21.15.158:0/998242763 wait complete. 2023-10-18T17:26:17.540 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:26:20.542 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:26:20.704 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.699+0000 7f2e65cdb700 1 Processor -- start 2023-10-18T17:26:20.704 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.699+0000 7f2e65cdb700 1 -- start start 2023-10-18T17:26:20.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.699+0000 7f2e65cdb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2e60154ab0 0x7f2e60062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:20.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.699+0000 7f2e65cdb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2e60062b40 0x7f2e60151090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:20.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.699+0000 7f2e65cdb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e600bf820 con 0x7f2e60062270 2023-10-18T17:26:20.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.699+0000 7f2e65cdb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e600be350 con 0x7f2e60062b40 2023-10-18T17:26:20.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.699+0000 7f2e65cdb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e600bdb40 con 0x7f2e60154ab0 2023-10-18T17:26:20.708 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e5f7fe700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f2e60062270 0x7f2e600bff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:49218/0 (socket says 172.21.15.158:49218) 2023-10-18T17:26:20.708 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e5f7fe700 1 -- 172.21.15.158:0/2770913587 learned_addr learned my addr 172.21.15.158:0/2770913587 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:26:20.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e5ffff700 1 --2- 172.21.15.158:0/2770913587 >> v2:172.21.15.158:3300/0 conn(0x7f2e60062b40 0x7f2e60151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:20.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e5effd700 1 --2- 172.21.15.158:0/2770913587 >> v2:172.21.15.183:3300/0 conn(0x7f2e60154ab0 0x7f2e60062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:20.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e5e7fc700 1 -- 172.21.15.158:0/2770913587 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150994085 0 0) 0x7f2e600bf820 con 0x7f2e60062270 2023-10-18T17:26:20.710 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e5e7fc700 1 -- 172.21.15.158:0/2770913587 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e480033f0 con 0x7f2e60062270 2023-10-18T17:26:20.710 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e5effd700 1 -- 172.21.15.158:0/2770913587 >> v2:172.21.15.158:3300/0 conn(0x7f2e60062b40 msgr2=0x7f2e60151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:26:20.710 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e5effd700 1 --2- 172.21.15.158:0/2770913587 >> v2:172.21.15.158:3300/0 conn(0x7f2e60062b40 0x7f2e60151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:20.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e5effd700 1 -- 172.21.15.158:0/2770913587 >> v1:172.21.15.183:6789/0 conn(0x7f2e60062270 legacy=0x7f2e600bff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:20.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e5effd700 1 -- 172.21.15.158:0/2770913587 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e600bfae0 con 0x7f2e60154ab0 2023-10-18T17:26:20.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e5effd700 1 --2- 172.21.15.158:0/2770913587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e60154ab0 0x7f2e60062650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f2e60068420 tx=0x7f2e54009060).ready entity=mon.1 client_cookie=4f753b0ef51d1770 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:20.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e5e7fc700 1 -- 172.21.15.158:0/2770913587 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5400d4a0 con 0x7f2e60154ab0 2023-10-18T17:26:20.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e5e7fc700 1 -- 172.21.15.158:0/2770913587 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5400d600 con 0x7f2e60154ab0 2023-10-18T17:26:20.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e5e7fc700 1 -- 172.21.15.158:0/2770913587 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5400d980 con 0x7f2e60154ab0 2023-10-18T17:26:20.714 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e65cdb700 1 -- 172.21.15.158:0/2770913587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e60154ab0 msgr2=0x7f2e60062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:20.715 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e65cdb700 1 --2- 172.21.15.158:0/2770913587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e60154ab0 0x7f2e60062650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f2e60068420 tx=0x7f2e54009060).stop 2023-10-18T17:26:20.715 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e65cdb700 1 -- 172.21.15.158:0/2770913587 shutdown_connections 2023-10-18T17:26:20.715 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e65cdb700 1 --2- 172.21.15.158:0/2770913587 >> v2:172.21.15.158:3300/0 conn(0x7f2e60062b40 0x7f2e60151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:20.716 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e65cdb700 1 --2- 172.21.15.158:0/2770913587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e60154ab0 0x7f2e60062650 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:20.716 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e65cdb700 1 -- 172.21.15.158:0/2770913587 >> 172.21.15.158:0/2770913587 conn(0x7f2e6005dc20 msgr2=0x7f2e6005e000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:20.716 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e65cdb700 1 -- 172.21.15.158:0/2770913587 shutdown_connections 2023-10-18T17:26:20.716 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.703+0000 7f2e65cdb700 1 -- 172.21.15.158:0/2770913587 wait complete. 2023-10-18T17:26:20.717 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.707+0000 7f2e65cdb700 1 Processor -- start 2023-10-18T17:26:20.717 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.707+0000 7f2e65cdb700 1 -- start start 2023-10-18T17:26:20.719 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e65cdb700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e60062270 0x7f2e60155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:20.719 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e65cdb700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e60062b40 0x7f2e601567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:20.719 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e65cdb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e60154ab0 0x7f2e60164680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:20.719 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e65cdb700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6014d590 con 0x7f2e60062270 2023-10-18T17:26:20.719 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e65cdb700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e600aeef0 con 0x7f2e60062b40 2023-10-18T17:26:20.720 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e65cdb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e600af190 con 0x7f2e60154ab0 2023-10-18T17:26:20.720 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e5f7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e60062270 0x7f2e60155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:20.720 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e5effd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e60062b40 0x7f2e601567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:20.720 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e5ffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e60154ab0 0x7f2e60164680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:20.720 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e5effd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e60062b40 0x7f2e601567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:37014/0 (socket says 172.21.15.158:37014) 2023-10-18T17:26:20.721 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e5effd700 1 -- 172.21.15.158:0/2889762240 learned_addr learned my addr 172.21.15.158:0/2889762240 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:20.721 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e5f7fe700 1 -- 172.21.15.158:0/2889762240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e60154ab0 msgr2=0x7f2e60164680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:20.721 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e5f7fe700 1 --2- 172.21.15.158:0/2889762240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e60154ab0 0x7f2e60164680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:20.721 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e5f7fe700 1 -- 172.21.15.158:0/2889762240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e60062b40 msgr2=0x7f2e601567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:20.722 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e5f7fe700 1 --2- 172.21.15.158:0/2889762240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e60062b40 0x7f2e601567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:20.722 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e5f7fe700 1 -- 172.21.15.158:0/2889762240 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e540092a0 con 0x7f2e60062270 2023-10-18T17:26:20.722 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e5ffff700 1 --2- 172.21.15.158:0/2889762240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e60154ab0 0x7f2e60164680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:26:20.722 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e5effd700 1 --2- 172.21.15.158:0/2889762240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e60062b40 0x7f2e601567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:26:20.722 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e5f7fe700 1 --2- 172.21.15.158:0/2889762240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e60062270 0x7f2e60155e00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f2e50001ed0 tx=0x7f2e50007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:20.723 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e477fe700 1 -- 172.21.15.158:0/2889762240 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e500070d0 con 0x7f2e60062270 2023-10-18T17:26:20.723 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e477fe700 1 -- 172.21.15.158:0/2889762240 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e50007230 con 0x7f2e60062270 2023-10-18T17:26:20.723 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.711+0000 7f2e65cdb700 1 -- 172.21.15.158:0/2889762240 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e600af470 con 0x7f2e60062270 2023-10-18T17:26:20.723 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.715+0000 7f2e477fe700 1 -- 172.21.15.158:0/2889762240 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e500075f0 con 0x7f2e60062270 2023-10-18T17:26:20.724 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.715+0000 7f2e65cdb700 1 -- 172.21.15.158:0/2889762240 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e60158040 con 0x7f2e60062270 2023-10-18T17:26:20.725 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.715+0000 7f2e65cdb700 1 -- 172.21.15.158:0/2889762240 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6006c190 con 0x7f2e60062270 2023-10-18T17:26:20.725 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.715+0000 7f2e477fe700 1 -- 172.21.15.158:0/2889762240 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2e500059b0 con 0x7f2e60062270 2023-10-18T17:26:20.725 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.719+0000 7f2e477fe700 1 --2- 172.21.15.158:0/2889762240 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f2e4c05a540 0x7f2e4c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:20.725 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.719+0000 7f2e477fe700 1 -- 172.21.15.158:0/2889762240 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f2e50074190 con 0x7f2e60062270 2023-10-18T17:26:20.725 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.719+0000 7f2e5effd700 1 --2- 172.21.15.158:0/2889762240 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f2e4c05a540 0x7f2e4c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:20.726 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.719+0000 7f2e5effd700 1 --2- 172.21.15.158:0/2889762240 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f2e4c05a540 0x7f2e4c05ca00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f2e6014e250 tx=0x7f2e54016000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:20.730 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.727+0000 7f2e477fe700 1 -- 172.21.15.158:0/2889762240 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f2e50047650 con 0x7f2e60062270 2023-10-18T17:26:20.930 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.923+0000 7f2e65cdb700 1 -- 172.21.15.158:0/2889762240 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2e60069840 con 0x7f2e60062270 2023-10-18T17:26:20.931 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.927+0000 7f2e477fe700 1 -- 172.21.15.158:0/2889762240 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f2e5004ac70 con 0x7f2e60062270 2023-10-18T17:26:20.931 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:26:20.933 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.927+0000 7f2e65cdb700 1 -- 172.21.15.158:0/2889762240 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f2e4c05a540 msgr2=0x7f2e4c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:20.934 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.927+0000 7f2e65cdb700 1 --2- 172.21.15.158:0/2889762240 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f2e4c05a540 0x7f2e4c05ca00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f2e6014e250 tx=0x7f2e54016000).stop 2023-10-18T17:26:20.934 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.927+0000 7f2e65cdb700 1 -- 172.21.15.158:0/2889762240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e60062270 msgr2=0x7f2e60155e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:20.934 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.927+0000 7f2e65cdb700 1 --2- 172.21.15.158:0/2889762240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e60062270 0x7f2e60155e00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f2e50001ed0 tx=0x7f2e50007bd0).stop 2023-10-18T17:26:20.934 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.927+0000 7f2e65cdb700 1 -- 172.21.15.158:0/2889762240 shutdown_connections 2023-10-18T17:26:20.934 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.927+0000 7f2e65cdb700 1 --2- 172.21.15.158:0/2889762240 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f2e4c05a540 0x7f2e4c05ca00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:20.935 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.927+0000 7f2e65cdb700 1 --2- 172.21.15.158:0/2889762240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e60154ab0 0x7f2e60164680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:20.935 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.927+0000 7f2e65cdb700 1 --2- 172.21.15.158:0/2889762240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e60062b40 0x7f2e601567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:20.935 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.927+0000 7f2e65cdb700 1 --2- 172.21.15.158:0/2889762240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2e60062270 0x7f2e60155e00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:20.935 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.927+0000 7f2e65cdb700 1 -- 172.21.15.158:0/2889762240 >> 172.21.15.158:0/2889762240 conn(0x7f2e6005dc20 msgr2=0x7f2e600bbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:20.935 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.927+0000 7f2e65cdb700 1 -- 172.21.15.158:0/2889762240 shutdown_connections 2023-10-18T17:26:20.936 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:20.927+0000 7f2e65cdb700 1 -- 172.21.15.158:0/2889762240 wait complete. 2023-10-18T17:26:20.956 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:26:23.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~77s 2023-10-18T17:26:23.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~132s 2023-10-18T17:26:23.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~57s 2023-10-18T17:26:23.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~44s 2023-10-18T17:26:23.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~91s 2023-10-18T17:26:23.814 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~32s 2023-10-18T17:26:23.957 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:26:24.126 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.123+0000 7f9d6a91b700 1 Processor -- start 2023-10-18T17:26:24.127 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.123+0000 7f9d6a91b700 1 -- start start 2023-10-18T17:26:24.127 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.123+0000 7f9d6a91b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9d640b9690 0x7f9d640b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:24.128 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.123+0000 7f9d6a91b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d640bca50 0x7f9d6414dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:24.128 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.123+0000 7f9d6a91b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d640bc480 con 0x7f9d64065620 2023-10-18T17:26:24.128 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.123+0000 7f9d6a91b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d64065190 con 0x7f9d640b9690 2023-10-18T17:26:24.128 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.123+0000 7f9d6a91b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d640bb920 con 0x7f9d640bca50 2023-10-18T17:26:24.129 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.123+0000 7f9d68eb8700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f9d64065620 0x7f9d64065a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:36258/0 (socket says 172.21.15.158:36258) 2023-10-18T17:26:24.130 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.123+0000 7f9d68eb8700 1 -- 172.21.15.158:0/2864524104 learned_addr learned my addr 172.21.15.158:0/2864524104 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:26:24.130 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.123+0000 7f9d63fff700 1 --2- 172.21.15.158:0/2864524104 >> v2:172.21.15.183:3300/0 conn(0x7f9d640b9690 0x7f9d640b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:24.130 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.123+0000 7f9d5b7fe700 1 --2- 172.21.15.158:0/2864524104 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d640bca50 0x7f9d6414dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:24.130 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.123+0000 7f9d637fe700 1 -- 172.21.15.158:0/2864524104 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2990896211 0 0) 0x7f9d640bc480 con 0x7f9d64065620 2023-10-18T17:26:24.130 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.123+0000 7f9d637fe700 1 -- 172.21.15.158:0/2864524104 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d500033f0 con 0x7f9d64065620 2023-10-18T17:26:24.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.123+0000 7f9d63fff700 1 -- 172.21.15.158:0/2864524104 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d640bca50 msgr2=0x7f9d6414dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:26:24.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.123+0000 7f9d63fff700 1 --2- 172.21.15.158:0/2864524104 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d640bca50 0x7f9d6414dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:24.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.123+0000 7f9d63fff700 1 -- 172.21.15.158:0/2864524104 >> v1:172.21.15.158:6789/0 conn(0x7f9d64065620 legacy=0x7f9d64065a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:24.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.123+0000 7f9d63fff700 1 -- 172.21.15.158:0/2864524104 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d640bbbe0 con 0x7f9d640b9690 2023-10-18T17:26:24.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.123+0000 7f9d5b7fe700 1 --2- 172.21.15.158:0/2864524104 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d640bca50 0x7f9d6414dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:26:24.132 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.123+0000 7f9d63fff700 1 --2- 172.21.15.158:0/2864524104 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d640b9690 0x7f9d640b9a70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f9d54009e60 tx=0x7f9d54009780).ready entity=mon.1 client_cookie=939eb39be1cb220f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:24.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.127+0000 7f9d637fe700 1 -- 172.21.15.158:0/2864524104 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5400e070 con 0x7f9d640b9690 2023-10-18T17:26:24.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.127+0000 7f9d637fe700 1 -- 172.21.15.158:0/2864524104 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5400bab0 con 0x7f9d640b9690 2023-10-18T17:26:24.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.127+0000 7f9d637fe700 1 -- 172.21.15.158:0/2864524104 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5400be30 con 0x7f9d640b9690 2023-10-18T17:26:24.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.127+0000 7f9d6a91b700 1 -- 172.21.15.158:0/2864524104 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d640b9690 msgr2=0x7f9d640b9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:24.134 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.127+0000 7f9d6a91b700 1 --2- 172.21.15.158:0/2864524104 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d640b9690 0x7f9d640b9a70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f9d54009e60 tx=0x7f9d54009780).stop 2023-10-18T17:26:24.134 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.127+0000 7f9d6a91b700 1 -- 172.21.15.158:0/2864524104 shutdown_connections 2023-10-18T17:26:24.134 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.127+0000 7f9d6a91b700 1 --2- 172.21.15.158:0/2864524104 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d640bca50 0x7f9d6414dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:24.134 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.127+0000 7f9d6a91b700 1 --2- 172.21.15.158:0/2864524104 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d640b9690 0x7f9d640b9a70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:24.134 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.127+0000 7f9d6a91b700 1 -- 172.21.15.158:0/2864524104 >> 172.21.15.158:0/2864524104 conn(0x7f9d640620d0 msgr2=0x7f9d640624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:24.135 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.127+0000 7f9d6a91b700 1 -- 172.21.15.158:0/2864524104 shutdown_connections 2023-10-18T17:26:24.135 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.127+0000 7f9d6a91b700 1 -- 172.21.15.158:0/2864524104 wait complete. 2023-10-18T17:26:24.135 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.131+0000 7f9d6a91b700 1 Processor -- start 2023-10-18T17:26:24.136 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.131+0000 7f9d6a91b700 1 -- start start 2023-10-18T17:26:24.137 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.131+0000 7f9d6a91b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d64065620 0x7f9d64140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:24.138 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.131+0000 7f9d6a91b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d640b9690 0x7f9d6414cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:24.138 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.131+0000 7f9d6a91b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d64067f30 0x7f9d6414d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:24.138 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.131+0000 7f9d6a91b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d640c0cf0 con 0x7f9d640b9690 2023-10-18T17:26:24.138 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.131+0000 7f9d6a91b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d640c2f50 con 0x7f9d64067f30 2023-10-18T17:26:24.139 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.131+0000 7f9d6a91b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d64145de0 con 0x7f9d64065620 2023-10-18T17:26:24.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.131+0000 7f9d5b7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d640b9690 0x7f9d6414cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:24.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.135+0000 7f9d5b7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d640b9690 0x7f9d6414cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:40408/0 (socket says 172.21.15.158:40408) 2023-10-18T17:26:24.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.135+0000 7f9d5b7fe700 1 -- 172.21.15.158:0/2061335968 learned_addr learned my addr 172.21.15.158:0/2061335968 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:24.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.135+0000 7f9d63fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d64065620 0x7f9d64140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:24.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.135+0000 7f9d68eb8700 1 --2- 172.21.15.158:0/2061335968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d64067f30 0x7f9d6414d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:24.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.135+0000 7f9d5b7fe700 1 -- 172.21.15.158:0/2061335968 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d64065620 msgr2=0x7f9d64140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:24.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.135+0000 7f9d5b7fe700 1 --2- 172.21.15.158:0/2061335968 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d64065620 0x7f9d64140c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:24.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.135+0000 7f9d5b7fe700 1 -- 172.21.15.158:0/2061335968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d64067f30 msgr2=0x7f9d6414d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:24.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.135+0000 7f9d5b7fe700 1 --2- 172.21.15.158:0/2061335968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d64067f30 0x7f9d6414d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:24.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.135+0000 7f9d5b7fe700 1 -- 172.21.15.158:0/2061335968 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c0092a0 con 0x7f9d640b9690 2023-10-18T17:26:24.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.135+0000 7f9d68eb8700 1 --2- 172.21.15.158:0/2061335968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d64067f30 0x7f9d6414d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:26:24.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.135+0000 7f9d63fff700 1 --2- 172.21.15.158:0/2061335968 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d64065620 0x7f9d64140c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:26:24.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.135+0000 7f9d5b7fe700 1 --2- 172.21.15.158:0/2061335968 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d640b9690 0x7f9d6414cd70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f9d4c00e980 tx=0x7f9d4c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:24.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.135+0000 7f9d60ff9700 1 -- 172.21.15.158:0/2061335968 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c012600 con 0x7f9d640b9690 2023-10-18T17:26:24.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.135+0000 7f9d60ff9700 1 -- 172.21.15.158:0/2061335968 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c012760 con 0x7f9d640b9690 2023-10-18T17:26:24.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.135+0000 7f9d6a91b700 1 -- 172.21.15.158:0/2061335968 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d54009a20 con 0x7f9d640b9690 2023-10-18T17:26:24.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.135+0000 7f9d60ff9700 1 -- 172.21.15.158:0/2061335968 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c012ae0 con 0x7f9d640b9690 2023-10-18T17:26:24.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.135+0000 7f9d6a91b700 1 -- 172.21.15.158:0/2061335968 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d64143a70 con 0x7f9d640b9690 2023-10-18T17:26:24.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.135+0000 7f9d6a91b700 1 -- 172.21.15.158:0/2061335968 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d64068ea0 con 0x7f9d640b9690 2023-10-18T17:26:24.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.139+0000 7f9d60ff9700 1 -- 172.21.15.158:0/2061335968 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9d4c01b400 con 0x7f9d640b9690 2023-10-18T17:26:24.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.139+0000 7f9d60ff9700 1 --2- 172.21.15.158:0/2061335968 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9d4405a510 0x7f9d4405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:24.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.139+0000 7f9d60ff9700 1 -- 172.21.15.158:0/2061335968 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f9d4c074fd0 con 0x7f9d640b9690 2023-10-18T17:26:24.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.139+0000 7f9d63fff700 1 --2- 172.21.15.158:0/2061335968 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9d4405a510 0x7f9d4405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:24.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.143+0000 7f9d63fff700 1 --2- 172.21.15.158:0/2061335968 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9d4405a510 0x7f9d4405c9d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f9d54009e60 tx=0x7f9d54009780).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:24.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.147+0000 7f9d60ff9700 1 -- 172.21.15.158:0/2061335968 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f9d64068ea0 con 0x7f9d640b9690 2023-10-18T17:26:24.344 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.339+0000 7f9d6a91b700 1 -- 172.21.15.158:0/2061335968 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9d64068e80 con 0x7f9d640b9690 2023-10-18T17:26:24.345 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.339+0000 7f9d60ff9700 1 -- 172.21.15.158:0/2061335968 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f9d4c048430 con 0x7f9d640b9690 2023-10-18T17:26:24.345 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:26:24.348 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.343+0000 7f9d6a91b700 1 -- 172.21.15.158:0/2061335968 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9d4405a510 msgr2=0x7f9d4405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:24.348 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.343+0000 7f9d6a91b700 1 --2- 172.21.15.158:0/2061335968 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9d4405a510 0x7f9d4405c9d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f9d54009e60 tx=0x7f9d54009780).stop 2023-10-18T17:26:24.348 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.343+0000 7f9d6a91b700 1 -- 172.21.15.158:0/2061335968 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d640b9690 msgr2=0x7f9d6414cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:24.349 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.343+0000 7f9d6a91b700 1 --2- 172.21.15.158:0/2061335968 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d640b9690 0x7f9d6414cd70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f9d4c00e980 tx=0x7f9d4c009060).stop 2023-10-18T17:26:24.350 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.343+0000 7f9d6a91b700 1 -- 172.21.15.158:0/2061335968 shutdown_connections 2023-10-18T17:26:24.350 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.343+0000 7f9d6a91b700 1 --2- 172.21.15.158:0/2061335968 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9d4405a510 0x7f9d4405c9d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:24.350 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.343+0000 7f9d6a91b700 1 --2- 172.21.15.158:0/2061335968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d64067f30 0x7f9d6414d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:24.350 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.343+0000 7f9d6a91b700 1 --2- 172.21.15.158:0/2061335968 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9d640b9690 0x7f9d6414cd70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:24.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.343+0000 7f9d6a91b700 1 --2- 172.21.15.158:0/2061335968 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d64065620 0x7f9d64140c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:24.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.343+0000 7f9d6a91b700 1 -- 172.21.15.158:0/2061335968 >> 172.21.15.158:0/2061335968 conn(0x7f9d640620d0 msgr2=0x7f9d640bce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:24.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.343+0000 7f9d6a91b700 1 -- 172.21.15.158:0/2061335968 shutdown_connections 2023-10-18T17:26:24.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:24.343+0000 7f9d6a91b700 1 -- 172.21.15.158:0/2061335968 wait complete. 2023-10-18T17:26:24.365 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:26:27.367 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:26:27.529 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.523+0000 7fee454e4700 1 Processor -- start 2023-10-18T17:26:27.530 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.523+0000 7fee454e4700 1 -- start start 2023-10-18T17:26:27.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.527+0000 7fee454e4700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fee400658a0 0x7fee40065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:27.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.527+0000 7fee454e4700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee40069f20 0x7fee400c2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:27.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.527+0000 7fee454e4700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4006a760 con 0x7fee400c2b20 2023-10-18T17:26:27.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.527+0000 7fee454e4700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee40150bf0 con 0x7fee400658a0 2023-10-18T17:26:27.533 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.527+0000 7fee454e4700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4006a480 con 0x7fee40069f20 2023-10-18T17:26:27.534 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.527+0000 7fee377fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee40069f20 0x7fee400c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:27.534 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.527+0000 7fee3ffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fee400658a0 0x7fee40065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:27.534 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.527+0000 7fee377fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee40069f20 0x7fee400c2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:39292/0 (socket says 172.21.15.158:39292) 2023-10-18T17:26:27.534 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.527+0000 7fee377fe700 1 -- 172.21.15.158:0/280804492 learned_addr learned my addr 172.21.15.158:0/280804492 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:27.535 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.527+0000 7fee377fe700 1 -- 172.21.15.158:0/280804492 >> v2:172.21.15.183:3300/0 conn(0x7fee400658a0 msgr2=0x7fee40065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:26:27.535 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.527+0000 7fee377fe700 1 --2- 172.21.15.158:0/280804492 >> v2:172.21.15.183:3300/0 conn(0x7fee400658a0 0x7fee40065c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:27.535 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.527+0000 7fee377fe700 1 -- 172.21.15.158:0/280804492 >> v1:172.21.15.158:6789/0 conn(0x7fee400c2b20 legacy=0x7fee400630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:27.535 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.527+0000 7fee377fe700 1 -- 172.21.15.158:0/280804492 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4014fe30 con 0x7fee40069f20 2023-10-18T17:26:27.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.527+0000 7fee377fe700 1 --2- 172.21.15.158:0/280804492 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee40069f20 0x7fee400c2630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fee28006fd0 tx=0x7fee280090f0).ready entity=mon.2 client_cookie=238da38ec1a3da75 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:27.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.531+0000 7fee3f7fe700 1 -- 172.21.15.158:0/280804492 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2800b610 con 0x7fee40069f20 2023-10-18T17:26:27.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.531+0000 7fee3f7fe700 1 -- 172.21.15.158:0/280804492 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2800b770 con 0x7fee40069f20 2023-10-18T17:26:27.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.531+0000 7fee3f7fe700 1 -- 172.21.15.158:0/280804492 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2800baf0 con 0x7fee40069f20 2023-10-18T17:26:27.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.531+0000 7fee454e4700 1 -- 172.21.15.158:0/280804492 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee40069f20 msgr2=0x7fee400c2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:27.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.531+0000 7fee454e4700 1 --2- 172.21.15.158:0/280804492 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee40069f20 0x7fee400c2630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fee28006fd0 tx=0x7fee280090f0).stop 2023-10-18T17:26:27.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.531+0000 7fee454e4700 1 -- 172.21.15.158:0/280804492 shutdown_connections 2023-10-18T17:26:27.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.531+0000 7fee454e4700 1 --2- 172.21.15.158:0/280804492 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee40069f20 0x7fee400c2630 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:27.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.531+0000 7fee454e4700 1 --2- 172.21.15.158:0/280804492 >> v2:172.21.15.183:3300/0 conn(0x7fee400658a0 0x7fee40065c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:27.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.531+0000 7fee454e4700 1 -- 172.21.15.158:0/280804492 >> 172.21.15.158:0/280804492 conn(0x7fee40062ba0 msgr2=0x7fee400c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:27.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.531+0000 7fee454e4700 1 -- 172.21.15.158:0/280804492 shutdown_connections 2023-10-18T17:26:27.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.531+0000 7fee454e4700 1 -- 172.21.15.158:0/280804492 wait complete. 2023-10-18T17:26:27.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.535+0000 7fee454e4700 1 Processor -- start 2023-10-18T17:26:27.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.535+0000 7fee454e4700 1 -- start start 2023-10-18T17:26:27.541 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.535+0000 7fee454e4700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee400658a0 0x7fee401610f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:27.541 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.535+0000 7fee454e4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee40069f20 0x7fee40157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:27.541 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.535+0000 7fee454e4700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee400c2b20 0x7fee401631f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:27.542 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.535+0000 7fee454e4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee401615e0 con 0x7fee40069f20 2023-10-18T17:26:27.542 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.535+0000 7fee454e4700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee400bd500 con 0x7fee400658a0 2023-10-18T17:26:27.542 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.535+0000 7fee454e4700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee400bc8f0 con 0x7fee400c2b20 2023-10-18T17:26:27.544 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.535+0000 7fee3ffff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee400658a0 0x7fee401610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:27.544 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.535+0000 7fee3ffff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee400658a0 0x7fee401610f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:37054/0 (socket says 172.21.15.158:37054) 2023-10-18T17:26:27.544 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.535+0000 7fee3ffff700 1 -- 172.21.15.158:0/1779412355 learned_addr learned my addr 172.21.15.158:0/1779412355 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:27.544 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.535+0000 7fee377fe700 1 --2- 172.21.15.158:0/1779412355 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee40069f20 0x7fee40157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:27.545 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.535+0000 7fee44ce3700 1 --2- 172.21.15.158:0/1779412355 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee400c2b20 0x7fee401631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:27.545 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.535+0000 7fee3ffff700 1 -- 172.21.15.158:0/1779412355 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee400c2b20 msgr2=0x7fee401631f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:27.545 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.535+0000 7fee3ffff700 1 --2- 172.21.15.158:0/1779412355 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee400c2b20 0x7fee401631f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:27.545 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.535+0000 7fee3ffff700 1 -- 172.21.15.158:0/1779412355 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee40069f20 msgr2=0x7fee40157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:27.546 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.535+0000 7fee3ffff700 1 --2- 172.21.15.158:0/1779412355 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee40069f20 0x7fee40157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:27.546 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.539+0000 7fee3ffff700 1 -- 172.21.15.158:0/1779412355 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee28009370 con 0x7fee400658a0 2023-10-18T17:26:27.546 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.539+0000 7fee3ffff700 1 --2- 172.21.15.158:0/1779412355 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee400658a0 0x7fee401610f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fee3000e900 tx=0x7fee30009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:27.546 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.539+0000 7fee3cff9700 1 -- 172.21.15.158:0/1779412355 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee30012600 con 0x7fee400658a0 2023-10-18T17:26:27.546 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.539+0000 7fee3cff9700 1 -- 172.21.15.158:0/1779412355 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee30012760 con 0x7fee400658a0 2023-10-18T17:26:27.547 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.539+0000 7fee454e4700 1 -- 172.21.15.158:0/1779412355 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee400bcbd0 con 0x7fee400658a0 2023-10-18T17:26:27.547 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.539+0000 7fee3cff9700 1 -- 172.21.15.158:0/1779412355 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee30012ae0 con 0x7fee400658a0 2023-10-18T17:26:27.547 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.539+0000 7fee454e4700 1 -- 172.21.15.158:0/1779412355 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee400bd190 con 0x7fee400658a0 2023-10-18T17:26:27.548 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.539+0000 7fee454e4700 1 -- 172.21.15.158:0/1779412355 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee40046f00 con 0x7fee400658a0 2023-10-18T17:26:27.548 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.539+0000 7fee3cff9700 1 -- 172.21.15.158:0/1779412355 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fee3001b400 con 0x7fee400658a0 2023-10-18T17:26:27.549 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.543+0000 7fee3cff9700 1 --2- 172.21.15.158:0/1779412355 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fee2005a510 0x7fee2005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:27.549 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.543+0000 7fee3cff9700 1 -- 172.21.15.158:0/1779412355 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fee30074d10 con 0x7fee400658a0 2023-10-18T17:26:27.549 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.543+0000 7fee377fe700 1 --2- 172.21.15.158:0/1779412355 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fee2005a510 0x7fee2005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:27.549 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.543+0000 7fee377fe700 1 --2- 172.21.15.158:0/1779412355 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fee2005a510 0x7fee2005c9d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fee28009130 tx=0x7fee28017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:27.558 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.555+0000 7fee3cff9700 1 -- 172.21.15.158:0/1779412355 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fee30048230 con 0x7fee400658a0 2023-10-18T17:26:27.758 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.755+0000 7fee454e4700 1 -- 172.21.15.158:0/1779412355 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fee400661a0 con 0x7fee400658a0 2023-10-18T17:26:27.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.755+0000 7fee3cff9700 1 -- 172.21.15.158:0/1779412355 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fee3004b850 con 0x7fee400658a0 2023-10-18T17:26:27.759 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:26:27.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.755+0000 7fee454e4700 1 -- 172.21.15.158:0/1779412355 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fee2005a510 msgr2=0x7fee2005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:27.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.755+0000 7fee454e4700 1 --2- 172.21.15.158:0/1779412355 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fee2005a510 0x7fee2005c9d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fee28009130 tx=0x7fee28017000).stop 2023-10-18T17:26:27.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.755+0000 7fee454e4700 1 -- 172.21.15.158:0/1779412355 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee400658a0 msgr2=0x7fee401610f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:27.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.755+0000 7fee454e4700 1 --2- 172.21.15.158:0/1779412355 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee400658a0 0x7fee401610f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fee3000e900 tx=0x7fee30009060).stop 2023-10-18T17:26:27.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.755+0000 7fee454e4700 1 -- 172.21.15.158:0/1779412355 shutdown_connections 2023-10-18T17:26:27.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.755+0000 7fee454e4700 1 --2- 172.21.15.158:0/1779412355 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fee2005a510 0x7fee2005c9d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:27.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.755+0000 7fee454e4700 1 --2- 172.21.15.158:0/1779412355 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee400c2b20 0x7fee401631f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:27.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.755+0000 7fee454e4700 1 --2- 172.21.15.158:0/1779412355 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee40069f20 0x7fee40157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:27.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.755+0000 7fee454e4700 1 --2- 172.21.15.158:0/1779412355 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee400658a0 0x7fee401610f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:27.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.755+0000 7fee454e4700 1 -- 172.21.15.158:0/1779412355 >> 172.21.15.158:0/1779412355 conn(0x7fee40062ba0 msgr2=0x7fee4014d170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:27.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.755+0000 7fee454e4700 1 -- 172.21.15.158:0/1779412355 shutdown_connections 2023-10-18T17:26:27.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:27.755+0000 7fee454e4700 1 -- 172.21.15.158:0/1779412355 wait complete. 2023-10-18T17:26:27.782 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:26:30.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~84s 2023-10-18T17:26:30.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~138s 2023-10-18T17:26:30.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~64s 2023-10-18T17:26:30.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~51s 2023-10-18T17:26:30.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~97s 2023-10-18T17:26:30.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~38s 2023-10-18T17:26:30.783 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:26:30.945 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.939+0000 7ff029d46700 1 Processor -- start 2023-10-18T17:26:30.945 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.939+0000 7ff029d46700 1 -- start start 2023-10-18T17:26:30.948 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.943+0000 7ff029d46700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff0240b9690 0x7ff0240b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:30.948 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.943+0000 7ff029d46700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0240bc480 con 0x7ff0240bca50 2023-10-18T17:26:30.950 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.943+0000 7ff029d46700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff024065190 con 0x7ff024065d30 2023-10-18T17:26:30.950 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.943+0000 7ff01affd700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7ff0240bca50 0x7ff024065620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:53718/0 (socket says 172.21.15.158:53718) 2023-10-18T17:26:30.950 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.943+0000 7ff01affd700 1 -- 172.21.15.158:0/2177359899 learned_addr learned my addr 172.21.15.158:0/2177359899 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:26:30.950 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.943+0000 7ff029d46700 1 -- 172.21.15.158:0/2177359899 --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0240bb920 con 0x7ff0240b9690 2023-10-18T17:26:30.951 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.943+0000 7ff0237fe700 1 --2- 172.21.15.158:0/2177359899 >> v2:172.21.15.158:3300/0 conn(0x7ff0240b9690 0x7ff0240b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:30.951 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.943+0000 7ff022ffd700 1 -- 172.21.15.158:0/2177359899 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35225584 0 0) 0x7ff0240bc480 con 0x7ff0240bca50 2023-10-18T17:26:30.951 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.943+0000 7ff022ffd700 1 -- 172.21.15.158:0/2177359899 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0100033f0 con 0x7ff0240bca50 2023-10-18T17:26:30.951 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.943+0000 7ff022ffd700 1 -- 172.21.15.158:0/2177359899 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501963244 0 0) 0x7ff024065190 con 0x7ff024065d30 2023-10-18T17:26:30.952 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.943+0000 7ff022ffd700 1 -- 172.21.15.158:0/2177359899 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0240bc480 con 0x7ff024065d30 2023-10-18T17:26:30.952 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.943+0000 7ff0237fe700 1 -- 172.21.15.158:0/2177359899 >> v1:172.21.15.183:6789/0 conn(0x7ff024065d30 legacy=0x7ff0240b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:30.952 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.943+0000 7ff022ffd700 1 -- 172.21.15.158:0/2177359899 <== mon.0 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 384736315 0 0) 0x7ff0100033f0 con 0x7ff0240bca50 2023-10-18T17:26:30.952 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.943+0000 7ff0237fe700 1 -- 172.21.15.158:0/2177359899 >> v1:172.21.15.158:6789/0 conn(0x7ff0240bca50 legacy=0x7ff024065620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:30.953 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.943+0000 7ff0237fe700 1 -- 172.21.15.158:0/2177359899 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0240bbbe0 con 0x7ff0240b9690 2023-10-18T17:26:30.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.943+0000 7ff0237fe700 1 --2- 172.21.15.158:0/2177359899 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0240b9690 0x7ff0240b9a70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7ff014009e60 tx=0x7ff014009780).ready entity=mon.0 client_cookie=cbb0e971689bf0bc server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:30.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.947+0000 7ff022ffd700 1 -- 172.21.15.158:0/2177359899 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01400e070 con 0x7ff0240b9690 2023-10-18T17:26:30.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.947+0000 7ff022ffd700 1 -- 172.21.15.158:0/2177359899 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01400b7a0 con 0x7ff0240b9690 2023-10-18T17:26:30.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.947+0000 7ff022ffd700 1 -- 172.21.15.158:0/2177359899 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c001470 con 0x7ff0240b9690 2023-10-18T17:26:30.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.947+0000 7ff029d46700 1 -- 172.21.15.158:0/2177359899 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0240b9690 msgr2=0x7ff0240b9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:30.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.947+0000 7ff029d46700 1 --2- 172.21.15.158:0/2177359899 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0240b9690 0x7ff0240b9a70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7ff014009e60 tx=0x7ff014009780).stop 2023-10-18T17:26:30.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.947+0000 7ff029d46700 1 -- 172.21.15.158:0/2177359899 shutdown_connections 2023-10-18T17:26:30.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.947+0000 7ff029d46700 1 --2- 172.21.15.158:0/2177359899 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0240b9690 0x7ff0240b9a70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:30.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.947+0000 7ff029d46700 1 -- 172.21.15.158:0/2177359899 >> 172.21.15.158:0/2177359899 conn(0x7ff0240620d0 msgr2=0x7ff0240624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:30.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.947+0000 7ff029d46700 1 -- 172.21.15.158:0/2177359899 shutdown_connections 2023-10-18T17:26:30.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.947+0000 7ff029d46700 1 -- 172.21.15.158:0/2177359899 wait complete. 2023-10-18T17:26:30.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.947+0000 7ff029d46700 1 Processor -- start 2023-10-18T17:26:30.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff029d46700 1 -- start start 2023-10-18T17:26:30.959 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff029d46700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff024065d30 0x7ff0240c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:30.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff029d46700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0240b9690 0x7ff0240bfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:30.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff029d46700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff02414b190 0x7ff0240c03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:30.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff029d46700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02414e950 con 0x7ff0240b9690 2023-10-18T17:26:30.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff029d46700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff024160140 con 0x7ff02414b190 2023-10-18T17:26:30.961 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff029d46700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff024160c60 con 0x7ff024065d30 2023-10-18T17:26:30.961 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff0237fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff024065d30 0x7ff0240c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:30.961 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff01affd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0240b9690 0x7ff0240bfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:30.961 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff0237fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff024065d30 0x7ff0240c27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:50162/0 (socket says 172.21.15.158:50162) 2023-10-18T17:26:30.961 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff0237fe700 1 -- 172.21.15.158:0/1041117418 learned_addr learned my addr 172.21.15.158:0/1041117418 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:30.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff023fff700 1 --2- 172.21.15.158:0/1041117418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff02414b190 0x7ff0240c03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:30.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff0237fe700 1 -- 172.21.15.158:0/1041117418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff02414b190 msgr2=0x7ff0240c03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:30.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff0237fe700 1 --2- 172.21.15.158:0/1041117418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff02414b190 0x7ff0240c03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:30.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff0237fe700 1 -- 172.21.15.158:0/1041117418 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0240b9690 msgr2=0x7ff0240bfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:30.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff0237fe700 1 --2- 172.21.15.158:0/1041117418 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0240b9690 0x7ff0240bfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:30.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff0237fe700 1 -- 172.21.15.158:0/1041117418 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff014009a20 con 0x7ff024065d30 2023-10-18T17:26:30.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff0237fe700 1 --2- 172.21.15.158:0/1041117418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff024065d30 0x7ff0240c27b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7ff014012cc0 tx=0x7ff0240bb400).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:30.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff01bfff700 1 -- 172.21.15.158:0/1041117418 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014012ea0 con 0x7ff024065d30 2023-10-18T17:26:30.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff01bfff700 1 -- 172.21.15.158:0/1041117418 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff014000f40 con 0x7ff024065d30 2023-10-18T17:26:30.964 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff029d46700 1 -- 172.21.15.158:0/1041117418 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff024164060 con 0x7ff024065d30 2023-10-18T17:26:30.964 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.951+0000 7ff01bfff700 1 -- 172.21.15.158:0/1041117418 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01401e670 con 0x7ff024065d30 2023-10-18T17:26:30.964 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.955+0000 7ff029d46700 1 -- 172.21.15.158:0/1041117418 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff024160330 con 0x7ff024065d30 2023-10-18T17:26:30.964 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.955+0000 7ff029d46700 1 -- 172.21.15.158:0/1041117418 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02406c190 con 0x7ff024065d30 2023-10-18T17:26:30.965 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.955+0000 7ff01bfff700 1 -- 172.21.15.158:0/1041117418 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff014003040 con 0x7ff024065d30 2023-10-18T17:26:30.966 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.959+0000 7ff01bfff700 1 --2- 172.21.15.158:0/1041117418 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff00405a540 0x7ff00405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:30.966 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.959+0000 7ff01bfff700 1 -- 172.21.15.158:0/1041117418 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7ff014075eb0 con 0x7ff024065d30 2023-10-18T17:26:30.966 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.959+0000 7ff01affd700 1 --2- 172.21.15.158:0/1041117418 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff00405a540 0x7ff00405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:30.966 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.959+0000 7ff01affd700 1 --2- 172.21.15.158:0/1041117418 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff00405a540 0x7ff00405ca00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7ff024154110 tx=0x7ff00c001980).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:30.973 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:30.967+0000 7ff01bfff700 1 -- 172.21.15.158:0/1041117418 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7ff014049370 con 0x7ff024065d30 2023-10-18T17:26:31.170 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:31.163+0000 7ff029d46700 1 -- 172.21.15.158:0/1041117418 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff0240bbec0 con 0x7ff024065d30 2023-10-18T17:26:31.171 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:31.167+0000 7ff01bfff700 1 -- 172.21.15.158:0/1041117418 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7ff014023020 con 0x7ff024065d30 2023-10-18T17:26:31.171 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:26:31.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:31.171+0000 7ff029d46700 1 -- 172.21.15.158:0/1041117418 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff00405a540 msgr2=0x7ff00405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:31.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:31.171+0000 7ff029d46700 1 --2- 172.21.15.158:0/1041117418 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff00405a540 0x7ff00405ca00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7ff024154110 tx=0x7ff00c001980).stop 2023-10-18T17:26:31.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:31.171+0000 7ff029d46700 1 -- 172.21.15.158:0/1041117418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff024065d30 msgr2=0x7ff0240c27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:31.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:31.171+0000 7ff029d46700 1 --2- 172.21.15.158:0/1041117418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff024065d30 0x7ff0240c27b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7ff014012cc0 tx=0x7ff0240bb400).stop 2023-10-18T17:26:31.177 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:31.171+0000 7ff029d46700 1 -- 172.21.15.158:0/1041117418 shutdown_connections 2023-10-18T17:26:31.177 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:31.171+0000 7ff029d46700 1 --2- 172.21.15.158:0/1041117418 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff00405a540 0x7ff00405ca00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:31.177 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:31.171+0000 7ff029d46700 1 --2- 172.21.15.158:0/1041117418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff02414b190 0x7ff0240c03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:31.177 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:31.171+0000 7ff029d46700 1 --2- 172.21.15.158:0/1041117418 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff0240b9690 0x7ff0240bfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:31.177 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:31.171+0000 7ff029d46700 1 --2- 172.21.15.158:0/1041117418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff024065d30 0x7ff0240c27b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:31.178 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:31.171+0000 7ff029d46700 1 -- 172.21.15.158:0/1041117418 >> 172.21.15.158:0/1041117418 conn(0x7ff0240620d0 msgr2=0x7ff0240624b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:31.178 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:31.171+0000 7ff029d46700 1 -- 172.21.15.158:0/1041117418 shutdown_connections 2023-10-18T17:26:31.178 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:31.171+0000 7ff029d46700 1 -- 172.21.15.158:0/1041117418 wait complete. 2023-10-18T17:26:31.195 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:26:34.159 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:26:34.166 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:26:34.196 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:26:34.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.371+0000 7fb54641b700 1 Processor -- start 2023-10-18T17:26:34.376 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.371+0000 7fb54641b700 1 -- start start 2023-10-18T17:26:34.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb54641b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb540065e30 0x7fb5400683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:34.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb54641b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb540066900 con 0x7fb5400bca50 2023-10-18T17:26:34.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb54641b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5400659a0 con 0x7fb540067ff0 2023-10-18T17:26:34.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb54641b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb540068a50 con 0x7fb540065e30 2023-10-18T17:26:34.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb53ffff700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fb540067ff0 0x7fb5400bdc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:36844/0 (socket says 172.21.15.158:36844) 2023-10-18T17:26:34.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb53ffff700 1 -- 172.21.15.158:0/3468950289 learned_addr learned my addr 172.21.15.158:0/3468950289 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:26:34.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb537fff700 1 --2- 172.21.15.158:0/3468950289 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb540065e30 0x7fb5400683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:34.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb53f7fe700 1 -- 172.21.15.158:0/3468950289 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153408961 0 0) 0x7fb5400659a0 con 0x7fb540067ff0 2023-10-18T17:26:34.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb53f7fe700 1 -- 172.21.15.158:0/3468950289 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb52c0033f0 con 0x7fb540067ff0 2023-10-18T17:26:34.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb53f7fe700 1 -- 172.21.15.158:0/3468950289 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184525503 0 0) 0x7fb540066900 con 0x7fb5400bca50 2023-10-18T17:26:34.382 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb53f7fe700 1 -- 172.21.15.158:0/3468950289 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5400659a0 con 0x7fb5400bca50 2023-10-18T17:26:34.382 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb537fff700 1 -- 172.21.15.158:0/3468950289 >> v1:172.21.15.183:6789/0 conn(0x7fb540067ff0 legacy=0x7fb5400bdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:34.382 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb537fff700 1 -- 172.21.15.158:0/3468950289 >> v1:172.21.15.158:6789/0 conn(0x7fb5400bca50 legacy=0x7fb540150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:34.382 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb537fff700 1 -- 172.21.15.158:0/3468950289 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb540066620 con 0x7fb540065e30 2023-10-18T17:26:34.383 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb537fff700 1 --2- 172.21.15.158:0/3468950289 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb540065e30 0x7fb5400683d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fb5280097c0 tx=0x7fb528009060).ready entity=mon.2 client_cookie=155e6456faa1ddb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:34.384 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb53f7fe700 1 -- 172.21.15.158:0/3468950289 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52800f510 con 0x7fb540065e30 2023-10-18T17:26:34.384 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb53f7fe700 1 -- 172.21.15.158:0/3468950289 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52800f670 con 0x7fb540065e30 2023-10-18T17:26:34.384 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb53f7fe700 1 -- 172.21.15.158:0/3468950289 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52800f9f0 con 0x7fb540065e30 2023-10-18T17:26:34.384 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb54641b700 1 -- 172.21.15.158:0/3468950289 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb540065e30 msgr2=0x7fb5400683d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:34.384 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.375+0000 7fb54641b700 1 --2- 172.21.15.158:0/3468950289 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb540065e30 0x7fb5400683d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fb5280097c0 tx=0x7fb528009060).stop 2023-10-18T17:26:34.384 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.379+0000 7fb54641b700 1 -- 172.21.15.158:0/3468950289 shutdown_connections 2023-10-18T17:26:34.385 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.379+0000 7fb54641b700 1 --2- 172.21.15.158:0/3468950289 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb540065e30 0x7fb5400683d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:34.385 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.379+0000 7fb54641b700 1 -- 172.21.15.158:0/3468950289 >> 172.21.15.158:0/3468950289 conn(0x7fb5400620d0 msgr2=0x7fb5400624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:34.385 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.379+0000 7fb54641b700 1 -- 172.21.15.158:0/3468950289 shutdown_connections 2023-10-18T17:26:34.385 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.379+0000 7fb54641b700 1 -- 172.21.15.158:0/3468950289 wait complete. 2023-10-18T17:26:34.386 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.379+0000 7fb54641b700 1 Processor -- start 2023-10-18T17:26:34.387 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.379+0000 7fb54641b700 1 -- start start 2023-10-18T17:26:34.387 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.379+0000 7fb54641b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb540065e30 0x7fb5400c1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:34.387 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.379+0000 7fb54641b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb540067ff0 0x7fb5400b8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:34.387 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.379+0000 7fb54641b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5400bca50 0x7fb5401524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:34.387 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.379+0000 7fb54641b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb540164300 con 0x7fb540067ff0 2023-10-18T17:26:34.388 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.379+0000 7fb54641b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400c2030 con 0x7fb5400bca50 2023-10-18T17:26:34.388 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.379+0000 7fb54641b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5401639d0 con 0x7fb540065e30 2023-10-18T17:26:34.388 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.383+0000 7fb537fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb540067ff0 0x7fb5400b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:34.388 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.383+0000 7fb537fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb540067ff0 0x7fb5400b8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:50132/0 (socket says 172.21.15.158:50132) 2023-10-18T17:26:34.388 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.383+0000 7fb537fff700 1 -- 172.21.15.158:0/1521950607 learned_addr learned my addr 172.21.15.158:0/1521950607 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:34.389 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.383+0000 7fb5449b8700 1 --2- 172.21.15.158:0/1521950607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5400bca50 0x7fb5401524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:34.389 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.383+0000 7fb53ffff700 1 --2- 172.21.15.158:0/1521950607 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb540065e30 0x7fb5400c1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:34.390 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.383+0000 7fb537fff700 1 -- 172.21.15.158:0/1521950607 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb540065e30 msgr2=0x7fb5400c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:34.390 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.383+0000 7fb537fff700 1 --2- 172.21.15.158:0/1521950607 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb540065e30 0x7fb5400c1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:34.390 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.383+0000 7fb537fff700 1 -- 172.21.15.158:0/1521950607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5400bca50 msgr2=0x7fb5401524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:34.390 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.383+0000 7fb537fff700 1 --2- 172.21.15.158:0/1521950607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5400bca50 0x7fb5401524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:34.391 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.383+0000 7fb537fff700 1 -- 172.21.15.158:0/1521950607 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5280092a0 con 0x7fb540067ff0 2023-10-18T17:26:34.391 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.383+0000 7fb53ffff700 1 --2- 172.21.15.158:0/1521950607 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb540065e30 0x7fb5400c1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:26:34.391 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.383+0000 7fb537fff700 1 --2- 172.21.15.158:0/1521950607 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb540067ff0 0x7fb5400b8780 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fb528011000 tx=0x7fb528017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:34.391 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.383+0000 7fb53cff9700 1 -- 172.21.15.158:0/1521950607 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52800f7e0 con 0x7fb540067ff0 2023-10-18T17:26:34.391 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.383+0000 7fb53cff9700 1 -- 172.21.15.158:0/1521950607 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52800f940 con 0x7fb540067ff0 2023-10-18T17:26:34.392 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.383+0000 7fb54641b700 1 -- 172.21.15.158:0/1521950607 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb540163cb0 con 0x7fb540067ff0 2023-10-18T17:26:34.392 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.383+0000 7fb53cff9700 1 -- 172.21.15.158:0/1521950607 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52801b690 con 0x7fb540067ff0 2023-10-18T17:26:34.392 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.383+0000 7fb54641b700 1 -- 172.21.15.158:0/1521950607 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5400c10b0 con 0x7fb540067ff0 2023-10-18T17:26:34.392 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.383+0000 7fb54641b700 1 -- 172.21.15.158:0/1521950607 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb540164470 con 0x7fb540067ff0 2023-10-18T17:26:34.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.387+0000 7fb53cff9700 1 -- 172.21.15.158:0/1521950607 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb52801ba40 con 0x7fb540067ff0 2023-10-18T17:26:34.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.387+0000 7fb53cff9700 1 --2- 172.21.15.158:0/1521950607 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb52005a510 0x7fb52005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:34.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.387+0000 7fb53cff9700 1 -- 172.21.15.158:0/1521950607 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fb528076120 con 0x7fb540067ff0 2023-10-18T17:26:34.394 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.387+0000 7fb53ffff700 1 --2- 172.21.15.158:0/1521950607 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb52005a510 0x7fb52005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:34.394 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.387+0000 7fb53ffff700 1 --2- 172.21.15.158:0/1521950607 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb52005a510 0x7fb52005c9d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb530005750 tx=0x7fb530009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:34.398 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.395+0000 7fb53cff9700 1 -- 172.21.15.158:0/1521950607 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fb5280496a0 con 0x7fb540067ff0 2023-10-18T17:26:34.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.591+0000 7fb54641b700 1 -- 172.21.15.158:0/1521950607 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb54006c190 con 0x7fb540067ff0 2023-10-18T17:26:34.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.591+0000 7fb53cff9700 1 -- 172.21.15.158:0/1521950607 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fb52804ccc0 con 0x7fb540067ff0 2023-10-18T17:26:34.596 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:26:34.599 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.591+0000 7fb54641b700 1 -- 172.21.15.158:0/1521950607 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb52005a510 msgr2=0x7fb52005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:34.599 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.591+0000 7fb54641b700 1 --2- 172.21.15.158:0/1521950607 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb52005a510 0x7fb52005c9d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb530005750 tx=0x7fb530009040).stop 2023-10-18T17:26:34.599 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.591+0000 7fb54641b700 1 -- 172.21.15.158:0/1521950607 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb540067ff0 msgr2=0x7fb5400b8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:34.599 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.591+0000 7fb54641b700 1 --2- 172.21.15.158:0/1521950607 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb540067ff0 0x7fb5400b8780 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fb528011000 tx=0x7fb528017000).stop 2023-10-18T17:26:34.599 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.595+0000 7fb54641b700 1 -- 172.21.15.158:0/1521950607 shutdown_connections 2023-10-18T17:26:34.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.595+0000 7fb54641b700 1 --2- 172.21.15.158:0/1521950607 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb52005a510 0x7fb52005c9d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:34.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.595+0000 7fb54641b700 1 --2- 172.21.15.158:0/1521950607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5400bca50 0x7fb5401524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:34.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.595+0000 7fb54641b700 1 --2- 172.21.15.158:0/1521950607 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb540067ff0 0x7fb5400b8780 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:34.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.595+0000 7fb54641b700 1 --2- 172.21.15.158:0/1521950607 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb540065e30 0x7fb5400c1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:34.601 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.595+0000 7fb54641b700 1 -- 172.21.15.158:0/1521950607 >> 172.21.15.158:0/1521950607 conn(0x7fb5400620d0 msgr2=0x7fb5400bdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:34.601 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.595+0000 7fb54641b700 1 -- 172.21.15.158:0/1521950607 shutdown_connections 2023-10-18T17:26:34.601 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:34.595+0000 7fb54641b700 1 -- 172.21.15.158:0/1521950607 wait complete. 2023-10-18T17:26:34.618 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:26:36.435 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~90s 2023-10-18T17:26:36.435 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~144s 2023-10-18T17:26:36.435 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~70s 2023-10-18T17:26:36.435 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~57s 2023-10-18T17:26:36.436 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~103s 2023-10-18T17:26:36.436 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~44s 2023-10-18T17:26:37.619 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:26:37.777 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.771+0000 7f5c0085b700 1 Processor -- start 2023-10-18T17:26:37.778 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.771+0000 7f5c0085b700 1 -- start start 2023-10-18T17:26:37.779 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5c0085b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bfc067ff0 0x7f5bfc0683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:37.779 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5c0085b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5bfc0bca50 0x7f5bfc150890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:37.779 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5c0085b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bfc066900 con 0x7f5bfc065e30 2023-10-18T17:26:37.780 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5c0085b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bfc068a50 con 0x7f5bfc0bca50 2023-10-18T17:26:37.780 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5c0085b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc0659a0 con 0x7f5bfc067ff0 2023-10-18T17:26:37.781 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5bfad9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5bfc0bca50 0x7f5bfc150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:37.781 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5bf1d9b700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f5bfc065e30 0x7f5bfc0bdc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:53734/0 (socket says 172.21.15.158:53734) 2023-10-18T17:26:37.782 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5bf1d9b700 1 -- 172.21.15.158:0/204310316 learned_addr learned my addr 172.21.15.158:0/204310316 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:26:37.782 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5bfa59c700 1 --2- 172.21.15.158:0/204310316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bfc067ff0 0x7f5bfc0683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:37.782 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5bfad9d700 1 -- 172.21.15.158:0/204310316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bfc067ff0 msgr2=0x7f5bfc0683d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:26:37.782 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5bfad9d700 1 --2- 172.21.15.158:0/204310316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bfc067ff0 0x7f5bfc0683d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:37.783 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5bfad9d700 1 -- 172.21.15.158:0/204310316 >> v1:172.21.15.158:6789/0 conn(0x7f5bfc065e30 legacy=0x7f5bfc0bdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:37.783 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5bfad9d700 1 -- 172.21.15.158:0/204310316 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bfc066620 con 0x7f5bfc0bca50 2023-10-18T17:26:37.783 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5bf9d9b700 1 -- 172.21.15.158:0/204310316 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234021734 0 0) 0x7f5bfc066900 con 0x7f5bfc065e30 2023-10-18T17:26:37.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5bfad9d700 1 --2- 172.21.15.158:0/204310316 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bfc0bca50 0x7f5bfc150890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f5bf4009790 tx=0x7f5bf4009060).ready entity=mon.0 client_cookie=a8460e787daa9221 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:37.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5bf9d9b700 1 -- 172.21.15.158:0/204310316 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf400b530 con 0x7f5bfc0bca50 2023-10-18T17:26:37.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5bf9d9b700 1 -- 172.21.15.158:0/204310316 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf400b690 con 0x7f5bfc0bca50 2023-10-18T17:26:37.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5bf9d9b700 1 -- 172.21.15.158:0/204310316 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf400ba10 con 0x7f5bfc0bca50 2023-10-18T17:26:37.786 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5c0085b700 1 -- 172.21.15.158:0/204310316 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bfc0bca50 msgr2=0x7f5bfc150890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:37.787 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5c0085b700 1 --2- 172.21.15.158:0/204310316 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bfc0bca50 0x7f5bfc150890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f5bf4009790 tx=0x7f5bf4009060).stop 2023-10-18T17:26:37.787 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5c0085b700 1 -- 172.21.15.158:0/204310316 shutdown_connections 2023-10-18T17:26:37.787 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5c0085b700 1 --2- 172.21.15.158:0/204310316 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bfc0bca50 0x7f5bfc150890 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:37.788 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5c0085b700 1 --2- 172.21.15.158:0/204310316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bfc067ff0 0x7f5bfc0683d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:37.788 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5c0085b700 1 -- 172.21.15.158:0/204310316 >> 172.21.15.158:0/204310316 conn(0x7f5bfc0620d0 msgr2=0x7f5bfc0624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:37.788 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5c0085b700 1 -- 172.21.15.158:0/204310316 shutdown_connections 2023-10-18T17:26:37.788 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.775+0000 7f5c0085b700 1 -- 172.21.15.158:0/204310316 wait complete. 2023-10-18T17:26:37.789 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.779+0000 7f5c0085b700 1 Processor -- start 2023-10-18T17:26:37.789 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.779+0000 7f5c0085b700 1 -- start start 2023-10-18T17:26:37.789 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.779+0000 7f5c0085b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bfc065e30 0x7f5bfc0b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:37.790 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.779+0000 7f5c0085b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bfc067ff0 0x7f5bfc160570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:37.790 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.779+0000 7f5c0085b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bfc0bca50 0x7f5bfc160a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:37.790 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.779+0000 7f5c0085b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc0bbc20 con 0x7f5bfc0bca50 2023-10-18T17:26:37.791 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.779+0000 7f5c0085b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc0b9400 con 0x7f5bfc067ff0 2023-10-18T17:26:37.791 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.779+0000 7f5c0085b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc160f50 con 0x7f5bfc065e30 2023-10-18T17:26:37.791 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.779+0000 7f5bfad9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bfc0bca50 0x7f5bfc160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:37.791 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.779+0000 7f5bfad9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bfc0bca50 0x7f5bfc160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:50142/0 (socket says 172.21.15.158:50142) 2023-10-18T17:26:37.791 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.779+0000 7f5bfad9d700 1 -- 172.21.15.158:0/844699238 learned_addr learned my addr 172.21.15.158:0/844699238 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:37.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.779+0000 7f5bfa59c700 1 --2- 172.21.15.158:0/844699238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bfc065e30 0x7f5bfc0b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:37.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.779+0000 7f5bf1d9b700 1 --2- 172.21.15.158:0/844699238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bfc067ff0 0x7f5bfc160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:37.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.783+0000 7f5bfad9d700 1 -- 172.21.15.158:0/844699238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bfc065e30 msgr2=0x7f5bfc0b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:37.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.783+0000 7f5bfad9d700 1 --2- 172.21.15.158:0/844699238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bfc065e30 0x7f5bfc0b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:37.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.783+0000 7f5bfad9d700 1 -- 172.21.15.158:0/844699238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bfc067ff0 msgr2=0x7f5bfc160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:37.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.783+0000 7f5bfad9d700 1 --2- 172.21.15.158:0/844699238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bfc067ff0 0x7f5bfc160570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:37.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.783+0000 7f5bfad9d700 1 -- 172.21.15.158:0/844699238 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf40092a0 con 0x7f5bfc0bca50 2023-10-18T17:26:37.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.783+0000 7f5bfad9d700 1 --2- 172.21.15.158:0/844699238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bfc0bca50 0x7f5bfc160a60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f5bfc064ac0 tx=0x7f5bf4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:37.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.783+0000 7f5bf2ffd700 1 -- 172.21.15.158:0/844699238 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf400ba10 con 0x7f5bfc0bca50 2023-10-18T17:26:37.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.783+0000 7f5bf2ffd700 1 -- 172.21.15.158:0/844699238 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf400be50 con 0x7f5bfc0bca50 2023-10-18T17:26:37.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.783+0000 7f5bf2ffd700 1 -- 172.21.15.158:0/844699238 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf401c670 con 0x7f5bfc0bca50 2023-10-18T17:26:37.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.783+0000 7f5c0085b700 1 -- 172.21.15.158:0/844699238 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bfc0b87b0 con 0x7f5bfc0bca50 2023-10-18T17:26:37.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.783+0000 7f5c0085b700 1 -- 172.21.15.158:0/844699238 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bfc0baa50 con 0x7f5bfc0bca50 2023-10-18T17:26:37.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.783+0000 7f5c0085b700 1 -- 172.21.15.158:0/844699238 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bfc06c190 con 0x7f5bfc0bca50 2023-10-18T17:26:37.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.783+0000 7f5bf2ffd700 1 -- 172.21.15.158:0/844699238 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5bf401ca20 con 0x7f5bfc0bca50 2023-10-18T17:26:37.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.787+0000 7f5bf2ffd700 1 --2- 172.21.15.158:0/844699238 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f5bdc05a510 0x7f5bdc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:37.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.787+0000 7f5bf2ffd700 1 -- 172.21.15.158:0/844699238 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f5bf40768c0 con 0x7f5bfc0bca50 2023-10-18T17:26:37.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.787+0000 7f5bfa59c700 1 --2- 172.21.15.158:0/844699238 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f5bdc05a510 0x7f5bdc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:37.797 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.787+0000 7f5bfa59c700 1 --2- 172.21.15.158:0/844699238 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f5bdc05a510 0x7f5bdc05c9d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f5bec00f570 tx=0x7f5bec00b040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:37.797 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.791+0000 7f5bf2ffd700 1 -- 172.21.15.158:0/844699238 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f5bf4049d80 con 0x7f5bfc0bca50 2023-10-18T17:26:37.990 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.983+0000 7f5c0085b700 1 -- 172.21.15.158:0/844699238 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5bfc063cf0 con 0x7f5bfc0bca50 2023-10-18T17:26:37.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.987+0000 7f5bf2ffd700 1 -- 172.21.15.158:0/844699238 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f5bf402a0e0 con 0x7f5bfc0bca50 2023-10-18T17:26:37.991 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:26:37.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.991+0000 7f5c0085b700 1 -- 172.21.15.158:0/844699238 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f5bdc05a510 msgr2=0x7f5bdc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:37.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.991+0000 7f5c0085b700 1 --2- 172.21.15.158:0/844699238 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f5bdc05a510 0x7f5bdc05c9d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f5bec00f570 tx=0x7f5bec00b040).stop 2023-10-18T17:26:37.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.991+0000 7f5c0085b700 1 -- 172.21.15.158:0/844699238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bfc0bca50 msgr2=0x7f5bfc160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:37.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.991+0000 7f5c0085b700 1 --2- 172.21.15.158:0/844699238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bfc0bca50 0x7f5bfc160a60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f5bfc064ac0 tx=0x7f5bf4017000).stop 2023-10-18T17:26:37.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.991+0000 7f5c0085b700 1 -- 172.21.15.158:0/844699238 shutdown_connections 2023-10-18T17:26:37.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.991+0000 7f5c0085b700 1 --2- 172.21.15.158:0/844699238 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f5bdc05a510 0x7f5bdc05c9d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:37.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.991+0000 7f5c0085b700 1 --2- 172.21.15.158:0/844699238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bfc0bca50 0x7f5bfc160a60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:37.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.991+0000 7f5c0085b700 1 --2- 172.21.15.158:0/844699238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bfc067ff0 0x7f5bfc160570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:37.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.991+0000 7f5c0085b700 1 --2- 172.21.15.158:0/844699238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bfc065e30 0x7f5bfc0b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:37.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.991+0000 7f5c0085b700 1 -- 172.21.15.158:0/844699238 >> 172.21.15.158:0/844699238 conn(0x7f5bfc0620d0 msgr2=0x7f5bfc149bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:37.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.991+0000 7f5c0085b700 1 -- 172.21.15.158:0/844699238 shutdown_connections 2023-10-18T17:26:37.999 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:37.991+0000 7f5c0085b700 1 -- 172.21.15.158:0/844699238 wait complete. 2023-10-18T17:26:38.015 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:26:41.017 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:26:41.171 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.167+0000 7fa959947700 1 Processor -- start 2023-10-18T17:26:41.171 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.167+0000 7fa959947700 1 -- start start 2023-10-18T17:26:41.173 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.167+0000 7fa959947700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa9540658a0 0x7fa954065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:41.173 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.167+0000 7fa959947700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa9540bd1c0 0x7fa95414ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:41.173 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.167+0000 7fa959947700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9540be2e0 con 0x7fa9540c2bf0 2023-10-18T17:26:41.173 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.167+0000 7fa959947700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9540bda80 con 0x7fa9540bd1c0 2023-10-18T17:26:41.174 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.167+0000 7fa959947700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa95406a7c0 con 0x7fa9540658a0 2023-10-18T17:26:41.175 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.167+0000 7fa953fff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fa9540c2bf0 0x7fa9540630e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:41738/0 (socket says 172.21.15.158:41738) 2023-10-18T17:26:41.175 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.167+0000 7fa959146700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa9540bd1c0 0x7fa95414ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:41.175 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.167+0000 7fa953fff700 1 -- 172.21.15.158:0/3155745083 learned_addr learned my addr 172.21.15.158:0/3155745083 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:26:41.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.167+0000 7fa958945700 1 --2- 172.21.15.158:0/3155745083 >> v2:172.21.15.183:3300/0 conn(0x7fa9540658a0 0x7fa954065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:41.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.167+0000 7fa9537fe700 1 -- 172.21.15.158:0/3155745083 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119644833 0 0) 0x7fa9540be2e0 con 0x7fa9540c2bf0 2023-10-18T17:26:41.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.167+0000 7fa9537fe700 1 -- 172.21.15.158:0/3155745083 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9440033f0 con 0x7fa9540c2bf0 2023-10-18T17:26:41.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.167+0000 7fa959146700 1 -- 172.21.15.158:0/3155745083 >> v2:172.21.15.183:3300/0 conn(0x7fa9540658a0 msgr2=0x7fa954065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:26:41.177 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.167+0000 7fa959146700 1 --2- 172.21.15.158:0/3155745083 >> v2:172.21.15.183:3300/0 conn(0x7fa9540658a0 0x7fa954065c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:41.177 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.167+0000 7fa959146700 1 -- 172.21.15.158:0/3155745083 >> v1:172.21.15.158:6789/0 conn(0x7fa9540c2bf0 legacy=0x7fa9540630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:41.177 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.167+0000 7fa959146700 1 -- 172.21.15.158:0/3155745083 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9540be770 con 0x7fa9540bd1c0 2023-10-18T17:26:41.177 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.167+0000 7fa958945700 1 --2- 172.21.15.158:0/3155745083 >> v2:172.21.15.183:3300/0 conn(0x7fa9540658a0 0x7fa954065c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:26:41.177 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.171+0000 7fa959146700 1 --2- 172.21.15.158:0/3155745083 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9540bd1c0 0x7fa95414ddb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fa954063040 tx=0x7fa94c009780).ready entity=mon.0 client_cookie=283d87e39e535ed6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:41.178 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.171+0000 7fa9537fe700 1 -- 172.21.15.158:0/3155745083 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c00e070 con 0x7fa9540bd1c0 2023-10-18T17:26:41.178 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.171+0000 7fa9537fe700 1 -- 172.21.15.158:0/3155745083 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c00bab0 con 0x7fa9540bd1c0 2023-10-18T17:26:41.178 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.171+0000 7fa9537fe700 1 -- 172.21.15.158:0/3155745083 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c00be30 con 0x7fa9540bd1c0 2023-10-18T17:26:41.179 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.171+0000 7fa959947700 1 -- 172.21.15.158:0/3155745083 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9540bd1c0 msgr2=0x7fa95414ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:41.179 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.171+0000 7fa959947700 1 --2- 172.21.15.158:0/3155745083 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9540bd1c0 0x7fa95414ddb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fa954063040 tx=0x7fa94c009780).stop 2023-10-18T17:26:41.180 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.171+0000 7fa959947700 1 -- 172.21.15.158:0/3155745083 shutdown_connections 2023-10-18T17:26:41.180 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.171+0000 7fa959947700 1 --2- 172.21.15.158:0/3155745083 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9540bd1c0 0x7fa95414ddb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:41.180 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.171+0000 7fa959947700 1 --2- 172.21.15.158:0/3155745083 >> v2:172.21.15.183:3300/0 conn(0x7fa9540658a0 0x7fa954065c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:41.180 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.171+0000 7fa959947700 1 -- 172.21.15.158:0/3155745083 >> 172.21.15.158:0/3155745083 conn(0x7fa954062ba0 msgr2=0x7fa9540c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:41.180 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.171+0000 7fa959947700 1 -- 172.21.15.158:0/3155745083 shutdown_connections 2023-10-18T17:26:41.181 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.171+0000 7fa959947700 1 -- 172.21.15.158:0/3155745083 wait complete. 2023-10-18T17:26:41.181 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa959947700 1 Processor -- start 2023-10-18T17:26:41.181 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa959947700 1 -- start start 2023-10-18T17:26:41.183 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa959947700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9540658a0 0x7fa9540bb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:41.183 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa959947700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9540bd1c0 0x7fa95414c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:41.183 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa959947700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9540c2bf0 0x7fa95414c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:41.183 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa959947700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9540b0ec0 con 0x7fa9540658a0 2023-10-18T17:26:41.184 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa959947700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9540680a0 con 0x7fa9540c2bf0 2023-10-18T17:26:41.184 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa959947700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa954068580 con 0x7fa9540bd1c0 2023-10-18T17:26:41.184 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa958945700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9540658a0 0x7fa9540bb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:41.184 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa958945700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9540658a0 0x7fa9540bb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:36966/0 (socket says 172.21.15.158:36966) 2023-10-18T17:26:41.184 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa958945700 1 -- 172.21.15.158:0/2016038123 learned_addr learned my addr 172.21.15.158:0/2016038123 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:41.185 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa959146700 1 --2- 172.21.15.158:0/2016038123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9540c2bf0 0x7fa95414c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:41.185 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa953fff700 1 --2- 172.21.15.158:0/2016038123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9540bd1c0 0x7fa95414c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:41.185 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa958945700 1 -- 172.21.15.158:0/2016038123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9540bd1c0 msgr2=0x7fa95414c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:41.185 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa958945700 1 --2- 172.21.15.158:0/2016038123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9540bd1c0 0x7fa95414c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:41.185 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa958945700 1 -- 172.21.15.158:0/2016038123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9540c2bf0 msgr2=0x7fa95414c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:41.186 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa958945700 1 --2- 172.21.15.158:0/2016038123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9540c2bf0 0x7fa95414c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:41.186 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa958945700 1 -- 172.21.15.158:0/2016038123 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9480092a0 con 0x7fa9540658a0 2023-10-18T17:26:41.186 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa959146700 1 --2- 172.21.15.158:0/2016038123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9540c2bf0 0x7fa95414c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:26:41.186 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa958945700 1 --2- 172.21.15.158:0/2016038123 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9540658a0 0x7fa9540bb3f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fa94800ea20 tx=0x7fa948009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:41.187 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa950ff9700 1 -- 172.21.15.158:0/2016038123 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94800c8e0 con 0x7fa9540658a0 2023-10-18T17:26:41.187 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa950ff9700 1 -- 172.21.15.158:0/2016038123 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94800ca40 con 0x7fa9540658a0 2023-10-18T17:26:41.187 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa959947700 1 -- 172.21.15.158:0/2016038123 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94c009a20 con 0x7fa9540658a0 2023-10-18T17:26:41.187 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa950ff9700 1 -- 172.21.15.158:0/2016038123 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94800cdc0 con 0x7fa9540658a0 2023-10-18T17:26:41.187 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.175+0000 7fa959947700 1 -- 172.21.15.158:0/2016038123 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa954164af0 con 0x7fa9540658a0 2023-10-18T17:26:41.188 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.179+0000 7fa959947700 1 -- 172.21.15.158:0/2016038123 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa954046f00 con 0x7fa9540658a0 2023-10-18T17:26:41.189 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.179+0000 7fa950ff9700 1 -- 172.21.15.158:0/2016038123 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa948012600 con 0x7fa9540658a0 2023-10-18T17:26:41.189 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.179+0000 7fa950ff9700 1 --2- 172.21.15.158:0/2016038123 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fa93805a510 0x7fa93805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:41.189 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.179+0000 7fa950ff9700 1 -- 172.21.15.158:0/2016038123 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fa948075060 con 0x7fa9540658a0 2023-10-18T17:26:41.189 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.183+0000 7fa953fff700 1 --2- 172.21.15.158:0/2016038123 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fa93805a510 0x7fa93805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:41.189 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.183+0000 7fa953fff700 1 --2- 172.21.15.158:0/2016038123 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fa93805a510 0x7fa93805c9d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fa940007fd0 tx=0x7fa940009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:41.195 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.191+0000 7fa950ff9700 1 -- 172.21.15.158:0/2016038123 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fa9480485e0 con 0x7fa9540658a0 2023-10-18T17:26:41.394 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.387+0000 7fa959947700 1 -- 172.21.15.158:0/2016038123 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa9540a8050 con 0x7fa9540658a0 2023-10-18T17:26:41.395 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.391+0000 7fa950ff9700 1 -- 172.21.15.158:0/2016038123 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fa94804bc00 con 0x7fa9540658a0 2023-10-18T17:26:41.395 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:26:41.398 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.391+0000 7fa959947700 1 -- 172.21.15.158:0/2016038123 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fa93805a510 msgr2=0x7fa93805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:41.398 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.391+0000 7fa959947700 1 --2- 172.21.15.158:0/2016038123 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fa93805a510 0x7fa93805c9d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fa940007fd0 tx=0x7fa940009040).stop 2023-10-18T17:26:41.398 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.391+0000 7fa959947700 1 -- 172.21.15.158:0/2016038123 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9540658a0 msgr2=0x7fa9540bb3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:41.398 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.391+0000 7fa959947700 1 --2- 172.21.15.158:0/2016038123 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9540658a0 0x7fa9540bb3f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fa94800ea20 tx=0x7fa948009060).stop 2023-10-18T17:26:41.399 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.391+0000 7fa959947700 1 -- 172.21.15.158:0/2016038123 shutdown_connections 2023-10-18T17:26:41.399 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.391+0000 7fa959947700 1 --2- 172.21.15.158:0/2016038123 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fa93805a510 0x7fa93805c9d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:41.399 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.391+0000 7fa959947700 1 --2- 172.21.15.158:0/2016038123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9540c2bf0 0x7fa95414c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:41.400 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.391+0000 7fa959947700 1 --2- 172.21.15.158:0/2016038123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9540bd1c0 0x7fa95414c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:41.400 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.391+0000 7fa959947700 1 --2- 172.21.15.158:0/2016038123 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9540658a0 0x7fa9540bb3f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:41.400 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.391+0000 7fa959947700 1 -- 172.21.15.158:0/2016038123 >> 172.21.15.158:0/2016038123 conn(0x7fa954062ba0 msgr2=0x7fa954063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:41.400 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.395+0000 7fa959947700 1 -- 172.21.15.158:0/2016038123 shutdown_connections 2023-10-18T17:26:41.400 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:41.395+0000 7fa959947700 1 -- 172.21.15.158:0/2016038123 wait complete. 2023-10-18T17:26:41.418 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:26:42.747 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~96s 2023-10-18T17:26:42.747 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~151s 2023-10-18T17:26:42.747 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~76s 2023-10-18T17:26:42.748 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~63s 2023-10-18T17:26:42.748 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~110s 2023-10-18T17:26:42.748 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~50s 2023-10-18T17:26:44.420 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:26:44.580 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.575+0000 7f2a0ea79700 1 Processor -- start 2023-10-18T17:26:44.580 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.575+0000 7f2a0ea79700 1 -- start start 2023-10-18T17:26:44.584 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.579+0000 7f2a0ea79700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2a081513e0 0x7f2a08067d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:44.584 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.579+0000 7f2a0ea79700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2a080630e0 0x7f2a08065700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:44.584 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.579+0000 7f2a0ea79700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a08154b00 con 0x7f2a081517c0 2023-10-18T17:26:44.585 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.579+0000 7f2a0ea79700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a08069380 con 0x7f2a080630e0 2023-10-18T17:26:44.586 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.579+0000 7f2a0ea79700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0806a750 con 0x7f2a081513e0 2023-10-18T17:26:44.586 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.579+0000 7f2a0da77700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2a081513e0 0x7f2a08067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:44.586 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.579+0000 7f2a0d276700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f2a081517c0 0x7f2a0806a040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:53728/0 (socket says 172.21.15.158:53728) 2023-10-18T17:26:44.586 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.579+0000 7f2a0d276700 1 -- 172.21.15.158:0/3892328174 learned_addr learned my addr 172.21.15.158:0/3892328174 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:26:44.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.579+0000 7f2a0e278700 1 --2- 172.21.15.158:0/3892328174 >> v2:172.21.15.158:3300/0 conn(0x7f2a080630e0 0x7f2a08065700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:44.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.579+0000 7f2a0ca75700 1 -- 172.21.15.158:0/3892328174 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296073871 0 0) 0x7f2a08154b00 con 0x7f2a081517c0 2023-10-18T17:26:44.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.579+0000 7f2a0ca75700 1 -- 172.21.15.158:0/3892328174 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29f40033f0 con 0x7f2a081517c0 2023-10-18T17:26:44.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.579+0000 7f2a0da77700 1 -- 172.21.15.158:0/3892328174 >> v2:172.21.15.158:3300/0 conn(0x7f2a080630e0 msgr2=0x7f2a08065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:26:44.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.579+0000 7f2a0da77700 1 --2- 172.21.15.158:0/3892328174 >> v2:172.21.15.158:3300/0 conn(0x7f2a080630e0 0x7f2a08065700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:44.588 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.579+0000 7f2a0da77700 1 -- 172.21.15.158:0/3892328174 >> v1:172.21.15.183:6789/0 conn(0x7f2a081517c0 legacy=0x7f2a0806a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:44.588 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.579+0000 7f2a0da77700 1 -- 172.21.15.158:0/3892328174 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a08154f90 con 0x7f2a081513e0 2023-10-18T17:26:44.589 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.583+0000 7f2a0da77700 1 --2- 172.21.15.158:0/3892328174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a081513e0 0x7f2a08067d30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f2a08063040 tx=0x7f2a04009060).ready entity=mon.1 client_cookie=64138736ebd7a826 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:44.589 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.583+0000 7f2a0ca75700 1 -- 172.21.15.158:0/3892328174 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0400f510 con 0x7f2a081513e0 2023-10-18T17:26:44.589 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.583+0000 7f2a0ca75700 1 -- 172.21.15.158:0/3892328174 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0400f670 con 0x7f2a081513e0 2023-10-18T17:26:44.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.583+0000 7f2a0ca75700 1 -- 172.21.15.158:0/3892328174 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0400f9f0 con 0x7f2a081513e0 2023-10-18T17:26:44.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.583+0000 7f2a0ea79700 1 -- 172.21.15.158:0/3892328174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a081513e0 msgr2=0x7f2a08067d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:44.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.583+0000 7f2a0ea79700 1 --2- 172.21.15.158:0/3892328174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a081513e0 0x7f2a08067d30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f2a08063040 tx=0x7f2a04009060).stop 2023-10-18T17:26:44.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.583+0000 7f2a0ea79700 1 -- 172.21.15.158:0/3892328174 shutdown_connections 2023-10-18T17:26:44.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.583+0000 7f2a0ea79700 1 --2- 172.21.15.158:0/3892328174 >> v2:172.21.15.158:3300/0 conn(0x7f2a080630e0 0x7f2a08065700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:44.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.583+0000 7f2a0ea79700 1 --2- 172.21.15.158:0/3892328174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a081513e0 0x7f2a08067d30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:44.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.583+0000 7f2a0ea79700 1 -- 172.21.15.158:0/3892328174 >> 172.21.15.158:0/3892328174 conn(0x7f2a08062ba0 msgr2=0x7f2a080c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:44.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.583+0000 7f2a0ea79700 1 -- 172.21.15.158:0/3892328174 shutdown_connections 2023-10-18T17:26:44.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.583+0000 7f2a0ea79700 1 -- 172.21.15.158:0/3892328174 wait complete. 2023-10-18T17:26:44.593 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.583+0000 7f2a0ea79700 1 Processor -- start 2023-10-18T17:26:44.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0ea79700 1 -- start start 2023-10-18T17:26:44.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0ea79700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a080630e0 0x7f2a0814fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:44.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0ea79700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a081513e0 0x7f2a0814da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:44.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0ea79700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a081517c0 0x7f2a0814ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:44.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0ea79700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a081682d0 con 0x7f2a081517c0 2023-10-18T17:26:44.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0ea79700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a081679e0 con 0x7f2a081513e0 2023-10-18T17:26:44.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0ea79700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08164f60 con 0x7f2a080630e0 2023-10-18T17:26:44.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0da77700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a080630e0 0x7f2a0814fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:44.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0e278700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a081517c0 0x7f2a0814ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:44.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0da77700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a080630e0 0x7f2a0814fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:50736/0 (socket says 172.21.15.158:50736) 2023-10-18T17:26:44.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0da77700 1 -- 172.21.15.158:0/2108086052 learned_addr learned my addr 172.21.15.158:0/2108086052 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:44.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0d276700 1 --2- 172.21.15.158:0/2108086052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a081513e0 0x7f2a0814da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:44.596 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0da77700 1 -- 172.21.15.158:0/2108086052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a081513e0 msgr2=0x7f2a0814da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:44.597 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0da77700 1 --2- 172.21.15.158:0/2108086052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a081513e0 0x7f2a0814da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:44.597 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0da77700 1 -- 172.21.15.158:0/2108086052 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a081517c0 msgr2=0x7f2a0814ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:44.597 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0da77700 1 --2- 172.21.15.158:0/2108086052 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a081517c0 0x7f2a0814ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:44.597 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0da77700 1 -- 172.21.15.158:0/2108086052 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a040092a0 con 0x7f2a080630e0 2023-10-18T17:26:44.597 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0da77700 1 --2- 172.21.15.158:0/2108086052 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a080630e0 0x7f2a0814fa20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f2a04009d20 tx=0x7f2a04017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:44.598 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f29fdffb700 1 -- 172.21.15.158:0/2108086052 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a04023430 con 0x7f2a080630e0 2023-10-18T17:26:44.598 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f29fdffb700 1 -- 172.21.15.158:0/2108086052 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0401e070 con 0x7f2a080630e0 2023-10-18T17:26:44.598 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0ea79700 1 -- 172.21.15.158:0/2108086052 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a08167c80 con 0x7f2a080630e0 2023-10-18T17:26:44.598 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f29fdffb700 1 -- 172.21.15.158:0/2108086052 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a040237e0 con 0x7f2a080630e0 2023-10-18T17:26:44.599 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.587+0000 7f2a0ea79700 1 -- 172.21.15.158:0/2108086052 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a08165240 con 0x7f2a080630e0 2023-10-18T17:26:44.599 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.591+0000 7f2a0ea79700 1 -- 172.21.15.158:0/2108086052 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a08046f00 con 0x7f2a080630e0 2023-10-18T17:26:44.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.591+0000 7f29fdffb700 1 -- 172.21.15.158:0/2108086052 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2a04020030 con 0x7f2a080630e0 2023-10-18T17:26:44.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.595+0000 7f29fdffb700 1 --2- 172.21.15.158:0/2108086052 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f29ec05a510 0x7f29ec05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:44.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.595+0000 7f29fdffb700 1 -- 172.21.15.158:0/2108086052 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f2a04075640 con 0x7f2a080630e0 2023-10-18T17:26:44.600 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.595+0000 7f2a0d276700 1 --2- 172.21.15.158:0/2108086052 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f29ec05a510 0x7f29ec05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:44.601 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.595+0000 7f2a0d276700 1 --2- 172.21.15.158:0/2108086052 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f29ec05a510 0x7f29ec05c9d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f29f8007fd0 tx=0x7f29f8009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:44.608 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.603+0000 7f29fdffb700 1 -- 172.21.15.158:0/2108086052 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f2a04048b20 con 0x7f2a080630e0 2023-10-18T17:26:44.810 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.803+0000 7f2a0ea79700 1 -- 172.21.15.158:0/2108086052 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2a08068570 con 0x7f2a080630e0 2023-10-18T17:26:44.811 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.807+0000 7f29fdffb700 1 -- 172.21.15.158:0/2108086052 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f2a040290e0 con 0x7f2a080630e0 2023-10-18T17:26:44.811 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:26:44.814 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.807+0000 7f2a0ea79700 1 -- 172.21.15.158:0/2108086052 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f29ec05a510 msgr2=0x7f29ec05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:44.814 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.807+0000 7f2a0ea79700 1 --2- 172.21.15.158:0/2108086052 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f29ec05a510 0x7f29ec05c9d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f29f8007fd0 tx=0x7f29f8009040).stop 2023-10-18T17:26:44.815 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.807+0000 7f2a0ea79700 1 -- 172.21.15.158:0/2108086052 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a080630e0 msgr2=0x7f2a0814fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:44.815 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.807+0000 7f2a0ea79700 1 --2- 172.21.15.158:0/2108086052 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a080630e0 0x7f2a0814fa20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f2a04009d20 tx=0x7f2a04017000).stop 2023-10-18T17:26:44.815 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.807+0000 7f2a0ea79700 1 -- 172.21.15.158:0/2108086052 shutdown_connections 2023-10-18T17:26:44.815 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.807+0000 7f2a0ea79700 1 --2- 172.21.15.158:0/2108086052 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f29ec05a510 0x7f29ec05c9d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:44.816 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.807+0000 7f2a0ea79700 1 --2- 172.21.15.158:0/2108086052 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a081517c0 0x7f2a0814ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:44.816 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.807+0000 7f2a0ea79700 1 --2- 172.21.15.158:0/2108086052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a081513e0 0x7f2a0814da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:44.816 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.807+0000 7f2a0ea79700 1 --2- 172.21.15.158:0/2108086052 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a080630e0 0x7f2a0814fa20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:44.816 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.807+0000 7f2a0ea79700 1 -- 172.21.15.158:0/2108086052 >> 172.21.15.158:0/2108086052 conn(0x7f2a08062ba0 msgr2=0x7f2a08152a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:44.816 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.807+0000 7f2a0ea79700 1 -- 172.21.15.158:0/2108086052 shutdown_connections 2023-10-18T17:26:44.817 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:44.807+0000 7f2a0ea79700 1 -- 172.21.15.158:0/2108086052 wait complete. 2023-10-18T17:26:44.833 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:26:47.834 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:26:47.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.987+0000 7fa334a1b700 1 Processor -- start 2023-10-18T17:26:47.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.987+0000 7fa334a1b700 1 -- start start 2023-10-18T17:26:47.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.991+0000 7fa334a1b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa330065e30 0x7fa3300683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:47.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.991+0000 7fa334a1b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa330066900 con 0x7fa3300bca50 2023-10-18T17:26:47.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.991+0000 7fa334a1b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3300659a0 con 0x7fa330067ff0 2023-10-18T17:26:47.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.991+0000 7fa334a1b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa330068a50 con 0x7fa330065e30 2023-10-18T17:26:47.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.991+0000 7fa32e59c700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fa330067ff0 0x7fa3300bdc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:53734/0 (socket says 172.21.15.158:53734) 2023-10-18T17:26:47.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.991+0000 7fa32e59c700 1 -- 172.21.15.158:0/1206868711 learned_addr learned my addr 172.21.15.158:0/1206868711 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:26:47.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.991+0000 7fa325d9b700 1 --2- 172.21.15.158:0/1206868711 >> v2:172.21.15.158:3300/0 conn(0x7fa330065e30 0x7fa3300683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:47.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.991+0000 7fa32dd9b700 1 -- 172.21.15.158:0/1206868711 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600295313 0 0) 0x7fa3300659a0 con 0x7fa330067ff0 2023-10-18T17:26:47.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.991+0000 7fa32dd9b700 1 -- 172.21.15.158:0/1206868711 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa31c0033f0 con 0x7fa330067ff0 2023-10-18T17:26:47.999 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.991+0000 7fa32dd9b700 1 -- 172.21.15.158:0/1206868711 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863043850 0 0) 0x7fa330066900 con 0x7fa3300bca50 2023-10-18T17:26:47.999 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.991+0000 7fa32dd9b700 1 -- 172.21.15.158:0/1206868711 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3300659a0 con 0x7fa3300bca50 2023-10-18T17:26:47.999 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.991+0000 7fa325d9b700 1 -- 172.21.15.158:0/1206868711 >> v1:172.21.15.183:6789/0 conn(0x7fa330067ff0 legacy=0x7fa3300bdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:47.999 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.991+0000 7fa325d9b700 1 -- 172.21.15.158:0/1206868711 >> v1:172.21.15.158:6789/0 conn(0x7fa3300bca50 legacy=0x7fa330150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:47.999 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.991+0000 7fa32dd9b700 1 -- 172.21.15.158:0/1206868711 <== mon.0 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2120506621 0 0) 0x7fa3300659a0 con 0x7fa3300bca50 2023-10-18T17:26:48.000 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.991+0000 7fa325d9b700 1 -- 172.21.15.158:0/1206868711 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa330066620 con 0x7fa330065e30 2023-10-18T17:26:48.000 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.991+0000 7fa325d9b700 1 --2- 172.21.15.158:0/1206868711 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa330065e30 0x7fa3300683d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fa318009760 tx=0x7fa318009060).ready entity=mon.0 client_cookie=700b9f3555d62124 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:48.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.991+0000 7fa32dd9b700 1 -- 172.21.15.158:0/1206868711 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3280017f0 con 0x7fa330065e30 2023-10-18T17:26:48.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.991+0000 7fa32dd9b700 1 -- 172.21.15.158:0/1206868711 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa318011400 con 0x7fa330065e30 2023-10-18T17:26:48.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.991+0000 7fa32dd9b700 1 -- 172.21.15.158:0/1206868711 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa318011780 con 0x7fa330065e30 2023-10-18T17:26:48.002 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.995+0000 7fa334a1b700 1 -- 172.21.15.158:0/1206868711 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa330065e30 msgr2=0x7fa3300683d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:48.002 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.995+0000 7fa334a1b700 1 --2- 172.21.15.158:0/1206868711 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa330065e30 0x7fa3300683d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fa318009760 tx=0x7fa318009060).stop 2023-10-18T17:26:48.002 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.995+0000 7fa334a1b700 1 -- 172.21.15.158:0/1206868711 shutdown_connections 2023-10-18T17:26:48.003 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.995+0000 7fa334a1b700 1 --2- 172.21.15.158:0/1206868711 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa330065e30 0x7fa3300683d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:48.003 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.995+0000 7fa334a1b700 1 -- 172.21.15.158:0/1206868711 >> 172.21.15.158:0/1206868711 conn(0x7fa3300620d0 msgr2=0x7fa3300624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:48.003 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.995+0000 7fa334a1b700 1 -- 172.21.15.158:0/1206868711 shutdown_connections 2023-10-18T17:26:48.003 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.995+0000 7fa334a1b700 1 -- 172.21.15.158:0/1206868711 wait complete. 2023-10-18T17:26:48.006 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.995+0000 7fa334a1b700 1 Processor -- start 2023-10-18T17:26:48.006 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.995+0000 7fa334a1b700 1 -- start start 2023-10-18T17:26:48.006 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa334a1b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa330065e30 0x7fa3300c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:48.006 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa334a1b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa330067ff0 0x7fa3300c0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:48.007 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa334a1b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3300bca50 0x7fa330160990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:48.007 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa334a1b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3300c1970 con 0x7fa330065e30 2023-10-18T17:26:48.007 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa334a1b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa330160500 con 0x7fa3300bca50 2023-10-18T17:26:48.007 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa334a1b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33015ff20 con 0x7fa330067ff0 2023-10-18T17:26:48.007 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa32e59c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa330065e30 0x7fa3300c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:48.008 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa32e59c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa330065e30 0x7fa3300c2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:37000/0 (socket says 172.21.15.158:37000) 2023-10-18T17:26:48.008 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa32e59c700 1 -- 172.21.15.158:0/609349582 learned_addr learned my addr 172.21.15.158:0/609349582 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:48.008 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa325d9b700 1 --2- 172.21.15.158:0/609349582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa330067ff0 0x7fa3300c0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:48.008 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa32ed9d700 1 --2- 172.21.15.158:0/609349582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3300bca50 0x7fa330160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:48.008 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa32e59c700 1 -- 172.21.15.158:0/609349582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa330067ff0 msgr2=0x7fa3300c0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:48.009 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa32e59c700 1 --2- 172.21.15.158:0/609349582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa330067ff0 0x7fa3300c0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:48.009 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa32e59c700 1 -- 172.21.15.158:0/609349582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3300bca50 msgr2=0x7fa330160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:48.009 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa32e59c700 1 --2- 172.21.15.158:0/609349582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3300bca50 0x7fa330160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:48.009 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa32e59c700 1 -- 172.21.15.158:0/609349582 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3180092a0 con 0x7fa330065e30 2023-10-18T17:26:48.009 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa32e59c700 1 --2- 172.21.15.158:0/609349582 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa330065e30 0x7fa3300c2ac0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fa32000c440 tx=0x7fa320007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:48.010 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa326ffd700 1 -- 172.21.15.158:0/609349582 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32000ce40 con 0x7fa330065e30 2023-10-18T17:26:48.010 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa326ffd700 1 -- 172.21.15.158:0/609349582 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3200072e0 con 0x7fa330065e30 2023-10-18T17:26:48.010 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa334a1b700 1 -- 172.21.15.158:0/609349582 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3300bdea0 con 0x7fa330065e30 2023-10-18T17:26:48.010 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa326ffd700 1 -- 172.21.15.158:0/609349582 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3200057a0 con 0x7fa330065e30 2023-10-18T17:26:48.010 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:47.999+0000 7fa334a1b700 1 -- 172.21.15.158:0/609349582 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3300ba7d0 con 0x7fa330065e30 2023-10-18T17:26:48.011 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.003+0000 7fa334a1b700 1 -- 172.21.15.158:0/609349582 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33006c190 con 0x7fa330065e30 2023-10-18T17:26:48.011 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.003+0000 7fa326ffd700 1 -- 172.21.15.158:0/609349582 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa320005b50 con 0x7fa330065e30 2023-10-18T17:26:48.012 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.003+0000 7fa326ffd700 1 --2- 172.21.15.158:0/609349582 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fa31005a510 0x7fa31005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:48.012 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.003+0000 7fa326ffd700 1 -- 172.21.15.158:0/609349582 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fa320074010 con 0x7fa330065e30 2023-10-18T17:26:48.012 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.003+0000 7fa325d9b700 1 --2- 172.21.15.158:0/609349582 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fa31005a510 0x7fa31005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:48.012 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.007+0000 7fa325d9b700 1 --2- 172.21.15.158:0/609349582 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fa31005a510 0x7fa31005c9d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fa318009760 tx=0x7fa318016000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:48.014 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.011+0000 7fa326ffd700 1 -- 172.21.15.158:0/609349582 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fa320047590 con 0x7fa330065e30 2023-10-18T17:26:48.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.203+0000 7fa334a1b700 1 -- 172.21.15.158:0/609349582 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa330063cf0 con 0x7fa330065e30 2023-10-18T17:26:48.208 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.203+0000 7fa326ffd700 1 -- 172.21.15.158:0/609349582 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fa320018070 con 0x7fa330065e30 2023-10-18T17:26:48.208 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:26:48.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.203+0000 7fa334a1b700 1 -- 172.21.15.158:0/609349582 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fa31005a510 msgr2=0x7fa31005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:48.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.203+0000 7fa334a1b700 1 --2- 172.21.15.158:0/609349582 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fa31005a510 0x7fa31005c9d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fa318009760 tx=0x7fa318016000).stop 2023-10-18T17:26:48.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.203+0000 7fa334a1b700 1 -- 172.21.15.158:0/609349582 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa330065e30 msgr2=0x7fa3300c2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:48.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.203+0000 7fa334a1b700 1 --2- 172.21.15.158:0/609349582 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa330065e30 0x7fa3300c2ac0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fa32000c440 tx=0x7fa320007c70).stop 2023-10-18T17:26:48.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.203+0000 7fa334a1b700 1 -- 172.21.15.158:0/609349582 shutdown_connections 2023-10-18T17:26:48.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.203+0000 7fa334a1b700 1 --2- 172.21.15.158:0/609349582 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fa31005a510 0x7fa31005c9d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:48.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.203+0000 7fa334a1b700 1 --2- 172.21.15.158:0/609349582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3300bca50 0x7fa330160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:48.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.203+0000 7fa334a1b700 1 --2- 172.21.15.158:0/609349582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa330067ff0 0x7fa3300c0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:48.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.203+0000 7fa334a1b700 1 --2- 172.21.15.158:0/609349582 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa330065e30 0x7fa3300c2ac0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:48.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.203+0000 7fa334a1b700 1 -- 172.21.15.158:0/609349582 >> 172.21.15.158:0/609349582 conn(0x7fa3300620d0 msgr2=0x7fa33014cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:48.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.207+0000 7fa334a1b700 1 -- 172.21.15.158:0/609349582 shutdown_connections 2023-10-18T17:26:48.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:48.207+0000 7fa334a1b700 1 -- 172.21.15.158:0/609349582 wait complete. 2023-10-18T17:26:48.233 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:26:49.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~103s 2023-10-18T17:26:49.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~157s 2023-10-18T17:26:49.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~83s 2023-10-18T17:26:49.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~70s 2023-10-18T17:26:49.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~116s 2023-10-18T17:26:49.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~57s 2023-10-18T17:26:51.235 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:26:51.404 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.399+0000 7f5d6f59e700 1 Processor -- start 2023-10-18T17:26:51.404 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.399+0000 7f5d6f59e700 1 -- start start 2023-10-18T17:26:51.405 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.399+0000 7f5d6f59e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700658a0 0x7f5d70065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:51.405 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.399+0000 7f5d6f59e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5d700bd1c0 0x7f5d7014ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:51.406 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.399+0000 7f5d6f59e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d700be2e0 con 0x7f5d700c2bf0 2023-10-18T17:26:51.406 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.399+0000 7f5d6f59e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d700bda80 con 0x7f5d700bd1c0 2023-10-18T17:26:51.406 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.399+0000 7f5d6f59e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7006a7c0 con 0x7f5d700658a0 2023-10-18T17:26:51.407 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.399+0000 7f5d6ed9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5d700bd1c0 0x7f5d7014ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:51.407 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.399+0000 7f5d6e59c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700658a0 0x7f5d70065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:51.408 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.399+0000 7f5d65d9b700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f5d700c2bf0 0x7f5d700630e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:45400/0 (socket says 172.21.15.158:45400) 2023-10-18T17:26:51.408 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.399+0000 7f5d6ed9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5d700bd1c0 0x7f5d7014ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:40790/0 (socket says 172.21.15.158:40790) 2023-10-18T17:26:51.408 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.399+0000 7f5d65d9b700 1 -- 172.21.15.158:0/3460456613 learned_addr learned my addr 172.21.15.158:0/3460456613 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:26:51.408 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.403+0000 7f5d6ed9d700 1 -- 172.21.15.158:0/3460456613 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700658a0 msgr2=0x7f5d70065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:26:51.408 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.403+0000 7f5d6ed9d700 1 --2- 172.21.15.158:0/3460456613 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700658a0 0x7f5d70065c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:51.409 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.403+0000 7f5d6ed9d700 1 -- 172.21.15.158:0/3460456613 >> v1:172.21.15.158:6789/0 conn(0x7f5d700c2bf0 legacy=0x7f5d700630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:51.409 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.403+0000 7f5d6ed9d700 1 -- 172.21.15.158:0/3460456613 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d700be770 con 0x7f5d700bd1c0 2023-10-18T17:26:51.409 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.403+0000 7f5d6ed9d700 1 --2- 172.21.15.158:0/3460456613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d700bd1c0 0x7f5d7014ddb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f5d68009760 tx=0x7f5d68009060).ready entity=mon.0 client_cookie=1b8e97456ea0a882 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:51.409 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.403+0000 7f5d6dd9b700 1 -- 172.21.15.158:0/3460456613 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6800f510 con 0x7f5d700bd1c0 2023-10-18T17:26:51.409 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.403+0000 7f5d6dd9b700 1 -- 172.21.15.158:0/3460456613 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6800f670 con 0x7f5d700bd1c0 2023-10-18T17:26:51.410 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.403+0000 7f5d6dd9b700 1 -- 172.21.15.158:0/3460456613 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6800f9f0 con 0x7f5d700bd1c0 2023-10-18T17:26:51.411 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.403+0000 7f5d6f59e700 1 -- 172.21.15.158:0/3460456613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d700bd1c0 msgr2=0x7f5d7014ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:51.411 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.403+0000 7f5d6f59e700 1 --2- 172.21.15.158:0/3460456613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d700bd1c0 0x7f5d7014ddb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f5d68009760 tx=0x7f5d68009060).stop 2023-10-18T17:26:51.411 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.403+0000 7f5d6f59e700 1 -- 172.21.15.158:0/3460456613 shutdown_connections 2023-10-18T17:26:51.411 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.403+0000 7f5d6f59e700 1 --2- 172.21.15.158:0/3460456613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d700bd1c0 0x7f5d7014ddb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:51.411 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.403+0000 7f5d6f59e700 1 --2- 172.21.15.158:0/3460456613 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700658a0 0x7f5d70065c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:51.412 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.403+0000 7f5d6f59e700 1 -- 172.21.15.158:0/3460456613 >> 172.21.15.158:0/3460456613 conn(0x7f5d70062ba0 msgr2=0x7f5d700c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:51.412 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.403+0000 7f5d6f59e700 1 -- 172.21.15.158:0/3460456613 shutdown_connections 2023-10-18T17:26:51.412 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.403+0000 7f5d6f59e700 1 -- 172.21.15.158:0/3460456613 wait complete. 2023-10-18T17:26:51.413 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.407+0000 7f5d6f59e700 1 Processor -- start 2023-10-18T17:26:51.413 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.407+0000 7f5d6f59e700 1 -- start start 2023-10-18T17:26:51.414 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.407+0000 7f5d6f59e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700658a0 0x7f5d700a7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:51.414 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.407+0000 7f5d6f59e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d700bd1c0 0x7f5d70149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:51.415 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.407+0000 7f5d6f59e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d700c2bf0 0x7f5d7014a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:51.415 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.407+0000 7f5d6f59e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70163e80 con 0x7f5d700c2bf0 2023-10-18T17:26:51.415 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.407+0000 7f5d6f59e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d700a7790 con 0x7f5d700bd1c0 2023-10-18T17:26:51.415 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.407+0000 7f5d6f59e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70149b50 con 0x7f5d700658a0 2023-10-18T17:26:51.416 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.407+0000 7f5d6e59c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700658a0 0x7f5d700a7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:51.416 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.407+0000 7f5d6ed9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d700c2bf0 0x7f5d7014a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:51.416 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.407+0000 7f5d6e59c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700658a0 0x7f5d700a7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:57508/0 (socket says 172.21.15.158:57508) 2023-10-18T17:26:51.416 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.407+0000 7f5d6e59c700 1 -- 172.21.15.158:0/2067931907 learned_addr learned my addr 172.21.15.158:0/2067931907 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:51.416 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.407+0000 7f5d65d9b700 1 --2- 172.21.15.158:0/2067931907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d700bd1c0 0x7f5d70149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:51.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.411+0000 7f5d6ed9d700 1 -- 172.21.15.158:0/2067931907 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700658a0 msgr2=0x7f5d700a7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:51.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.411+0000 7f5d6ed9d700 1 --2- 172.21.15.158:0/2067931907 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700658a0 0x7f5d700a7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:51.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.411+0000 7f5d6ed9d700 1 -- 172.21.15.158:0/2067931907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d700bd1c0 msgr2=0x7f5d70149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:51.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.411+0000 7f5d6ed9d700 1 --2- 172.21.15.158:0/2067931907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d700bd1c0 0x7f5d70149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:51.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.411+0000 7f5d6ed9d700 1 -- 172.21.15.158:0/2067931907 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d680092a0 con 0x7f5d700c2bf0 2023-10-18T17:26:51.419 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.411+0000 7f5d6ed9d700 1 --2- 172.21.15.158:0/2067931907 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d700c2bf0 0x7f5d7014a920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f5d68014000 tx=0x7f5d68017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:51.419 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.411+0000 7f5d66ffd700 1 -- 172.21.15.158:0/2067931907 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6800f510 con 0x7f5d700c2bf0 2023-10-18T17:26:51.419 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.411+0000 7f5d66ffd700 1 -- 172.21.15.158:0/2067931907 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6800f9f0 con 0x7f5d700c2bf0 2023-10-18T17:26:51.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.411+0000 7f5d6f59e700 1 -- 172.21.15.158:0/2067931907 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d70160b20 con 0x7f5d700c2bf0 2023-10-18T17:26:51.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.411+0000 7f5d66ffd700 1 -- 172.21.15.158:0/2067931907 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6801b640 con 0x7f5d700c2bf0 2023-10-18T17:26:51.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.411+0000 7f5d6f59e700 1 -- 172.21.15.158:0/2067931907 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d70163830 con 0x7f5d700c2bf0 2023-10-18T17:26:51.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.411+0000 7f5d6f59e700 1 -- 172.21.15.158:0/2067931907 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d70163ff0 con 0x7f5d700c2bf0 2023-10-18T17:26:51.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.411+0000 7f5d66ffd700 1 -- 172.21.15.158:0/2067931907 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5d6801ba70 con 0x7f5d700c2bf0 2023-10-18T17:26:51.421 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.415+0000 7f5d66ffd700 1 --2- 172.21.15.158:0/2067931907 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f5d5005a510 0x7f5d5005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:51.421 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.415+0000 7f5d66ffd700 1 -- 172.21.15.158:0/2067931907 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f5d680763c0 con 0x7f5d700c2bf0 2023-10-18T17:26:51.421 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.415+0000 7f5d6e59c700 1 --2- 172.21.15.158:0/2067931907 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f5d5005a510 0x7f5d5005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:51.422 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.415+0000 7f5d6e59c700 1 --2- 172.21.15.158:0/2067931907 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f5d5005a510 0x7f5d5005c9d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f5d60009fd0 tx=0x7f5d6000b040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:51.425 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.419+0000 7f5d66ffd700 1 -- 172.21.15.158:0/2067931907 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f5d68049880 con 0x7f5d700c2bf0 2023-10-18T17:26:51.626 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.619+0000 7f5d6f59e700 1 -- 172.21.15.158:0/2067931907 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5d70046f00 con 0x7f5d700c2bf0 2023-10-18T17:26:51.627 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.619+0000 7f5d66ffd700 1 -- 172.21.15.158:0/2067931907 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f5d680290e0 con 0x7f5d700c2bf0 2023-10-18T17:26:51.627 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:26:51.629 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.623+0000 7f5d6f59e700 1 -- 172.21.15.158:0/2067931907 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f5d5005a510 msgr2=0x7f5d5005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:51.629 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.623+0000 7f5d6f59e700 1 --2- 172.21.15.158:0/2067931907 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f5d5005a510 0x7f5d5005c9d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f5d60009fd0 tx=0x7f5d6000b040).stop 2023-10-18T17:26:51.629 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.623+0000 7f5d6f59e700 1 -- 172.21.15.158:0/2067931907 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d700c2bf0 msgr2=0x7f5d7014a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:51.630 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.623+0000 7f5d6f59e700 1 --2- 172.21.15.158:0/2067931907 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d700c2bf0 0x7f5d7014a920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f5d68014000 tx=0x7f5d68017000).stop 2023-10-18T17:26:51.630 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.623+0000 7f5d6f59e700 1 -- 172.21.15.158:0/2067931907 shutdown_connections 2023-10-18T17:26:51.631 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.623+0000 7f5d6f59e700 1 --2- 172.21.15.158:0/2067931907 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f5d5005a510 0x7f5d5005c9d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:51.631 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.623+0000 7f5d6f59e700 1 --2- 172.21.15.158:0/2067931907 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5d700c2bf0 0x7f5d7014a920 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:51.631 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.623+0000 7f5d6f59e700 1 --2- 172.21.15.158:0/2067931907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d700bd1c0 0x7f5d70149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:51.631 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.623+0000 7f5d6f59e700 1 --2- 172.21.15.158:0/2067931907 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700658a0 0x7f5d700a7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:51.632 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.623+0000 7f5d6f59e700 1 -- 172.21.15.158:0/2067931907 >> 172.21.15.158:0/2067931907 conn(0x7f5d70062ba0 msgr2=0x7f5d70155540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:51.632 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.623+0000 7f5d6f59e700 1 -- 172.21.15.158:0/2067931907 shutdown_connections 2023-10-18T17:26:51.632 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:51.623+0000 7f5d6f59e700 1 -- 172.21.15.158:0/2067931907 wait complete. 2023-10-18T17:26:51.650 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:26:54.652 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:26:54.815 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.811+0000 7fd2f9d1b700 1 Processor -- start 2023-10-18T17:26:54.816 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.811+0000 7fd2f9d1b700 1 -- start start 2023-10-18T17:26:54.818 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.811+0000 7fd2f9d1b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd2f4065e30 0x7fd2f40683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:54.818 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.811+0000 7fd2f9d1b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f4066900 con 0x7fd2f4067ff0 2023-10-18T17:26:54.819 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.811+0000 7fd2f9d1b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f40659a0 con 0x7fd2f40bca50 2023-10-18T17:26:54.819 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.811+0000 7fd2f9d1b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f4068a50 con 0x7fd2f4065e30 2023-10-18T17:26:54.824 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f3fff700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fd2f40bca50 0x7fd2f4150890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:39472/0 (socket says 172.21.15.158:39472) 2023-10-18T17:26:54.824 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f3fff700 1 -- 172.21.15.158:0/489562689 learned_addr learned my addr 172.21.15.158:0/489562689 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:26:54.824 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f37fe700 1 --1- 172.21.15.158:0/489562689 >> v1:172.21.15.158:6789/0 conn(0x7fd2f4067ff0 0x7fd2f40bdc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:45408/0 (socket says 172.21.15.158:45408) 2023-10-18T17:26:54.825 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f2ffd700 1 --2- 172.21.15.158:0/489562689 >> v2:172.21.15.183:3300/0 conn(0x7fd2f4065e30 0x7fd2f40683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:54.825 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 -- 172.21.15.158:0/489562689 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441997174 0 0) 0x7fd2f40659a0 con 0x7fd2f40bca50 2023-10-18T17:26:54.825 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 -- 172.21.15.158:0/489562689 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2dc0033f0 con 0x7fd2f40bca50 2023-10-18T17:26:54.825 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 -- 172.21.15.158:0/489562689 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993659673 0 0) 0x7fd2f4066900 con 0x7fd2f4067ff0 2023-10-18T17:26:54.825 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 -- 172.21.15.158:0/489562689 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2f40659a0 con 0x7fd2f4067ff0 2023-10-18T17:26:54.826 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 -- 172.21.15.158:0/489562689 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4126688498 0 0) 0x7fd2dc0033f0 con 0x7fd2f40bca50 2023-10-18T17:26:54.826 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 -- 172.21.15.158:0/489562689 >> v2:172.21.15.183:3300/0 conn(0x7fd2f4065e30 msgr2=0x7fd2f40683d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:26:54.826 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 --2- 172.21.15.158:0/489562689 >> v2:172.21.15.183:3300/0 conn(0x7fd2f4065e30 0x7fd2f40683d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:54.826 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 -- 172.21.15.158:0/489562689 >> v1:172.21.15.158:6789/0 conn(0x7fd2f4067ff0 legacy=0x7fd2f40bdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:54.827 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 -- 172.21.15.158:0/489562689 --> v1:172.21.15.183:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f4066620 con 0x7fd2f40bca50 2023-10-18T17:26:54.827 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 -- 172.21.15.158:0/489562689 <== mon.1 v1:172.21.15.183:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2074596555 0 0) 0x7fd2ec0017f0 con 0x7fd2f40bca50 2023-10-18T17:26:54.827 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 -- 172.21.15.158:0/489562689 >> v1:172.21.15.183:6789/0 conn(0x7fd2f40bca50 legacy=0x7fd2f4150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:54.827 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 --2- 172.21.15.158:0/489562689 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2dc003a70 0x7fd2dc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:54.827 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 --2- 172.21.15.158:0/489562689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2dc004690 0x7fd2dc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:54.828 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 --2- 172.21.15.158:0/489562689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2dc005000 0x7fd2dc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:54.828 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 -- 172.21.15.158:0/489562689 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f4068a50 con 0x7fd2dc005000 2023-10-18T17:26:54.828 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 -- 172.21.15.158:0/489562689 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc00be80 con 0x7fd2dc004690 2023-10-18T17:26:54.828 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 -- 172.21.15.158:0/489562689 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc00c040 con 0x7fd2dc003a70 2023-10-18T17:26:54.828 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f2ffd700 1 --2- 172.21.15.158:0/489562689 >> v2:172.21.15.183:3300/0 conn(0x7fd2f4065e30 0x7fd2f40683d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:26:54.829 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f3fff700 1 --2- 172.21.15.158:0/489562689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2dc005000 0x7fd2dc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:54.829 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f37fe700 1 --2- 172.21.15.158:0/489562689 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2dc003a70 0x7fd2dc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:54.829 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f2ffd700 1 --2- 172.21.15.158:0/489562689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2dc004690 0x7fd2dc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:54.829 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f3fff700 1 -- 172.21.15.158:0/489562689 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2dc003a70 msgr2=0x7fd2dc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:26:54.830 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f3fff700 1 --2- 172.21.15.158:0/489562689 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2dc003a70 0x7fd2dc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:54.830 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f3fff700 1 -- 172.21.15.158:0/489562689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2dc004690 msgr2=0x7fd2dc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:26:54.830 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f3fff700 1 --2- 172.21.15.158:0/489562689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2dc004690 0x7fd2dc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:54.830 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f3fff700 1 -- 172.21.15.158:0/489562689 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2dc0033f0 con 0x7fd2dc005000 2023-10-18T17:26:54.830 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f2ffd700 1 --2- 172.21.15.158:0/489562689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2dc004690 0x7fd2dc004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:26:54.831 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f3fff700 1 -- 172.21.15.158:0/489562689 reap_dead start 2023-10-18T17:26:54.831 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f3fff700 1 --2- 172.21.15.158:0/489562689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2dc005000 0x7fd2dc00b8e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fd2f40bcf00 tx=0x7fd2f40bf7f0).ready entity=mon.0 client_cookie=22ba56a464339e53 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:54.832 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 -- 172.21.15.158:0/489562689 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec00cd90 con 0x7fd2dc005000 2023-10-18T17:26:54.832 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 -- 172.21.15.158:0/489562689 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ec005b20 con 0x7fd2dc005000 2023-10-18T17:26:54.832 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f27fc700 1 -- 172.21.15.158:0/489562689 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec005ea0 con 0x7fd2dc005000 2023-10-18T17:26:54.833 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f9d1b700 1 -- 172.21.15.158:0/489562689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2dc005000 msgr2=0x7fd2dc00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:54.833 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.815+0000 7fd2f9d1b700 1 --2- 172.21.15.158:0/489562689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2dc005000 0x7fd2dc00b8e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fd2f40bcf00 tx=0x7fd2f40bf7f0).stop 2023-10-18T17:26:54.833 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.819+0000 7fd2f9d1b700 1 -- 172.21.15.158:0/489562689 shutdown_connections 2023-10-18T17:26:54.834 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.819+0000 7fd2f9d1b700 1 --2- 172.21.15.158:0/489562689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2dc005000 0x7fd2dc00b8e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:54.834 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.819+0000 7fd2f9d1b700 1 -- 172.21.15.158:0/489562689 >> 172.21.15.158:0/489562689 conn(0x7fd2f40620d0 msgr2=0x7fd2f40624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:54.834 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.819+0000 7fd2f9d1b700 1 -- 172.21.15.158:0/489562689 shutdown_connections 2023-10-18T17:26:54.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.819+0000 7fd2f9d1b700 1 -- 172.21.15.158:0/489562689 wait complete. 2023-10-18T17:26:54.839 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.819+0000 7fd2f9d1b700 1 Processor -- start 2023-10-18T17:26:54.839 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.819+0000 7fd2f9d1b700 1 -- start start 2023-10-18T17:26:54.839 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2f9d1b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2dc005000 0x7fd2f40b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:54.840 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2f9d1b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2f40b4f40 0x7fd2f4144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:54.840 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2f9d1b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2f4144f50 0x7fd2f4155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:54.840 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2f9d1b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f40bba80 con 0x7fd2f40b4f40 2023-10-18T17:26:54.841 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2f9d1b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f40b5820 con 0x7fd2dc005000 2023-10-18T17:26:54.841 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2f9d1b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f40b34c0 con 0x7fd2f4144f50 2023-10-18T17:26:54.841 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2f2ffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2f40b4f40 0x7fd2f4144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:54.841 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2f2ffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2f40b4f40 0x7fd2f4144a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:40808/0 (socket says 172.21.15.158:40808) 2023-10-18T17:26:54.842 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2f2ffd700 1 -- 172.21.15.158:0/3437920597 learned_addr learned my addr 172.21.15.158:0/3437920597 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:54.842 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2f37fe700 1 --2- 172.21.15.158:0/3437920597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2dc005000 0x7fd2f40b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:54.842 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2f3fff700 1 --2- 172.21.15.158:0/3437920597 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2f4144f50 0x7fd2f4155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:54.842 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2f2ffd700 1 -- 172.21.15.158:0/3437920597 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2f4144f50 msgr2=0x7fd2f4155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:54.842 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2f2ffd700 1 --2- 172.21.15.158:0/3437920597 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2f4144f50 0x7fd2f4155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:54.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2f2ffd700 1 -- 172.21.15.158:0/3437920597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2dc005000 msgr2=0x7fd2f40b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:54.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2f2ffd700 1 --2- 172.21.15.158:0/3437920597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2dc005000 0x7fd2f40b4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:54.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2f2ffd700 1 -- 172.21.15.158:0/3437920597 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f40b5540 con 0x7fd2f40b4f40 2023-10-18T17:26:54.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2f2ffd700 1 --2- 172.21.15.158:0/3437920597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2f40b4f40 0x7fd2f4144a60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fd2e8006f70 tx=0x7fd2e8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:54.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2db7fe700 1 -- 172.21.15.158:0/3437920597 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8015690 con 0x7fd2f40b4f40 2023-10-18T17:26:54.844 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2db7fe700 1 -- 172.21.15.158:0/3437920597 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e80157f0 con 0x7fd2f40b4f40 2023-10-18T17:26:54.844 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2db7fe700 1 -- 172.21.15.158:0/3437920597 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8015b70 con 0x7fd2f40b4f40 2023-10-18T17:26:54.844 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2f9d1b700 1 -- 172.21.15.158:0/3437920597 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f41549a0 con 0x7fd2f40b4f40 2023-10-18T17:26:54.844 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.823+0000 7fd2f9d1b700 1 -- 172.21.15.158:0/3437920597 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f4154f60 con 0x7fd2f40b4f40 2023-10-18T17:26:54.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.827+0000 7fd2f9d1b700 1 -- 172.21.15.158:0/3437920597 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f406c190 con 0x7fd2f40b4f40 2023-10-18T17:26:54.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.827+0000 7fd2db7fe700 1 -- 172.21.15.158:0/3437920597 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd2e8013410 con 0x7fd2f40b4f40 2023-10-18T17:26:54.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.827+0000 7fd2db7fe700 1 --2- 172.21.15.158:0/3437920597 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fd2e005a540 0x7fd2e005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:54.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.827+0000 7fd2db7fe700 1 -- 172.21.15.158:0/3437920597 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fd2e8074fe0 con 0x7fd2f40b4f40 2023-10-18T17:26:54.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.827+0000 7fd2f37fe700 1 --2- 172.21.15.158:0/3437920597 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fd2e005a540 0x7fd2e005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:54.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.827+0000 7fd2f37fe700 1 --2- 172.21.15.158:0/3437920597 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fd2e005a540 0x7fd2e005ca00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd2e4007cf0 tx=0x7fd2e4009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:54.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:54.835+0000 7fd2db7fe700 1 -- 172.21.15.158:0/3437920597 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fd2e8048480 con 0x7fd2f40b4f40 2023-10-18T17:26:55.038 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:55.031+0000 7fd2f9d1b700 1 -- 172.21.15.158:0/3437920597 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd2f4145330 con 0x7fd2f40b4f40 2023-10-18T17:26:55.040 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:55.035+0000 7fd2db7fe700 1 -- 172.21.15.158:0/3437920597 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fd2e8019020 con 0x7fd2f40b4f40 2023-10-18T17:26:55.040 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:26:55.043 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:55.035+0000 7fd2f9d1b700 1 -- 172.21.15.158:0/3437920597 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fd2e005a540 msgr2=0x7fd2e005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:55.043 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:55.035+0000 7fd2f9d1b700 1 --2- 172.21.15.158:0/3437920597 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fd2e005a540 0x7fd2e005ca00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd2e4007cf0 tx=0x7fd2e4009040).stop 2023-10-18T17:26:55.043 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:55.035+0000 7fd2f9d1b700 1 -- 172.21.15.158:0/3437920597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2f40b4f40 msgr2=0x7fd2f4144a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:55.044 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:55.035+0000 7fd2f9d1b700 1 --2- 172.21.15.158:0/3437920597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2f40b4f40 0x7fd2f4144a60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fd2e8006f70 tx=0x7fd2e8008040).stop 2023-10-18T17:26:55.044 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:55.035+0000 7fd2f9d1b700 1 -- 172.21.15.158:0/3437920597 shutdown_connections 2023-10-18T17:26:55.044 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:55.035+0000 7fd2f9d1b700 1 --2- 172.21.15.158:0/3437920597 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fd2e005a540 0x7fd2e005ca00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:55.044 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:55.035+0000 7fd2f9d1b700 1 --2- 172.21.15.158:0/3437920597 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2f4144f50 0x7fd2f4155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:55.044 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:55.035+0000 7fd2f9d1b700 1 --2- 172.21.15.158:0/3437920597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2f40b4f40 0x7fd2f4144a60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:55.045 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:55.035+0000 7fd2f9d1b700 1 --2- 172.21.15.158:0/3437920597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2dc005000 0x7fd2f40b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:55.045 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:55.035+0000 7fd2f9d1b700 1 -- 172.21.15.158:0/3437920597 >> 172.21.15.158:0/3437920597 conn(0x7fd2f40620d0 msgr2=0x7fd2f4149f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:55.045 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:55.035+0000 7fd2f9d1b700 1 -- 172.21.15.158:0/3437920597 shutdown_connections 2023-10-18T17:26:55.045 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:55.035+0000 7fd2f9d1b700 1 -- 172.21.15.158:0/3437920597 wait complete. 2023-10-18T17:26:55.060 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:26:55.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~109s 2023-10-18T17:26:55.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~163s 2023-10-18T17:26:55.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~89s 2023-10-18T17:26:55.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~76s 2023-10-18T17:26:55.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~122s 2023-10-18T17:26:55.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~63s 2023-10-18T17:26:58.062 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:26:58.226 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.218+0000 7fcad6f79700 1 Processor -- start 2023-10-18T17:26:58.226 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.218+0000 7fcad6f79700 1 -- start start 2023-10-18T17:26:58.229 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.222+0000 7fcad6f79700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcad014d040 0x7fcad00c0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:58.229 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.222+0000 7fcad6f79700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcad00bf550 0x7fcad00bdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:58.229 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.222+0000 7fcad6f79700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad0150ae0 con 0x7fcad014d420 2023-10-18T17:26:58.229 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.222+0000 7fcad6f79700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad0150800 con 0x7fcad00bf550 2023-10-18T17:26:58.230 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.222+0000 7fcad6f79700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad0062c10 con 0x7fcad014d040 2023-10-18T17:26:58.231 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.222+0000 7fcad6778700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fcad014d420 0x7fcad0064d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:45414/0 (socket says 172.21.15.158:45414) 2023-10-18T17:26:58.231 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.222+0000 7fcad6778700 1 -- 172.21.15.158:0/964293886 learned_addr learned my addr 172.21.15.158:0/964293886 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:26:58.232 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.222+0000 7fcad5f77700 1 --2- 172.21.15.158:0/964293886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcad014d040 0x7fcad00c0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:58.232 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.222+0000 7fcad5776700 1 --2- 172.21.15.158:0/964293886 >> v2:172.21.15.183:3300/0 conn(0x7fcad00bf550 0x7fcad00bdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:58.232 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.222+0000 7fcad4f75700 1 -- 172.21.15.158:0/964293886 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934105772 0 0) 0x7fcad0150ae0 con 0x7fcad014d420 2023-10-18T17:26:58.232 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.222+0000 7fcad4f75700 1 -- 172.21.15.158:0/964293886 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcabc0033f0 con 0x7fcad014d420 2023-10-18T17:26:58.233 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.222+0000 7fcad5776700 1 -- 172.21.15.158:0/964293886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcad014d040 msgr2=0x7fcad00c0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:26:58.233 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.222+0000 7fcad5776700 1 --2- 172.21.15.158:0/964293886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcad014d040 0x7fcad00c0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:58.233 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.222+0000 7fcad5776700 1 -- 172.21.15.158:0/964293886 >> v1:172.21.15.158:6789/0 conn(0x7fcad014d420 legacy=0x7fcad0064d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:58.233 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.222+0000 7fcad5776700 1 -- 172.21.15.158:0/964293886 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad0062ef0 con 0x7fcad00bf550 2023-10-18T17:26:58.233 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.226+0000 7fcad5776700 1 --2- 172.21.15.158:0/964293886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcad00bf550 0x7fcad00bdac0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fcac0009760 tx=0x7fcac0009060).ready entity=mon.1 client_cookie=bf70d889156fc5cf server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:58.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.226+0000 7fcad4f75700 1 -- 172.21.15.158:0/964293886 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000d4a0 con 0x7fcad00bf550 2023-10-18T17:26:58.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.226+0000 7fcad4f75700 1 -- 172.21.15.158:0/964293886 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac000d600 con 0x7fcad00bf550 2023-10-18T17:26:58.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.226+0000 7fcad4f75700 1 -- 172.21.15.158:0/964293886 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000d980 con 0x7fcad00bf550 2023-10-18T17:26:58.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.226+0000 7fcad6f79700 1 -- 172.21.15.158:0/964293886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcad00bf550 msgr2=0x7fcad00bdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:58.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.226+0000 7fcad6f79700 1 --2- 172.21.15.158:0/964293886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcad00bf550 0x7fcad00bdac0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fcac0009760 tx=0x7fcac0009060).stop 2023-10-18T17:26:58.236 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.226+0000 7fcad6f79700 1 -- 172.21.15.158:0/964293886 shutdown_connections 2023-10-18T17:26:58.236 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.226+0000 7fcad6f79700 1 --2- 172.21.15.158:0/964293886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcad00bf550 0x7fcad00bdac0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:58.236 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.226+0000 7fcad6f79700 1 --2- 172.21.15.158:0/964293886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcad014d040 0x7fcad00c0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:58.236 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.226+0000 7fcad6f79700 1 -- 172.21.15.158:0/964293886 >> 172.21.15.158:0/964293886 conn(0x7fcad0069d80 msgr2=0x7fcad006a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:58.236 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.226+0000 7fcad6f79700 1 -- 172.21.15.158:0/964293886 shutdown_connections 2023-10-18T17:26:58.237 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.226+0000 7fcad6f79700 1 -- 172.21.15.158:0/964293886 wait complete. 2023-10-18T17:26:58.237 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.230+0000 7fcad6f79700 1 Processor -- start 2023-10-18T17:26:58.237 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.230+0000 7fcad6f79700 1 -- start start 2023-10-18T17:26:58.239 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.230+0000 7fcad6f79700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcad00bf550 0x7fcad00b9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:58.239 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.230+0000 7fcad6f79700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcad014d040 0x7fcad00bc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:58.239 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.230+0000 7fcad6f79700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcad014d420 0x7fcad00bcec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:58.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.230+0000 7fcad6f79700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00b8db0 con 0x7fcad014d040 2023-10-18T17:26:58.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.230+0000 7fcad6f79700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00bd3b0 con 0x7fcad014d420 2023-10-18T17:26:58.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.230+0000 7fcad6f79700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00b9730 con 0x7fcad00bf550 2023-10-18T17:26:58.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.230+0000 7fcad5776700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcad014d040 0x7fcad00bc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:58.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.230+0000 7fcad5f77700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcad00bf550 0x7fcad00b9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:58.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.230+0000 7fcad5776700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcad014d040 0x7fcad00bc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:40822/0 (socket says 172.21.15.158:40822) 2023-10-18T17:26:58.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.230+0000 7fcad5776700 1 -- 172.21.15.158:0/4006511763 learned_addr learned my addr 172.21.15.158:0/4006511763 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:26:58.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.230+0000 7fcad6778700 1 --2- 172.21.15.158:0/4006511763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcad014d420 0x7fcad00bcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:58.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.230+0000 7fcad5776700 1 -- 172.21.15.158:0/4006511763 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcad00bf550 msgr2=0x7fcad00b9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:58.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.230+0000 7fcad5776700 1 --2- 172.21.15.158:0/4006511763 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcad00bf550 0x7fcad00b9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:58.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.230+0000 7fcad5776700 1 -- 172.21.15.158:0/4006511763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcad014d420 msgr2=0x7fcad00bcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:58.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.230+0000 7fcad5776700 1 --2- 172.21.15.158:0/4006511763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcad014d420 0x7fcad00bcec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:58.243 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.230+0000 7fcad5776700 1 -- 172.21.15.158:0/4006511763 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac00092a0 con 0x7fcad014d040 2023-10-18T17:26:58.243 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.230+0000 7fcad5776700 1 --2- 172.21.15.158:0/4006511763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcad014d040 0x7fcad00bc9d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fcad00679c0 tx=0x7fcac0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:58.243 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.234+0000 7fcac5ffb700 1 -- 172.21.15.158:0/4006511763 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000dd30 con 0x7fcad014d040 2023-10-18T17:26:58.243 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.234+0000 7fcac5ffb700 1 -- 172.21.15.158:0/4006511763 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac000de90 con 0x7fcad014d040 2023-10-18T17:26:58.243 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.234+0000 7fcad6f79700 1 -- 172.21.15.158:0/4006511763 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad00b7ec0 con 0x7fcad014d040 2023-10-18T17:26:58.244 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.234+0000 7fcac5ffb700 1 -- 172.21.15.158:0/4006511763 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000d980 con 0x7fcad014d040 2023-10-18T17:26:58.245 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.234+0000 7fcad6f79700 1 -- 172.21.15.158:0/4006511763 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad00b8480 con 0x7fcad014d040 2023-10-18T17:26:58.245 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.234+0000 7fcad6f79700 1 -- 172.21.15.158:0/4006511763 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad0046f00 con 0x7fcad014d040 2023-10-18T17:26:58.245 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.234+0000 7fcac5ffb700 1 -- 172.21.15.158:0/4006511763 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcac001d640 con 0x7fcad014d040 2023-10-18T17:26:58.245 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.238+0000 7fcac5ffb700 1 --2- 172.21.15.158:0/4006511763 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcab405a510 0x7fcab405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:26:58.245 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.238+0000 7fcac5ffb700 1 -- 172.21.15.158:0/4006511763 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fcac0076190 con 0x7fcad014d040 2023-10-18T17:26:58.246 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.238+0000 7fcad5f77700 1 --2- 172.21.15.158:0/4006511763 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcab405a510 0x7fcab405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:26:58.246 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.238+0000 7fcad5f77700 1 --2- 172.21.15.158:0/4006511763 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcab405a510 0x7fcab405c9d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fcacc009c30 tx=0x7fcacc009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:26:58.253 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.246+0000 7fcac5ffb700 1 -- 172.21.15.158:0/4006511763 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fcac0049650 con 0x7fcad014d040 2023-10-18T17:26:58.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.446+0000 7fcad6f79700 1 -- 172.21.15.158:0/4006511763 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcad005eb90 con 0x7fcad014d040 2023-10-18T17:26:58.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.446+0000 7fcac5ffb700 1 -- 172.21.15.158:0/4006511763 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fcac004cc70 con 0x7fcad014d040 2023-10-18T17:26:58.453 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:26:58.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.450+0000 7fcad6f79700 1 -- 172.21.15.158:0/4006511763 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcab405a510 msgr2=0x7fcab405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:58.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.450+0000 7fcad6f79700 1 --2- 172.21.15.158:0/4006511763 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcab405a510 0x7fcab405c9d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fcacc009c30 tx=0x7fcacc009060).stop 2023-10-18T17:26:58.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.450+0000 7fcad6f79700 1 -- 172.21.15.158:0/4006511763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcad014d040 msgr2=0x7fcad00bc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:26:58.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.450+0000 7fcad6f79700 1 --2- 172.21.15.158:0/4006511763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcad014d040 0x7fcad00bc9d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fcad00679c0 tx=0x7fcac0016000).stop 2023-10-18T17:26:58.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.450+0000 7fcad6f79700 1 -- 172.21.15.158:0/4006511763 shutdown_connections 2023-10-18T17:26:58.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.450+0000 7fcad6f79700 1 --2- 172.21.15.158:0/4006511763 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcab405a510 0x7fcab405c9d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:58.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.450+0000 7fcad6f79700 1 --2- 172.21.15.158:0/4006511763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcad014d420 0x7fcad00bcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:58.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.450+0000 7fcad6f79700 1 --2- 172.21.15.158:0/4006511763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcad014d040 0x7fcad00bc9d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:58.457 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.450+0000 7fcad6f79700 1 --2- 172.21.15.158:0/4006511763 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcad00bf550 0x7fcad00b9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:26:58.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.450+0000 7fcad6f79700 1 -- 172.21.15.158:0/4006511763 >> 172.21.15.158:0/4006511763 conn(0x7fcad0069d80 msgr2=0x7fcad014b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:26:58.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.450+0000 7fcad6f79700 1 -- 172.21.15.158:0/4006511763 shutdown_connections 2023-10-18T17:26:58.458 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:26:58.450+0000 7fcad6f79700 1 -- 172.21.15.158:0/4006511763 wait complete. 2023-10-18T17:26:58.474 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:27:01.476 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:27:01.642 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.634+0000 7f74a70b9700 1 Processor -- start 2023-10-18T17:27:01.643 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.638+0000 7f74a70b9700 1 -- start start 2023-10-18T17:27:01.646 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.638+0000 7f74a70b9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74a00bdf20 0x7f74a00be300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:01.646 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.638+0000 7f74a70b9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a00bd1a0 con 0x7f74a00686b0 2023-10-18T17:27:01.647 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.638+0000 7f74a70b9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a00bd480 con 0x7f74a00c2630 2023-10-18T17:27:01.647 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.638+0000 7f74a70b9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a0069e70 con 0x7f74a00bdf20 2023-10-18T17:27:01.647 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a58b6700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f74a00c2630 0x7f74a00bc8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:57554/0 (socket says 172.21.15.158:57554) 2023-10-18T17:27:01.647 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a60b7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74a00bdf20 0x7f74a00be300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:01.648 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a58b6700 1 -- 172.21.15.158:0/394558215 learned_addr learned my addr 172.21.15.158:0/394558215 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:27:01.649 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a50b5700 1 -- 172.21.15.158:0/394558215 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818801911 0 0) 0x7f74a00bd480 con 0x7f74a00c2630 2023-10-18T17:27:01.649 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a50b5700 1 -- 172.21.15.158:0/394558215 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f748c0033f0 con 0x7f74a00c2630 2023-10-18T17:27:01.649 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a50b5700 1 -- 172.21.15.158:0/394558215 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982122100 0 0) 0x7f74a00bd1a0 con 0x7f74a00686b0 2023-10-18T17:27:01.649 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a50b5700 1 -- 172.21.15.158:0/394558215 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74a00bd480 con 0x7f74a00686b0 2023-10-18T17:27:01.650 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a60b7700 1 -- 172.21.15.158:0/394558215 >> v1:172.21.15.183:6789/0 conn(0x7f74a00c2630 legacy=0x7f74a00bc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:01.650 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a60b7700 1 -- 172.21.15.158:0/394558215 >> v1:172.21.15.158:6789/0 conn(0x7f74a00686b0 legacy=0x7f74a014d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:01.650 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a60b7700 1 -- 172.21.15.158:0/394558215 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a00bd760 con 0x7f74a00bdf20 2023-10-18T17:27:01.650 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a60b7700 1 --2- 172.21.15.158:0/394558215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74a00bdf20 0x7f74a00be300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f749c009790 tx=0x7f749c009060).ready entity=mon.2 client_cookie=9557c07f92e14816 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:01.650 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a50b5700 1 -- 172.21.15.158:0/394558215 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c00f510 con 0x7f74a00bdf20 2023-10-18T17:27:01.651 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a50b5700 1 -- 172.21.15.158:0/394558215 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749c00f670 con 0x7f74a00bdf20 2023-10-18T17:27:01.651 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a50b5700 1 -- 172.21.15.158:0/394558215 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c00f9f0 con 0x7f74a00bdf20 2023-10-18T17:27:01.652 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a70b9700 1 -- 172.21.15.158:0/394558215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74a00bdf20 msgr2=0x7f74a00be300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:01.652 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a70b9700 1 --2- 172.21.15.158:0/394558215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74a00bdf20 0x7f74a00be300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f749c009790 tx=0x7f749c009060).stop 2023-10-18T17:27:01.652 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a70b9700 1 -- 172.21.15.158:0/394558215 shutdown_connections 2023-10-18T17:27:01.653 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a70b9700 1 --2- 172.21.15.158:0/394558215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74a00bdf20 0x7f74a00be300 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:01.653 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a70b9700 1 -- 172.21.15.158:0/394558215 >> 172.21.15.158:0/394558215 conn(0x7f74a0062ba0 msgr2=0x7f74a00c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:01.653 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a70b9700 1 -- 172.21.15.158:0/394558215 shutdown_connections 2023-10-18T17:27:01.653 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.642+0000 7f74a70b9700 1 -- 172.21.15.158:0/394558215 wait complete. 2023-10-18T17:27:01.653 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.646+0000 7f74a70b9700 1 Processor -- start 2023-10-18T17:27:01.654 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.646+0000 7f74a70b9700 1 -- start start 2023-10-18T17:27:01.656 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.646+0000 7f74a70b9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74a00686b0 0x7f74a01502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:01.656 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.646+0000 7f74a70b9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74a00bdf20 0x7f74a00a19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:01.656 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.646+0000 7f74a70b9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74a00c2630 0x7f74a00a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:01.656 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.646+0000 7f74a70b9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00a2390 con 0x7f74a00c2630 2023-10-18T17:27:01.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.646+0000 7f74a70b9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a015dfe0 con 0x7f74a00686b0 2023-10-18T17:27:01.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.646+0000 7f74a70b9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a015e2c0 con 0x7f74a00bdf20 2023-10-18T17:27:01.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.646+0000 7f74a60b7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74a00686b0 0x7f74a01502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:01.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.646+0000 7f74a60b7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74a00686b0 0x7f74a01502d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:45806/0 (socket says 172.21.15.158:45806) 2023-10-18T17:27:01.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.646+0000 7f74a60b7700 1 -- 172.21.15.158:0/3513584453 learned_addr learned my addr 172.21.15.158:0/3513584453 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:01.658 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.646+0000 7f74a58b6700 1 --2- 172.21.15.158:0/3513584453 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74a00bdf20 0x7f74a00a19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:01.658 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.646+0000 7f74a68b8700 1 --2- 172.21.15.158:0/3513584453 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74a00c2630 0x7f74a00a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:01.658 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.650+0000 7f74a60b7700 1 -- 172.21.15.158:0/3513584453 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74a00bdf20 msgr2=0x7f74a00a19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:01.658 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.650+0000 7f74a60b7700 1 --2- 172.21.15.158:0/3513584453 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74a00bdf20 0x7f74a00a19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:01.658 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.650+0000 7f74a60b7700 1 -- 172.21.15.158:0/3513584453 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74a00c2630 msgr2=0x7f74a00a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:01.659 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.650+0000 7f74a60b7700 1 --2- 172.21.15.158:0/3513584453 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74a00c2630 0x7f74a00a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:01.659 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.650+0000 7f74a60b7700 1 -- 172.21.15.158:0/3513584453 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749c0092a0 con 0x7f74a00686b0 2023-10-18T17:27:01.659 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.650+0000 7f74a68b8700 1 --2- 172.21.15.158:0/3513584453 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74a00c2630 0x7f74a00a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:27:01.659 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.650+0000 7f74a60b7700 1 --2- 172.21.15.158:0/3513584453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74a00686b0 0x7f74a01502d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f74a0067180 tx=0x7f749c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:01.659 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.650+0000 7f74967fc700 1 -- 172.21.15.158:0/3513584453 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c00fe80 con 0x7f74a00686b0 2023-10-18T17:27:01.660 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.650+0000 7f74967fc700 1 -- 172.21.15.158:0/3513584453 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749c00f7e0 con 0x7f74a00686b0 2023-10-18T17:27:01.660 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.650+0000 7f74967fc700 1 -- 172.21.15.158:0/3513584453 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c01b640 con 0x7f74a00686b0 2023-10-18T17:27:01.660 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.650+0000 7f74a70b9700 1 -- 172.21.15.158:0/3513584453 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a015e5a0 con 0x7f74a00686b0 2023-10-18T17:27:01.660 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.650+0000 7f74a70b9700 1 -- 172.21.15.158:0/3513584453 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a015eb60 con 0x7f74a00686b0 2023-10-18T17:27:01.661 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.650+0000 7f74a70b9700 1 -- 172.21.15.158:0/3513584453 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a0046f00 con 0x7f74a00686b0 2023-10-18T17:27:01.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.654+0000 7f74967fc700 1 -- 172.21.15.158:0/3513584453 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f749c01b9b0 con 0x7f74a00686b0 2023-10-18T17:27:01.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.654+0000 7f74967fc700 1 --2- 172.21.15.158:0/3513584453 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f748405a540 0x7f748405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:01.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.654+0000 7f74967fc700 1 -- 172.21.15.158:0/3513584453 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f749c076be0 con 0x7f74a00686b0 2023-10-18T17:27:01.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.654+0000 7f74a58b6700 1 --2- 172.21.15.158:0/3513584453 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f748405a540 0x7f748405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:01.663 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.654+0000 7f74a58b6700 1 --2- 172.21.15.158:0/3513584453 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f748405a540 0x7f748405ca00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f74a00a7af0 tx=0x7f7490009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:01.669 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.662+0000 7f74967fc700 1 -- 172.21.15.158:0/3513584453 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f749c04a120 con 0x7f74a00686b0 2023-10-18T17:27:01.680 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~115s 2023-10-18T17:27:01.680 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~169s 2023-10-18T17:27:01.680 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~95s 2023-10-18T17:27:01.680 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~82s 2023-10-18T17:27:01.680 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~129s 2023-10-18T17:27:01.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~69s 2023-10-18T17:27:01.865 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.858+0000 7f74a70b9700 1 -- 172.21.15.158:0/3513584453 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f74a00a8050 con 0x7f74a00686b0 2023-10-18T17:27:01.866 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.858+0000 7f74967fc700 1 -- 172.21.15.158:0/3513584453 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f749c04d740 con 0x7f74a00686b0 2023-10-18T17:27:01.867 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:27:01.869 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.862+0000 7f74a70b9700 1 -- 172.21.15.158:0/3513584453 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f748405a540 msgr2=0x7f748405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:01.869 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.862+0000 7f74a70b9700 1 --2- 172.21.15.158:0/3513584453 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f748405a540 0x7f748405ca00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f74a00a7af0 tx=0x7f7490009040).stop 2023-10-18T17:27:01.869 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.862+0000 7f74a70b9700 1 -- 172.21.15.158:0/3513584453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74a00686b0 msgr2=0x7f74a01502d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:01.870 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.862+0000 7f74a70b9700 1 --2- 172.21.15.158:0/3513584453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74a00686b0 0x7f74a01502d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f74a0067180 tx=0x7f749c017000).stop 2023-10-18T17:27:01.870 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.862+0000 7f74a70b9700 1 -- 172.21.15.158:0/3513584453 shutdown_connections 2023-10-18T17:27:01.870 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.862+0000 7f74a70b9700 1 --2- 172.21.15.158:0/3513584453 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f748405a540 0x7f748405ca00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:01.870 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.862+0000 7f74a70b9700 1 --2- 172.21.15.158:0/3513584453 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74a00c2630 0x7f74a00a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:01.870 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.862+0000 7f74a70b9700 1 --2- 172.21.15.158:0/3513584453 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74a00bdf20 0x7f74a00a19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:01.871 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.862+0000 7f74a70b9700 1 --2- 172.21.15.158:0/3513584453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74a00686b0 0x7f74a01502d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:01.871 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.862+0000 7f74a70b9700 1 -- 172.21.15.158:0/3513584453 >> 172.21.15.158:0/3513584453 conn(0x7f74a0062ba0 msgr2=0x7f74a0068b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:01.871 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.862+0000 7f74a70b9700 1 -- 172.21.15.158:0/3513584453 shutdown_connections 2023-10-18T17:27:01.871 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:01.862+0000 7f74a70b9700 1 -- 172.21.15.158:0/3513584453 wait complete. 2023-10-18T17:27:01.888 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:27:04.232 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:27:04.239 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:27:04.889 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:27:05.055 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.050+0000 7f9c9b29d700 1 Processor -- start 2023-10-18T17:27:05.056 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.050+0000 7f9c9b29d700 1 -- start start 2023-10-18T17:27:05.057 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.050+0000 7f9c9b29d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9c940658a0 0x7f9c94065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:05.057 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.050+0000 7f9c9b29d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c940bd1c0 0x7f9c9414ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:05.057 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.050+0000 7f9c9b29d700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c940be2e0 con 0x7f9c940c2bf0 2023-10-18T17:27:05.057 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.050+0000 7f9c9b29d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c940bda80 con 0x7f9c940658a0 2023-10-18T17:27:05.058 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.050+0000 7f9c9b29d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9406a7c0 con 0x7f9c940bd1c0 2023-10-18T17:27:05.059 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.050+0000 7f9c99a9a700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f9c940c2bf0 0x7f9c940630e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:57564/0 (socket says 172.21.15.158:57564) 2023-10-18T17:27:05.059 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.050+0000 7f9c99a9a700 1 -- 172.21.15.158:0/3761220003 learned_addr learned my addr 172.21.15.158:0/3761220003 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:27:05.059 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.050+0000 7f9c9a29b700 1 --2- 172.21.15.158:0/3761220003 >> v2:172.21.15.158:3300/0 conn(0x7f9c940658a0 0x7f9c94065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:05.060 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.050+0000 7f9c9aa9c700 1 --2- 172.21.15.158:0/3761220003 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c940bd1c0 0x7f9c9414ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:05.060 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.050+0000 7f9c99299700 1 -- 172.21.15.158:0/3761220003 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078155730 0 0) 0x7f9c940be2e0 con 0x7f9c940c2bf0 2023-10-18T17:27:05.060 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.050+0000 7f9c99299700 1 -- 172.21.15.158:0/3761220003 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c800033f0 con 0x7f9c940c2bf0 2023-10-18T17:27:05.060 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.050+0000 7f9c9a29b700 1 -- 172.21.15.158:0/3761220003 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c940bd1c0 msgr2=0x7f9c9414ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:27:05.060 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.054+0000 7f9c9a29b700 1 --2- 172.21.15.158:0/3761220003 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c940bd1c0 0x7f9c9414ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:05.061 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.054+0000 7f9c9a29b700 1 -- 172.21.15.158:0/3761220003 >> v1:172.21.15.183:6789/0 conn(0x7f9c940c2bf0 legacy=0x7f9c940630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:05.061 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.054+0000 7f9c9a29b700 1 -- 172.21.15.158:0/3761220003 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c940be770 con 0x7f9c940658a0 2023-10-18T17:27:05.061 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.054+0000 7f9c9a29b700 1 --2- 172.21.15.158:0/3761220003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c940658a0 0x7f9c94065c80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f9c90009e60 tx=0x7f9c90009780).ready entity=mon.0 client_cookie=c69ca3ff113640ed server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:05.062 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.054+0000 7f9c99299700 1 -- 172.21.15.158:0/3761220003 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9000e070 con 0x7f9c940658a0 2023-10-18T17:27:05.062 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.054+0000 7f9c99299700 1 -- 172.21.15.158:0/3761220003 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9000bab0 con 0x7f9c940658a0 2023-10-18T17:27:05.062 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.054+0000 7f9c99299700 1 -- 172.21.15.158:0/3761220003 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9000be30 con 0x7f9c940658a0 2023-10-18T17:27:05.063 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.054+0000 7f9c9b29d700 1 -- 172.21.15.158:0/3761220003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c940658a0 msgr2=0x7f9c94065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:05.063 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.054+0000 7f9c9b29d700 1 --2- 172.21.15.158:0/3761220003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c940658a0 0x7f9c94065c80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f9c90009e60 tx=0x7f9c90009780).stop 2023-10-18T17:27:05.063 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.054+0000 7f9c9b29d700 1 -- 172.21.15.158:0/3761220003 shutdown_connections 2023-10-18T17:27:05.063 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.054+0000 7f9c9b29d700 1 --2- 172.21.15.158:0/3761220003 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c940bd1c0 0x7f9c9414ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:05.063 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.054+0000 7f9c9b29d700 1 --2- 172.21.15.158:0/3761220003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c940658a0 0x7f9c94065c80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:05.064 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.054+0000 7f9c9b29d700 1 -- 172.21.15.158:0/3761220003 >> 172.21.15.158:0/3761220003 conn(0x7f9c94062ba0 msgr2=0x7f9c940c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:05.064 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.054+0000 7f9c9b29d700 1 -- 172.21.15.158:0/3761220003 shutdown_connections 2023-10-18T17:27:05.064 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.054+0000 7f9c9b29d700 1 -- 172.21.15.158:0/3761220003 wait complete. 2023-10-18T17:27:05.065 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.058+0000 7f9c9b29d700 1 Processor -- start 2023-10-18T17:27:05.065 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.058+0000 7f9c9b29d700 1 -- start start 2023-10-18T17:27:05.065 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.058+0000 7f9c9b29d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c940658a0 0x7f9c940a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:05.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.058+0000 7f9c9b29d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c940bd1c0 0x7f9c941615c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:05.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.058+0000 7f9c9b29d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c940c2bf0 0x7f9c94161ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:05.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.058+0000 7f9c9b29d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c940c13f0 con 0x7f9c940c2bf0 2023-10-18T17:27:05.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.058+0000 7f9c9b29d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c940c28c0 con 0x7f9c940658a0 2023-10-18T17:27:05.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.058+0000 7f9c9b29d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c94162160 con 0x7f9c940bd1c0 2023-10-18T17:27:05.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.058+0000 7f9c9aa9c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c940c2bf0 0x7f9c94161ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:05.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.058+0000 7f9c99a9a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c940bd1c0 0x7f9c941615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:05.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.058+0000 7f9c9a29b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c940658a0 0x7f9c940a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:05.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.058+0000 7f9c9a29b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c940658a0 0x7f9c940a0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:45814/0 (socket says 172.21.15.158:45814) 2023-10-18T17:27:05.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.058+0000 7f9c9a29b700 1 -- 172.21.15.158:0/361585279 learned_addr learned my addr 172.21.15.158:0/361585279 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:05.068 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.058+0000 7f9c9aa9c700 1 -- 172.21.15.158:0/361585279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c940bd1c0 msgr2=0x7f9c941615c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:05.069 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.058+0000 7f9c9aa9c700 1 --2- 172.21.15.158:0/361585279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c940bd1c0 0x7f9c941615c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:05.069 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.058+0000 7f9c9aa9c700 1 -- 172.21.15.158:0/361585279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c940658a0 msgr2=0x7f9c940a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:05.069 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.058+0000 7f9c9aa9c700 1 --2- 172.21.15.158:0/361585279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c940658a0 0x7f9c940a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:05.069 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.058+0000 7f9c9aa9c700 1 -- 172.21.15.158:0/361585279 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c90009a20 con 0x7f9c940c2bf0 2023-10-18T17:27:05.070 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.058+0000 7f9c9aa9c700 1 --2- 172.21.15.158:0/361585279 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c940c2bf0 0x7f9c94161ab0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f9c8c00e900 tx=0x7f9c8c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:05.070 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.062+0000 7f9c8a7fc700 1 -- 172.21.15.158:0/361585279 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c009430 con 0x7f9c940c2bf0 2023-10-18T17:27:05.070 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.062+0000 7f9c8a7fc700 1 -- 172.21.15.158:0/361585279 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c012600 con 0x7f9c940c2bf0 2023-10-18T17:27:05.070 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.062+0000 7f9c8a7fc700 1 -- 172.21.15.158:0/361585279 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c012980 con 0x7f9c940c2bf0 2023-10-18T17:27:05.070 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.062+0000 7f9c9b29d700 1 -- 172.21.15.158:0/361585279 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c940c07e0 con 0x7f9c940c2bf0 2023-10-18T17:27:05.071 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.062+0000 7f9c9b29d700 1 -- 172.21.15.158:0/361585279 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c940c0da0 con 0x7f9c940c2bf0 2023-10-18T17:27:05.071 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.062+0000 7f9c9b29d700 1 -- 172.21.15.158:0/361585279 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c940b9fe0 con 0x7f9c940c2bf0 2023-10-18T17:27:05.072 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.062+0000 7f9c8a7fc700 1 -- 172.21.15.158:0/361585279 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9c8c012cf0 con 0x7f9c940c2bf0 2023-10-18T17:27:05.072 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.066+0000 7f9c8a7fc700 1 --2- 172.21.15.158:0/361585279 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9c7805a540 0x7f9c7805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:05.072 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.066+0000 7f9c8a7fc700 1 -- 172.21.15.158:0/361585279 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f9c8c074d40 con 0x7f9c940c2bf0 2023-10-18T17:27:05.072 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.066+0000 7f9c9a29b700 1 --2- 172.21.15.158:0/361585279 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9c7805a540 0x7f9c7805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:05.073 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.066+0000 7f9c9a29b700 1 --2- 172.21.15.158:0/361585279 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9c7805a540 0x7f9c7805ca00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f9c94067180 tx=0x7f9c90009780).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:05.077 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.070+0000 7f9c8a7fc700 1 -- 172.21.15.158:0/361585279 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f9c940b9fe0 con 0x7f9c940c2bf0 2023-10-18T17:27:05.281 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.274+0000 7f9c9b29d700 1 -- 172.21.15.158:0/361585279 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9c940b9fe0 con 0x7f9c940c2bf0 2023-10-18T17:27:05.282 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.274+0000 7f9c8a7fc700 1 -- 172.21.15.158:0/361585279 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f9c940b9fe0 con 0x7f9c940c2bf0 2023-10-18T17:27:05.282 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:27:05.285 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.278+0000 7f9c9b29d700 1 -- 172.21.15.158:0/361585279 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9c7805a540 msgr2=0x7f9c7805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:05.285 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.278+0000 7f9c9b29d700 1 --2- 172.21.15.158:0/361585279 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9c7805a540 0x7f9c7805ca00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f9c94067180 tx=0x7f9c90009780).stop 2023-10-18T17:27:05.285 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.278+0000 7f9c9b29d700 1 -- 172.21.15.158:0/361585279 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c940c2bf0 msgr2=0x7f9c94161ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:05.285 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.278+0000 7f9c9b29d700 1 --2- 172.21.15.158:0/361585279 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c940c2bf0 0x7f9c94161ab0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f9c8c00e900 tx=0x7f9c8c009060).stop 2023-10-18T17:27:05.286 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.278+0000 7f9c9b29d700 1 -- 172.21.15.158:0/361585279 shutdown_connections 2023-10-18T17:27:05.286 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.278+0000 7f9c9b29d700 1 --2- 172.21.15.158:0/361585279 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9c7805a540 0x7f9c7805ca00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:05.286 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.278+0000 7f9c9b29d700 1 --2- 172.21.15.158:0/361585279 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c940c2bf0 0x7f9c94161ab0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:05.286 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.278+0000 7f9c9b29d700 1 --2- 172.21.15.158:0/361585279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c940bd1c0 0x7f9c941615c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:05.286 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.278+0000 7f9c9b29d700 1 --2- 172.21.15.158:0/361585279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c940658a0 0x7f9c940a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:05.287 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.278+0000 7f9c9b29d700 1 -- 172.21.15.158:0/361585279 >> 172.21.15.158:0/361585279 conn(0x7f9c94062ba0 msgr2=0x7f9c9414e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:05.287 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.278+0000 7f9c9b29d700 1 -- 172.21.15.158:0/361585279 shutdown_connections 2023-10-18T17:27:05.287 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:05.278+0000 7f9c9b29d700 1 -- 172.21.15.158:0/361585279 wait complete. 2023-10-18T17:27:05.305 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:27:07.992 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~121s 2023-10-18T17:27:07.992 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~176s 2023-10-18T17:27:07.993 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~102s 2023-10-18T17:27:07.993 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~89s 2023-10-18T17:27:07.993 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~135s 2023-10-18T17:27:07.993 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~76s 2023-10-18T17:27:08.306 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:27:08.472 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.466+0000 7f163908f700 1 Processor -- start 2023-10-18T17:27:08.473 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.466+0000 7f163908f700 1 -- start start 2023-10-18T17:27:08.475 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f163908f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f163414d170 0x7f163406a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:08.475 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f163908f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1634067d30 0x7f16340630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:08.475 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f163908f700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1634068910 con 0x7f1634068150 2023-10-18T17:27:08.476 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f163908f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1634150c10 con 0x7f1634067d30 2023-10-18T17:27:08.476 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f163908f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1634150780 con 0x7f163414d170 2023-10-18T17:27:08.477 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f1633fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f163414d170 0x7f163406a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:08.478 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f1633fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f163414d170 0x7f163406a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:50534/0 (socket says 172.21.15.158:50534) 2023-10-18T17:27:08.478 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f163888e700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f1634068150 0x7f1634065700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:42326/0 (socket says 172.21.15.158:42326) 2023-10-18T17:27:08.478 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f1633fff700 1 -- 172.21.15.158:0/110127956 learned_addr learned my addr 172.21.15.158:0/110127956 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:08.478 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f162b7fe700 1 --2- 172.21.15.158:0/110127956 >> v2:172.21.15.158:3300/0 conn(0x7f1634067d30 0x7f16340630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:08.478 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f1633fff700 1 -- 172.21.15.158:0/110127956 >> v2:172.21.15.158:3300/0 conn(0x7f1634067d30 msgr2=0x7f16340630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:27:08.479 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f1633fff700 1 --2- 172.21.15.158:0/110127956 >> v2:172.21.15.158:3300/0 conn(0x7f1634067d30 0x7f16340630e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:08.479 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f1633fff700 1 -- 172.21.15.158:0/110127956 >> v1:172.21.15.158:6789/0 conn(0x7f1634068150 legacy=0x7f1634065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:08.479 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f1633fff700 1 -- 172.21.15.158:0/110127956 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1634068630 con 0x7f163414d170 2023-10-18T17:27:08.479 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f1633fff700 1 --2- 172.21.15.158:0/110127956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f163414d170 0x7f163406a150 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f1624006fd0 tx=0x7f16240090f0).ready entity=mon.2 client_cookie=5f99250c003b4220 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:08.479 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f16337fe700 1 -- 172.21.15.158:0/110127956 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162400b610 con 0x7f163414d170 2023-10-18T17:27:08.480 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f16337fe700 1 -- 172.21.15.158:0/110127956 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162400b770 con 0x7f163414d170 2023-10-18T17:27:08.480 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f16337fe700 1 -- 172.21.15.158:0/110127956 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162400baf0 con 0x7f163414d170 2023-10-18T17:27:08.481 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f163908f700 1 -- 172.21.15.158:0/110127956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f163414d170 msgr2=0x7f163406a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:08.481 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.470+0000 7f163908f700 1 --2- 172.21.15.158:0/110127956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f163414d170 0x7f163406a150 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f1624006fd0 tx=0x7f16240090f0).stop 2023-10-18T17:27:08.482 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.474+0000 7f163908f700 1 -- 172.21.15.158:0/110127956 shutdown_connections 2023-10-18T17:27:08.482 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.474+0000 7f163908f700 1 --2- 172.21.15.158:0/110127956 >> v2:172.21.15.158:3300/0 conn(0x7f1634067d30 0x7f16340630e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:08.482 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.474+0000 7f163908f700 1 --2- 172.21.15.158:0/110127956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f163414d170 0x7f163406a150 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:08.482 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.474+0000 7f163908f700 1 -- 172.21.15.158:0/110127956 >> 172.21.15.158:0/110127956 conn(0x7f1634062ba0 msgr2=0x7f16340c6330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:08.483 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.474+0000 7f163908f700 1 -- 172.21.15.158:0/110127956 shutdown_connections 2023-10-18T17:27:08.483 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.474+0000 7f163908f700 1 -- 172.21.15.158:0/110127956 wait complete. 2023-10-18T17:27:08.483 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.474+0000 7f163908f700 1 Processor -- start 2023-10-18T17:27:08.483 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.474+0000 7f163908f700 1 -- start start 2023-10-18T17:27:08.485 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.474+0000 7f163908f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1634067d30 0x7f163414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:08.485 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.474+0000 7f163908f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1634068150 0x7f16341639d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:08.486 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.474+0000 7f163908f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f163414d170 0x7f1634163ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:08.486 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.474+0000 7f163908f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16341643b0 con 0x7f1634068150 2023-10-18T17:27:08.486 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.474+0000 7f163908f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16340c00e0 con 0x7f1634067d30 2023-10-18T17:27:08.486 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.474+0000 7f163908f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1634151400 con 0x7f163414d170 2023-10-18T17:27:08.487 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.478+0000 7f162b7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1634068150 0x7f16341639d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:08.487 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.478+0000 7f162b7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1634068150 0x7f16341639d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:37216/0 (socket says 172.21.15.158:37216) 2023-10-18T17:27:08.487 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.478+0000 7f1633fff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1634067d30 0x7f163414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:08.487 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.478+0000 7f162b7fe700 1 -- 172.21.15.158:0/3052063044 learned_addr learned my addr 172.21.15.158:0/3052063044 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:08.487 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.478+0000 7f163888e700 1 --2- 172.21.15.158:0/3052063044 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f163414d170 0x7f1634163ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:08.488 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.478+0000 7f162b7fe700 1 -- 172.21.15.158:0/3052063044 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f163414d170 msgr2=0x7f1634163ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:08.488 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.478+0000 7f162b7fe700 1 --2- 172.21.15.158:0/3052063044 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f163414d170 0x7f1634163ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:08.488 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.478+0000 7f162b7fe700 1 -- 172.21.15.158:0/3052063044 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1634067d30 msgr2=0x7f163414b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:08.488 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.478+0000 7f162b7fe700 1 --2- 172.21.15.158:0/3052063044 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1634067d30 0x7f163414b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:08.488 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.478+0000 7f162b7fe700 1 -- 172.21.15.158:0/3052063044 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1624009370 con 0x7f1634068150 2023-10-18T17:27:08.488 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.478+0000 7f1633fff700 1 --2- 172.21.15.158:0/3052063044 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1634067d30 0x7f163414b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:27:08.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.478+0000 7f162b7fe700 1 --2- 172.21.15.158:0/3052063044 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1634068150 0x7f16341639d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f161c00e900 tx=0x7f161c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:08.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.478+0000 7f1630ff9700 1 -- 172.21.15.158:0/3052063044 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c009510 con 0x7f1634068150 2023-10-18T17:27:08.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.478+0000 7f1630ff9700 1 -- 172.21.15.158:0/3052063044 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c012600 con 0x7f1634068150 2023-10-18T17:27:08.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.478+0000 7f163908f700 1 -- 172.21.15.158:0/3052063044 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16341645f0 con 0x7f1634068150 2023-10-18T17:27:08.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.478+0000 7f1630ff9700 1 -- 172.21.15.158:0/3052063044 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c012980 con 0x7f1634068150 2023-10-18T17:27:08.490 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.478+0000 7f163908f700 1 -- 172.21.15.158:0/3052063044 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16340c0330 con 0x7f1634068150 2023-10-18T17:27:08.491 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.478+0000 7f163908f700 1 -- 172.21.15.158:0/3052063044 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1634046f00 con 0x7f1634068150 2023-10-18T17:27:08.491 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.482+0000 7f1630ff9700 1 -- 172.21.15.158:0/3052063044 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f161c012d30 con 0x7f1634068150 2023-10-18T17:27:08.491 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.482+0000 7f1630ff9700 1 --2- 172.21.15.158:0/3052063044 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f161405a540 0x7f161405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:08.491 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.482+0000 7f1630ff9700 1 -- 172.21.15.158:0/3052063044 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f161c074d00 con 0x7f1634068150 2023-10-18T17:27:08.491 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.482+0000 7f1633fff700 1 --2- 172.21.15.158:0/3052063044 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f161405a540 0x7f161405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:08.492 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.482+0000 7f1633fff700 1 --2- 172.21.15.158:0/3052063044 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f161405a540 0x7f161405ca00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f1624009130 tx=0x7f1624017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:08.497 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.490+0000 7f1630ff9700 1 -- 172.21.15.158:0/3052063044 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f161c048280 con 0x7f1634068150 2023-10-18T17:27:08.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.690+0000 7f163908f700 1 -- 172.21.15.158:0/3052063044 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1634151540 con 0x7f1634068150 2023-10-18T17:27:08.696 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.690+0000 7f1630ff9700 1 -- 172.21.15.158:0/3052063044 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f161c04d0e0 con 0x7f1634068150 2023-10-18T17:27:08.696 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:27:08.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.690+0000 7f163908f700 1 -- 172.21.15.158:0/3052063044 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f161405a540 msgr2=0x7f161405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:08.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.690+0000 7f163908f700 1 --2- 172.21.15.158:0/3052063044 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f161405a540 0x7f161405ca00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f1624009130 tx=0x7f1624017000).stop 2023-10-18T17:27:08.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.690+0000 7f163908f700 1 -- 172.21.15.158:0/3052063044 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1634068150 msgr2=0x7f16341639d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:08.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.690+0000 7f163908f700 1 --2- 172.21.15.158:0/3052063044 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1634068150 0x7f16341639d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f161c00e900 tx=0x7f161c009060).stop 2023-10-18T17:27:08.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.690+0000 7f163908f700 1 -- 172.21.15.158:0/3052063044 shutdown_connections 2023-10-18T17:27:08.700 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.690+0000 7f163908f700 1 --2- 172.21.15.158:0/3052063044 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f161405a540 0x7f161405ca00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:08.700 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.690+0000 7f163908f700 1 --2- 172.21.15.158:0/3052063044 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f163414d170 0x7f1634163ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:08.700 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.690+0000 7f163908f700 1 --2- 172.21.15.158:0/3052063044 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1634068150 0x7f16341639d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:08.700 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.690+0000 7f163908f700 1 --2- 172.21.15.158:0/3052063044 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1634067d30 0x7f163414b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:08.700 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.690+0000 7f163908f700 1 -- 172.21.15.158:0/3052063044 >> 172.21.15.158:0/3052063044 conn(0x7f1634062ba0 msgr2=0x7f16340656e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:08.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.690+0000 7f163908f700 1 -- 172.21.15.158:0/3052063044 shutdown_connections 2023-10-18T17:27:08.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:08.694+0000 7f163908f700 1 -- 172.21.15.158:0/3052063044 wait complete. 2023-10-18T17:27:08.720 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:27:11.721 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:27:11.885 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.878+0000 7fcdf589b700 1 Processor -- start 2023-10-18T17:27:11.885 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.878+0000 7fcdf589b700 1 -- start start 2023-10-18T17:27:11.888 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.882+0000 7fcdf589b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcdf0067ff0 0x7fcdf00683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:11.888 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.882+0000 7fcdf589b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcdf00666b0 0x7fcdf00c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:11.889 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.882+0000 7fcdf589b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcdf00c2230 0x7fcdf014cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:11.889 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.882+0000 7fcdf589b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf0065cf0 con 0x7fcdf0067ff0 2023-10-18T17:27:11.889 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.882+0000 7fcdf589b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf0150350 con 0x7fcdf00c2230 2023-10-18T17:27:11.889 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.882+0000 7fcdf589b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf00650e0 con 0x7fcdf00666b0 2023-10-18T17:27:11.890 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.882+0000 7fcdeeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcdf0067ff0 0x7fcdf00683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:11.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.882+0000 7fcdef7fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcdf00c2230 0x7fcdf014cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:11.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.882+0000 7fcde7fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcdf00666b0 0x7fcdf00c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:11.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.882+0000 7fcdeeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fcdf0067ff0 0x7fcdf00683d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:49606/0 (socket says 172.21.15.158:49606) 2023-10-18T17:27:11.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.882+0000 7fcdeeffd700 1 -- 172.21.15.158:0/2851664819 learned_addr learned my addr 172.21.15.158:0/2851664819 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:11.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.882+0000 7fcdeeffd700 1 -- 172.21.15.158:0/2851664819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcdf00666b0 msgr2=0x7fcdf00c1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:27:11.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.882+0000 7fcdeeffd700 1 --2- 172.21.15.158:0/2851664819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcdf00666b0 0x7fcdf00c1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:11.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.882+0000 7fcdeeffd700 1 -- 172.21.15.158:0/2851664819 >> v2:172.21.15.183:3300/0 conn(0x7fcdf00c2230 msgr2=0x7fcdf014cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:27:11.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.882+0000 7fcdeeffd700 1 --2- 172.21.15.158:0/2851664819 >> v2:172.21.15.183:3300/0 conn(0x7fcdf00c2230 0x7fcdf014cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:11.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.882+0000 7fcdeeffd700 1 -- 172.21.15.158:0/2851664819 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf00653c0 con 0x7fcdf0067ff0 2023-10-18T17:27:11.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.882+0000 7fcdeeffd700 1 --2- 172.21.15.158:0/2851664819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcdf0067ff0 0x7fcdf00683d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fcdf0067660 tx=0x7fcde00090f0).ready entity=mon.0 client_cookie=61fe42666f7b103e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:11.893 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.882+0000 7fcdee7fc700 1 -- 172.21.15.158:0/2851664819 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde000f510 con 0x7fcdf0067ff0 2023-10-18T17:27:11.893 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.882+0000 7fcdee7fc700 1 -- 172.21.15.158:0/2851664819 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde000f670 con 0x7fcdf0067ff0 2023-10-18T17:27:11.893 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.886+0000 7fcdee7fc700 1 -- 172.21.15.158:0/2851664819 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde000f9f0 con 0x7fcdf0067ff0 2023-10-18T17:27:11.894 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.886+0000 7fcdf589b700 1 -- 172.21.15.158:0/2851664819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcdf0067ff0 msgr2=0x7fcdf00683d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:11.894 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.886+0000 7fcdf589b700 1 --2- 172.21.15.158:0/2851664819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcdf0067ff0 0x7fcdf00683d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fcdf0067660 tx=0x7fcde00090f0).stop 2023-10-18T17:27:11.894 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.886+0000 7fcdf589b700 1 -- 172.21.15.158:0/2851664819 shutdown_connections 2023-10-18T17:27:11.894 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.886+0000 7fcdf589b700 1 --2- 172.21.15.158:0/2851664819 >> v2:172.21.15.183:3300/0 conn(0x7fcdf00c2230 0x7fcdf014cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:11.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.886+0000 7fcdf589b700 1 --2- 172.21.15.158:0/2851664819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcdf00666b0 0x7fcdf00c1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:11.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.886+0000 7fcdf589b700 1 --2- 172.21.15.158:0/2851664819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcdf0067ff0 0x7fcdf00683d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:11.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.886+0000 7fcdf589b700 1 -- 172.21.15.158:0/2851664819 >> 172.21.15.158:0/2851664819 conn(0x7fcdf00620d0 msgr2=0x7fcdf00624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:11.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.886+0000 7fcdf589b700 1 -- 172.21.15.158:0/2851664819 shutdown_connections 2023-10-18T17:27:11.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.886+0000 7fcdf589b700 1 -- 172.21.15.158:0/2851664819 wait complete. 2023-10-18T17:27:11.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.886+0000 7fcdf589b700 1 Processor -- start 2023-10-18T17:27:11.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.886+0000 7fcdf589b700 1 -- start start 2023-10-18T17:27:11.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdf589b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcdf00666b0 0x7fcdf01530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:11.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdf589b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcdf0067ff0 0x7fcdf00bb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:11.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdf589b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcdf00c2230 0x7fcdf014f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:11.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdf589b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf01608d0 con 0x7fcdf00666b0 2023-10-18T17:27:11.899 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdf589b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf00bdf70 con 0x7fcdf00c2230 2023-10-18T17:27:11.899 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdf589b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf0160d90 con 0x7fcdf0067ff0 2023-10-18T17:27:11.899 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdeeffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcdf00666b0 0x7fcdf01530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:11.899 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdef7fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcdf00c2230 0x7fcdf014f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:11.900 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcde7fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcdf0067ff0 0x7fcdf00bb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:11.900 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdef7fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcdf00c2230 0x7fcdf014f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:54064/0 (socket says 172.21.15.158:54064) 2023-10-18T17:27:11.901 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdeeffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcdf00666b0 0x7fcdf01530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:49608/0 (socket says 172.21.15.158:49608) 2023-10-18T17:27:11.901 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdef7fe700 1 -- 172.21.15.158:0/2545546047 learned_addr learned my addr 172.21.15.158:0/2545546047 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:11.902 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdeeffd700 1 -- 172.21.15.158:0/2545546047 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcdf0067ff0 msgr2=0x7fcdf00bb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:11.903 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdeeffd700 1 --2- 172.21.15.158:0/2545546047 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcdf0067ff0 0x7fcdf00bb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:11.903 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdeeffd700 1 -- 172.21.15.158:0/2545546047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcdf00c2230 msgr2=0x7fcdf014f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:11.903 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdeeffd700 1 --2- 172.21.15.158:0/2545546047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcdf00c2230 0x7fcdf014f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:11.903 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdeeffd700 1 -- 172.21.15.158:0/2545546047 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde0009370 con 0x7fcdf00666b0 2023-10-18T17:27:11.903 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdef7fe700 1 --2- 172.21.15.158:0/2545546047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcdf00c2230 0x7fcdf014f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:27:11.904 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcde7fff700 1 --2- 172.21.15.158:0/2545546047 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcdf0067ff0 0x7fcdf00bb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:27:11.904 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdeeffd700 1 --2- 172.21.15.158:0/2545546047 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcdf00666b0 0x7fcdf01530f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fcdf005e8c0 tx=0x7fcde0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:11.904 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcde6ffd700 1 -- 172.21.15.158:0/2545546047 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0000bc0 con 0x7fcdf00666b0 2023-10-18T17:27:11.904 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcde6ffd700 1 -- 172.21.15.158:0/2545546047 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde000f7e0 con 0x7fcdf00666b0 2023-10-18T17:27:11.904 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcde6ffd700 1 -- 172.21.15.158:0/2545546047 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0000d20 con 0x7fcdf00666b0 2023-10-18T17:27:11.905 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdf589b700 1 -- 172.21.15.158:0/2545546047 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf0152c60 con 0x7fcdf00666b0 2023-10-18T17:27:11.905 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.890+0000 7fcdf589b700 1 -- 172.21.15.158:0/2545546047 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf0152610 con 0x7fcdf00666b0 2023-10-18T17:27:11.905 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.894+0000 7fcdf589b700 1 -- 172.21.15.158:0/2545546047 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf006c190 con 0x7fcdf00666b0 2023-10-18T17:27:11.905 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.894+0000 7fcde6ffd700 1 -- 172.21.15.158:0/2545546047 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcde0021070 con 0x7fcdf00666b0 2023-10-18T17:27:11.905 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.894+0000 7fcde6ffd700 1 --2- 172.21.15.158:0/2545546047 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcdd005a510 0x7fcdd005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:11.906 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.894+0000 7fcde6ffd700 1 -- 172.21.15.158:0/2545546047 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fcde0075d70 con 0x7fcdf00666b0 2023-10-18T17:27:11.906 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.898+0000 7fcde7fff700 1 --2- 172.21.15.158:0/2545546047 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcdd005a510 0x7fcdd005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:11.906 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.898+0000 7fcde7fff700 1 --2- 172.21.15.158:0/2545546047 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcdd005a510 0x7fcdd005c9d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fcdf0154c20 tx=0x7fcdd8009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:11.909 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:11.902+0000 7fcde6ffd700 1 -- 172.21.15.158:0/2545546047 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fcde0049230 con 0x7fcdf00666b0 2023-10-18T17:27:12.102 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:12.094+0000 7fcdf589b700 1 -- 172.21.15.158:0/2545546047 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcdf00656a0 con 0x7fcdf00666b0 2023-10-18T17:27:12.103 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:12.094+0000 7fcde6ffd700 1 -- 172.21.15.158:0/2545546047 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fcde004c850 con 0x7fcdf00666b0 2023-10-18T17:27:12.103 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:27:12.105 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:12.098+0000 7fcdf589b700 1 -- 172.21.15.158:0/2545546047 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcdd005a510 msgr2=0x7fcdd005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:12.106 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:12.098+0000 7fcdf589b700 1 --2- 172.21.15.158:0/2545546047 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcdd005a510 0x7fcdd005c9d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fcdf0154c20 tx=0x7fcdd8009060).stop 2023-10-18T17:27:12.106 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:12.098+0000 7fcdf589b700 1 -- 172.21.15.158:0/2545546047 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcdf00666b0 msgr2=0x7fcdf01530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:12.106 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:12.098+0000 7fcdf589b700 1 --2- 172.21.15.158:0/2545546047 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcdf00666b0 0x7fcdf01530f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fcdf005e8c0 tx=0x7fcde0017000).stop 2023-10-18T17:27:12.107 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:12.098+0000 7fcdf589b700 1 -- 172.21.15.158:0/2545546047 shutdown_connections 2023-10-18T17:27:12.107 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:12.098+0000 7fcdf589b700 1 --2- 172.21.15.158:0/2545546047 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcdd005a510 0x7fcdd005c9d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:12.108 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:12.098+0000 7fcdf589b700 1 --2- 172.21.15.158:0/2545546047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcdf00c2230 0x7fcdf014f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:12.108 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:12.098+0000 7fcdf589b700 1 --2- 172.21.15.158:0/2545546047 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcdf0067ff0 0x7fcdf00bb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:12.108 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:12.098+0000 7fcdf589b700 1 --2- 172.21.15.158:0/2545546047 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcdf00666b0 0x7fcdf01530f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:12.109 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:12.098+0000 7fcdf589b700 1 -- 172.21.15.158:0/2545546047 >> 172.21.15.158:0/2545546047 conn(0x7fcdf00620d0 msgr2=0x7fcdf0154e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:12.109 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:12.098+0000 7fcdf589b700 1 -- 172.21.15.158:0/2545546047 shutdown_connections 2023-10-18T17:27:12.109 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:12.098+0000 7fcdf589b700 1 -- 172.21.15.158:0/2545546047 wait complete. 2023-10-18T17:27:12.128 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:27:14.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~128s 2023-10-18T17:27:14.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~182s 2023-10-18T17:27:14.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~108s 2023-10-18T17:27:14.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~95s 2023-10-18T17:27:14.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~141s 2023-10-18T17:27:14.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~82s 2023-10-18T17:27:15.128 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:27:15.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.282+0000 7f7fcabb9700 1 Processor -- start 2023-10-18T17:27:15.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.286+0000 7f7fcabb9700 1 -- start start 2023-10-18T17:27:15.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.286+0000 7f7fcabb9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7fc40bdf20 0x7f7fc40be300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:15.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.286+0000 7f7fcabb9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fc40c2630 0x7f7fc40bc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:15.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.286+0000 7f7fcabb9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7fc40686b0 0x7f7fc4068b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:15.295 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.286+0000 7f7fcabb9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc4069e70 con 0x7f7fc40bdf20 2023-10-18T17:27:15.295 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.286+0000 7f7fcabb9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc4069030 con 0x7f7fc40686b0 2023-10-18T17:27:15.295 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.286+0000 7f7fcabb9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc40bd1a0 con 0x7f7fc40c2630 2023-10-18T17:27:15.296 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.286+0000 7f7fc9bb7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7fc40bdf20 0x7f7fc40be300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:15.297 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.286+0000 7f7fc9bb7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7fc40bdf20 0x7f7fc40be300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:49614/0 (socket says 172.21.15.158:49614) 2023-10-18T17:27:15.297 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.286+0000 7f7fc9bb7700 1 -- 172.21.15.158:0/2857708631 learned_addr learned my addr 172.21.15.158:0/2857708631 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:15.297 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fc93b6700 1 --2- 172.21.15.158:0/2857708631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fc40c2630 0x7f7fc40bc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:15.297 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fca3b8700 1 --2- 172.21.15.158:0/2857708631 >> v2:172.21.15.183:3300/0 conn(0x7f7fc40686b0 0x7f7fc4068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:15.297 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fc9bb7700 1 -- 172.21.15.158:0/2857708631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fc40c2630 msgr2=0x7f7fc40bc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:27:15.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fc9bb7700 1 --2- 172.21.15.158:0/2857708631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fc40c2630 0x7f7fc40bc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:15.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fc9bb7700 1 -- 172.21.15.158:0/2857708631 >> v2:172.21.15.183:3300/0 conn(0x7f7fc40686b0 msgr2=0x7f7fc4068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:27:15.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fc9bb7700 1 --2- 172.21.15.158:0/2857708631 >> v2:172.21.15.183:3300/0 conn(0x7f7fc40686b0 0x7f7fc4068b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:15.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fc9bb7700 1 -- 172.21.15.158:0/2857708631 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc40bd480 con 0x7f7fc40bdf20 2023-10-18T17:27:15.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fc9bb7700 1 --2- 172.21.15.158:0/2857708631 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7fc40bdf20 0x7f7fc40be300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f7fc4067780 tx=0x7f7fc000b3b0).ready entity=mon.0 client_cookie=cc3b9107847224a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:15.299 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fc8bb5700 1 -- 172.21.15.158:0/2857708631 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc000da40 con 0x7f7fc40bdf20 2023-10-18T17:27:15.299 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fc8bb5700 1 -- 172.21.15.158:0/2857708631 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc000dba0 con 0x7f7fc40bdf20 2023-10-18T17:27:15.299 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fc8bb5700 1 -- 172.21.15.158:0/2857708631 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0010470 con 0x7f7fc40bdf20 2023-10-18T17:27:15.300 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fcabb9700 1 -- 172.21.15.158:0/2857708631 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7fc40bdf20 msgr2=0x7f7fc40be300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:15.300 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fcabb9700 1 --2- 172.21.15.158:0/2857708631 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7fc40bdf20 0x7f7fc40be300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f7fc4067780 tx=0x7f7fc000b3b0).stop 2023-10-18T17:27:15.300 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fcabb9700 1 -- 172.21.15.158:0/2857708631 shutdown_connections 2023-10-18T17:27:15.301 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fcabb9700 1 --2- 172.21.15.158:0/2857708631 >> v2:172.21.15.183:3300/0 conn(0x7f7fc40686b0 0x7f7fc4068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:15.301 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fcabb9700 1 --2- 172.21.15.158:0/2857708631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fc40c2630 0x7f7fc40bc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:15.301 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fcabb9700 1 --2- 172.21.15.158:0/2857708631 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7fc40bdf20 0x7f7fc40be300 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:15.301 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fcabb9700 1 -- 172.21.15.158:0/2857708631 >> 172.21.15.158:0/2857708631 conn(0x7f7fc4062ba0 msgr2=0x7f7fc40c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:15.301 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fcabb9700 1 -- 172.21.15.158:0/2857708631 shutdown_connections 2023-10-18T17:27:15.301 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.290+0000 7f7fcabb9700 1 -- 172.21.15.158:0/2857708631 wait complete. 2023-10-18T17:27:15.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.294+0000 7f7fcabb9700 1 Processor -- start 2023-10-18T17:27:15.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.294+0000 7f7fcabb9700 1 -- start start 2023-10-18T17:27:15.303 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.294+0000 7f7fcabb9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fc40686b0 0x7f7fc414fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:15.303 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.294+0000 7f7fcabb9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fc40bdf20 0x7f7fc40a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:15.304 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.294+0000 7f7fcabb9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7fc40c2630 0x7f7fc40a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:15.304 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.294+0000 7f7fcabb9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc40a5900 con 0x7f7fc40c2630 2023-10-18T17:27:15.304 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.294+0000 7f7fcabb9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc40a6770 con 0x7f7fc40bdf20 2023-10-18T17:27:15.304 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.294+0000 7f7fcabb9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc41521c0 con 0x7f7fc40686b0 2023-10-18T17:27:15.304 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.294+0000 7f7fc9bb7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fc40686b0 0x7f7fc414fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:15.305 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.294+0000 7f7fca3b8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7fc40c2630 0x7f7fc40a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:15.305 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.294+0000 7f7fc93b6700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fc40bdf20 0x7f7fc40a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:15.305 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.294+0000 7f7fc9bb7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fc40686b0 0x7f7fc414fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:58994/0 (socket says 172.21.15.158:58994) 2023-10-18T17:27:15.305 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.294+0000 7f7fc9bb7700 1 -- 172.21.15.158:0/3434827850 learned_addr learned my addr 172.21.15.158:0/3434827850 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:15.305 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.298+0000 7f7fca3b8700 1 -- 172.21.15.158:0/3434827850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fc40686b0 msgr2=0x7f7fc414fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:15.305 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.298+0000 7f7fca3b8700 1 --2- 172.21.15.158:0/3434827850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fc40686b0 0x7f7fc414fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:15.306 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.298+0000 7f7fca3b8700 1 -- 172.21.15.158:0/3434827850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fc40bdf20 msgr2=0x7f7fc40a5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:15.306 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.298+0000 7f7fca3b8700 1 --2- 172.21.15.158:0/3434827850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fc40bdf20 0x7f7fc40a5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:15.306 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.298+0000 7f7fca3b8700 1 -- 172.21.15.158:0/3434827850 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc000b610 con 0x7f7fc40c2630 2023-10-18T17:27:15.306 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.298+0000 7f7fca3b8700 1 --2- 172.21.15.158:0/3434827850 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7fc40c2630 0x7f7fc40a6280 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f7fbc009e50 tx=0x7f7fbc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:15.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.298+0000 7f7fb9ffb700 1 -- 172.21.15.158:0/3434827850 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc00cb30 con 0x7f7fc40c2630 2023-10-18T17:27:15.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.298+0000 7f7fb9ffb700 1 -- 172.21.15.158:0/3434827850 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc00f040 con 0x7f7fc40c2630 2023-10-18T17:27:15.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.298+0000 7f7fb9ffb700 1 -- 172.21.15.158:0/3434827850 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc00cea0 con 0x7f7fc40c2630 2023-10-18T17:27:15.308 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.298+0000 7f7fcabb9700 1 -- 172.21.15.158:0/3434827850 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc4152480 con 0x7f7fc40c2630 2023-10-18T17:27:15.308 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.298+0000 7f7fcabb9700 1 -- 172.21.15.158:0/3434827850 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc4152a40 con 0x7f7fc40c2630 2023-10-18T17:27:15.308 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.298+0000 7f7fcabb9700 1 -- 172.21.15.158:0/3434827850 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc40a5ab0 con 0x7f7fc40c2630 2023-10-18T17:27:15.308 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.302+0000 7f7fb9ffb700 1 -- 172.21.15.158:0/3434827850 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7fbc013610 con 0x7f7fc40c2630 2023-10-18T17:27:15.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.302+0000 7f7fb9ffb700 1 --2- 172.21.15.158:0/3434827850 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f7fa805a540 0x7f7fa805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:15.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.302+0000 7f7fb9ffb700 1 -- 172.21.15.158:0/3434827850 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f7fbc0751f0 con 0x7f7fc40c2630 2023-10-18T17:27:15.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.302+0000 7f7fc9bb7700 1 --2- 172.21.15.158:0/3434827850 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f7fa805a540 0x7f7fa805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:15.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.302+0000 7f7fc9bb7700 1 --2- 172.21.15.158:0/3434827850 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f7fa805a540 0x7f7fa805ca00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f7fc000bfd0 tx=0x7f7fc000b3b0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:15.314 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.306+0000 7f7fb9ffb700 1 -- 172.21.15.158:0/3434827850 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f7fc40a5ab0 con 0x7f7fc40c2630 2023-10-18T17:27:15.510 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.502+0000 7f7fcabb9700 1 -- 172.21.15.158:0/3434827850 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7fc40a5a40 con 0x7f7fc40c2630 2023-10-18T17:27:15.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.506+0000 7f7fb9ffb700 1 -- 172.21.15.158:0/3434827850 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f7fbc048770 con 0x7f7fc40c2630 2023-10-18T17:27:15.512 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:27:15.514 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.506+0000 7f7fcabb9700 1 -- 172.21.15.158:0/3434827850 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f7fa805a540 msgr2=0x7f7fa805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:15.515 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.506+0000 7f7fcabb9700 1 --2- 172.21.15.158:0/3434827850 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f7fa805a540 0x7f7fa805ca00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f7fc000bfd0 tx=0x7f7fc000b3b0).stop 2023-10-18T17:27:15.515 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.506+0000 7f7fcabb9700 1 -- 172.21.15.158:0/3434827850 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7fc40c2630 msgr2=0x7f7fc40a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:15.515 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.506+0000 7f7fcabb9700 1 --2- 172.21.15.158:0/3434827850 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7fc40c2630 0x7f7fc40a6280 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f7fbc009e50 tx=0x7f7fbc00b040).stop 2023-10-18T17:27:15.515 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.506+0000 7f7fcabb9700 1 -- 172.21.15.158:0/3434827850 shutdown_connections 2023-10-18T17:27:15.515 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.506+0000 7f7fcabb9700 1 --2- 172.21.15.158:0/3434827850 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f7fa805a540 0x7f7fa805ca00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:15.516 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.506+0000 7f7fcabb9700 1 --2- 172.21.15.158:0/3434827850 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7fc40c2630 0x7f7fc40a6280 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:15.516 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.506+0000 7f7fcabb9700 1 --2- 172.21.15.158:0/3434827850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fc40bdf20 0x7f7fc40a5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:15.516 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.506+0000 7f7fcabb9700 1 --2- 172.21.15.158:0/3434827850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fc40686b0 0x7f7fc414fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:15.516 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.506+0000 7f7fcabb9700 1 -- 172.21.15.158:0/3434827850 >> 172.21.15.158:0/3434827850 conn(0x7f7fc4062ba0 msgr2=0x7f7fc40c1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:15.516 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.506+0000 7f7fcabb9700 1 -- 172.21.15.158:0/3434827850 shutdown_connections 2023-10-18T17:27:15.517 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:15.510+0000 7f7fcabb9700 1 -- 172.21.15.158:0/3434827850 wait complete. 2023-10-18T17:27:15.537 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:27:18.538 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:27:18.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.690+0000 7fef4251b700 1 Processor -- start 2023-10-18T17:27:18.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.694+0000 7fef4251b700 1 -- start start 2023-10-18T17:27:18.700 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.694+0000 7fef4251b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fef3c067ff0 0x7fef3c0683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:18.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.694+0000 7fef4251b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fef3c065e30 0x7fef3c0bdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:18.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.694+0000 7fef4251b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3c066900 con 0x7fef3c0bca50 2023-10-18T17:27:18.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.694+0000 7fef4251b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef3c068a50 con 0x7fef3c065e30 2023-10-18T17:27:18.701 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.694+0000 7fef4251b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef3c0659a0 con 0x7fef3c067ff0 2023-10-18T17:27:18.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.694+0000 7fef337fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fef3c065e30 0x7fef3c0bdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:18.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.694+0000 7fef337fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fef3c065e30 0x7fef3c0bdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:49622/0 (socket says 172.21.15.158:49622) 2023-10-18T17:27:18.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.694+0000 7fef337fe700 1 -- 172.21.15.158:0/2534465779 learned_addr learned my addr 172.21.15.158:0/2534465779 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:18.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.694+0000 7fef3bfff700 1 --2- 172.21.15.158:0/2534465779 >> v2:172.21.15.183:3300/0 conn(0x7fef3c067ff0 0x7fef3c0683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:18.704 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.694+0000 7fef337fe700 1 -- 172.21.15.158:0/2534465779 >> v2:172.21.15.183:3300/0 conn(0x7fef3c067ff0 msgr2=0x7fef3c0683d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:27:18.704 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.694+0000 7fef337fe700 1 --2- 172.21.15.158:0/2534465779 >> v2:172.21.15.183:3300/0 conn(0x7fef3c067ff0 0x7fef3c0683d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:18.704 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.694+0000 7fef337fe700 1 -- 172.21.15.158:0/2534465779 >> v1:172.21.15.183:6789/0 conn(0x7fef3c0bca50 legacy=0x7fef3c150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:18.705 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.694+0000 7fef337fe700 1 -- 172.21.15.158:0/2534465779 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c066620 con 0x7fef3c065e30 2023-10-18T17:27:18.705 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.694+0000 7fef337fe700 1 --2- 172.21.15.158:0/2534465779 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef3c065e30 0x7fef3c0bdc30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fef3c05e8c0 tx=0x7fef240090f0).ready entity=mon.0 client_cookie=db2f30d081a3876 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:18.705 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.694+0000 7fef3b7fe700 1 -- 172.21.15.158:0/2534465779 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2400b5b0 con 0x7fef3c065e30 2023-10-18T17:27:18.705 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.694+0000 7fef3b7fe700 1 -- 172.21.15.158:0/2534465779 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2400b710 con 0x7fef3c065e30 2023-10-18T17:27:18.705 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.694+0000 7fef3b7fe700 1 -- 172.21.15.158:0/2534465779 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2400ba90 con 0x7fef3c065e30 2023-10-18T17:27:18.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.698+0000 7fef4251b700 1 -- 172.21.15.158:0/2534465779 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef3c065e30 msgr2=0x7fef3c0bdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:18.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.698+0000 7fef4251b700 1 --2- 172.21.15.158:0/2534465779 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef3c065e30 0x7fef3c0bdc30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fef3c05e8c0 tx=0x7fef240090f0).stop 2023-10-18T17:27:18.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.698+0000 7fef4251b700 1 -- 172.21.15.158:0/2534465779 shutdown_connections 2023-10-18T17:27:18.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.698+0000 7fef4251b700 1 --2- 172.21.15.158:0/2534465779 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef3c065e30 0x7fef3c0bdc30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:18.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.698+0000 7fef4251b700 1 --2- 172.21.15.158:0/2534465779 >> v2:172.21.15.183:3300/0 conn(0x7fef3c067ff0 0x7fef3c0683d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:18.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.698+0000 7fef4251b700 1 -- 172.21.15.158:0/2534465779 >> 172.21.15.158:0/2534465779 conn(0x7fef3c0620d0 msgr2=0x7fef3c0624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:18.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.698+0000 7fef4251b700 1 -- 172.21.15.158:0/2534465779 shutdown_connections 2023-10-18T17:27:18.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.698+0000 7fef4251b700 1 -- 172.21.15.158:0/2534465779 wait complete. 2023-10-18T17:27:18.708 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.698+0000 7fef4251b700 1 Processor -- start 2023-10-18T17:27:18.708 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef4251b700 1 -- start start 2023-10-18T17:27:18.708 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef4251b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef3c065e30 0x7fef3c0ba360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:18.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef4251b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef3c067ff0 0x7fef3c0ba850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:18.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef4251b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef3c0bca50 0x7fef3c15fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:18.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef4251b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0bf7a0 con 0x7fef3c065e30 2023-10-18T17:27:18.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef4251b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c1467b0 con 0x7fef3c0bca50 2023-10-18T17:27:18.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef4251b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0c2ad0 con 0x7fef3c067ff0 2023-10-18T17:27:18.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef40ab8700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef3c0bca50 0x7fef3c15fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:18.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef337fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef3c067ff0 0x7fef3c0ba850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:18.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef40ab8700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef3c0bca50 0x7fef3c15fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:54092/0 (socket says 172.21.15.158:54092) 2023-10-18T17:27:18.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef3bfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef3c065e30 0x7fef3c0ba360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:18.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef40ab8700 1 -- 172.21.15.158:0/428425237 learned_addr learned my addr 172.21.15.158:0/428425237 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:18.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef40ab8700 1 -- 172.21.15.158:0/428425237 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef3c067ff0 msgr2=0x7fef3c0ba850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:18.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef40ab8700 1 --2- 172.21.15.158:0/428425237 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef3c067ff0 0x7fef3c0ba850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:18.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef40ab8700 1 -- 172.21.15.158:0/428425237 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef3c065e30 msgr2=0x7fef3c0ba360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:18.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef40ab8700 1 --2- 172.21.15.158:0/428425237 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef3c065e30 0x7fef3c0ba360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:18.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef40ab8700 1 -- 172.21.15.158:0/428425237 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef24009370 con 0x7fef3c0bca50 2023-10-18T17:27:18.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef40ab8700 1 --2- 172.21.15.158:0/428425237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef3c0bca50 0x7fef3c15fc70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fef3400c7c0 tx=0x7fef34001510).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:18.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef38ff9700 1 -- 172.21.15.158:0/428425237 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3400e4a0 con 0x7fef3c0bca50 2023-10-18T17:27:18.714 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef38ff9700 1 -- 172.21.15.158:0/428425237 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3400e600 con 0x7fef3c0bca50 2023-10-18T17:27:18.714 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef4251b700 1 -- 172.21.15.158:0/428425237 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3c1610c0 con 0x7fef3c0bca50 2023-10-18T17:27:18.714 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef38ff9700 1 -- 172.21.15.158:0/428425237 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3400e980 con 0x7fef3c0bca50 2023-10-18T17:27:18.714 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.702+0000 7fef4251b700 1 -- 172.21.15.158:0/428425237 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3c0c27f0 con 0x7fef3c0bca50 2023-10-18T17:27:18.715 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.706+0000 7fef4251b700 1 -- 172.21.15.158:0/428425237 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef3c14b030 con 0x7fef3c0bca50 2023-10-18T17:27:18.715 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.706+0000 7fef38ff9700 1 -- 172.21.15.158:0/428425237 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fef340123f0 con 0x7fef3c0bca50 2023-10-18T17:27:18.715 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.706+0000 7fef38ff9700 1 --2- 172.21.15.158:0/428425237 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fef1c05a540 0x7fef1c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:18.717 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.706+0000 7fef38ff9700 1 -- 172.21.15.158:0/428425237 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fef340742f0 con 0x7fef3c0bca50 2023-10-18T17:27:18.717 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.710+0000 7fef3bfff700 1 --2- 172.21.15.158:0/428425237 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fef1c05a540 0x7fef1c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:18.718 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.710+0000 7fef3bfff700 1 --2- 172.21.15.158:0/428425237 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fef1c05a540 0x7fef1c05ca00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fef2c009b90 tx=0x7fef2c009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:18.725 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.718+0000 7fef38ff9700 1 -- 172.21.15.158:0/428425237 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fef3c14b030 con 0x7fef3c0bca50 2023-10-18T17:27:18.922 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.914+0000 7fef4251b700 1 -- 172.21.15.158:0/428425237 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fef3c0bf8e0 con 0x7fef3c0bca50 2023-10-18T17:27:18.923 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.914+0000 7fef38ff9700 1 -- 172.21.15.158:0/428425237 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fef3c0bf8e0 con 0x7fef3c0bca50 2023-10-18T17:27:18.923 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:27:18.927 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.918+0000 7fef4251b700 1 -- 172.21.15.158:0/428425237 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fef1c05a540 msgr2=0x7fef1c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:18.927 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.918+0000 7fef4251b700 1 --2- 172.21.15.158:0/428425237 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fef1c05a540 0x7fef1c05ca00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fef2c009b90 tx=0x7fef2c009060).stop 2023-10-18T17:27:18.927 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.918+0000 7fef4251b700 1 -- 172.21.15.158:0/428425237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef3c0bca50 msgr2=0x7fef3c15fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:18.927 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.918+0000 7fef4251b700 1 --2- 172.21.15.158:0/428425237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef3c0bca50 0x7fef3c15fc70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fef3400c7c0 tx=0x7fef34001510).stop 2023-10-18T17:27:18.927 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.918+0000 7fef4251b700 1 -- 172.21.15.158:0/428425237 shutdown_connections 2023-10-18T17:27:18.928 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.918+0000 7fef4251b700 1 --2- 172.21.15.158:0/428425237 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fef1c05a540 0x7fef1c05ca00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:18.928 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.918+0000 7fef4251b700 1 --2- 172.21.15.158:0/428425237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef3c0bca50 0x7fef3c15fc70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:18.928 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.918+0000 7fef4251b700 1 --2- 172.21.15.158:0/428425237 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef3c067ff0 0x7fef3c0ba850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:18.928 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.918+0000 7fef4251b700 1 --2- 172.21.15.158:0/428425237 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef3c065e30 0x7fef3c0ba360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:18.928 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.918+0000 7fef4251b700 1 -- 172.21.15.158:0/428425237 >> 172.21.15.158:0/428425237 conn(0x7fef3c0620d0 msgr2=0x7fef3c14cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:18.929 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.918+0000 7fef4251b700 1 -- 172.21.15.158:0/428425237 shutdown_connections 2023-10-18T17:27:18.929 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:18.918+0000 7fef4251b700 1 -- 172.21.15.158:0/428425237 wait complete. 2023-10-18T17:27:18.945 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:27:20.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~134s 2023-10-18T17:27:20.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~188s 2023-10-18T17:27:20.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~114s 2023-10-18T17:27:20.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~101s 2023-10-18T17:27:20.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~147s 2023-10-18T17:27:20.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~88s 2023-10-18T17:27:21.946 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:27:22.113 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.106+0000 7facb1a39700 1 Processor -- start 2023-10-18T17:27:22.114 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.106+0000 7facb1a39700 1 -- start start 2023-10-18T17:27:22.116 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.110+0000 7facb1a39700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7facac0658a0 0x7facac065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:22.117 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.110+0000 7facb1a39700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facac0630e0 0x7facac14cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:22.117 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.110+0000 7facb1a39700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facac06a760 con 0x7facac069f20 2023-10-18T17:27:22.118 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.110+0000 7facb1a39700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facac0c2d40 con 0x7facac0658a0 2023-10-18T17:27:22.118 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.110+0000 7facb1a39700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facac150bf0 con 0x7facac0630e0 2023-10-18T17:27:22.119 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.110+0000 7facb0a37700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7facac0658a0 0x7facac065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:22.119 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.110+0000 7facb1238700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facac0630e0 0x7facac14cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:22.120 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.110+0000 7faca3fff700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7facac069f20 0x7facac0c2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:38504/0 (socket says 172.21.15.158:38504) 2023-10-18T17:27:22.120 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.110+0000 7faca3fff700 1 -- 172.21.15.158:0/3028543285 learned_addr learned my addr 172.21.15.158:0/3028543285 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:27:22.120 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.110+0000 7faca37fe700 1 -- 172.21.15.158:0/3028543285 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131691496 0 0) 0x7facac06a760 con 0x7facac069f20 2023-10-18T17:27:22.120 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.110+0000 7faca37fe700 1 -- 172.21.15.158:0/3028543285 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac940033f0 con 0x7facac069f20 2023-10-18T17:27:22.120 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.110+0000 7facb1238700 1 -- 172.21.15.158:0/3028543285 >> v2:172.21.15.183:3300/0 conn(0x7facac0658a0 msgr2=0x7facac065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:27:22.121 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.110+0000 7facb1238700 1 --2- 172.21.15.158:0/3028543285 >> v2:172.21.15.183:3300/0 conn(0x7facac0658a0 0x7facac065c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:22.121 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.110+0000 7facb1238700 1 -- 172.21.15.158:0/3028543285 >> v1:172.21.15.183:6789/0 conn(0x7facac069f20 legacy=0x7facac0c2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:22.121 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.110+0000 7facb1238700 1 -- 172.21.15.158:0/3028543285 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac06a480 con 0x7facac0630e0 2023-10-18T17:27:22.121 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.110+0000 7facb0a37700 1 --2- 172.21.15.158:0/3028543285 >> v2:172.21.15.183:3300/0 conn(0x7facac0658a0 0x7facac065c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:27:22.121 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.114+0000 7facb1238700 1 --2- 172.21.15.158:0/3028543285 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facac0630e0 0x7facac14cda0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7faca4009760 tx=0x7faca4009060).ready entity=mon.2 client_cookie=c28f0cf9f100c4ad server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:22.123 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.114+0000 7faca37fe700 1 -- 172.21.15.158:0/3028543285 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca400f510 con 0x7facac0630e0 2023-10-18T17:27:22.123 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.114+0000 7faca37fe700 1 -- 172.21.15.158:0/3028543285 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca400f670 con 0x7facac0630e0 2023-10-18T17:27:22.123 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.114+0000 7faca37fe700 1 -- 172.21.15.158:0/3028543285 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca400f9f0 con 0x7facac0630e0 2023-10-18T17:27:22.123 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.114+0000 7facb1a39700 1 -- 172.21.15.158:0/3028543285 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facac0630e0 msgr2=0x7facac14cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:22.124 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.114+0000 7facb1a39700 1 --2- 172.21.15.158:0/3028543285 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facac0630e0 0x7facac14cda0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7faca4009760 tx=0x7faca4009060).stop 2023-10-18T17:27:22.124 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.114+0000 7facb1a39700 1 -- 172.21.15.158:0/3028543285 shutdown_connections 2023-10-18T17:27:22.124 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.114+0000 7facb1a39700 1 --2- 172.21.15.158:0/3028543285 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facac0630e0 0x7facac14cda0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:22.124 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.114+0000 7facb1a39700 1 --2- 172.21.15.158:0/3028543285 >> v2:172.21.15.183:3300/0 conn(0x7facac0658a0 0x7facac065c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:22.125 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.114+0000 7facb1a39700 1 -- 172.21.15.158:0/3028543285 >> 172.21.15.158:0/3028543285 conn(0x7facac062ba0 msgr2=0x7facac0c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:22.125 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.114+0000 7facb1a39700 1 -- 172.21.15.158:0/3028543285 shutdown_connections 2023-10-18T17:27:22.125 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.114+0000 7facb1a39700 1 -- 172.21.15.158:0/3028543285 wait complete. 2023-10-18T17:27:22.126 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.118+0000 7facb1a39700 1 Processor -- start 2023-10-18T17:27:22.126 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.118+0000 7facb1a39700 1 -- start start 2023-10-18T17:27:22.127 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.118+0000 7facb1a39700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facac0630e0 0x7facac149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:22.127 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.118+0000 7facb1a39700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7facac0658a0 0x7facac153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:22.128 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.118+0000 7facb1a39700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facac069f20 0x7facac1527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:22.128 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.118+0000 7facb1a39700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac152cb0 con 0x7facac0658a0 2023-10-18T17:27:22.128 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.122+0000 7facb1a39700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac149960 con 0x7facac069f20 2023-10-18T17:27:22.129 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.122+0000 7facb1a39700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facac155190 con 0x7facac0630e0 2023-10-18T17:27:22.129 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.122+0000 7facb0a37700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facac0630e0 0x7facac149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:22.129 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.122+0000 7faca3fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7facac0658a0 0x7facac153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:22.129 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.122+0000 7facb0a37700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facac0630e0 0x7facac149110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:60894/0 (socket says 172.21.15.158:60894) 2023-10-18T17:27:22.129 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.122+0000 7facb0a37700 1 -- 172.21.15.158:0/713760860 learned_addr learned my addr 172.21.15.158:0/713760860 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:22.130 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.122+0000 7facb1238700 1 --2- 172.21.15.158:0/713760860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facac069f20 0x7facac1527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:22.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.122+0000 7faca3fff700 1 -- 172.21.15.158:0/713760860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facac0630e0 msgr2=0x7facac149110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:22.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.122+0000 7faca3fff700 1 --2- 172.21.15.158:0/713760860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facac0630e0 0x7facac149110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:22.132 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.122+0000 7faca3fff700 1 -- 172.21.15.158:0/713760860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facac069f20 msgr2=0x7facac1527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:22.132 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.122+0000 7faca3fff700 1 --2- 172.21.15.158:0/713760860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facac069f20 0x7facac1527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:22.132 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.122+0000 7faca3fff700 1 -- 172.21.15.158:0/713760860 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca8009a20 con 0x7facac0658a0 2023-10-18T17:27:22.132 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.122+0000 7faca3fff700 1 --2- 172.21.15.158:0/713760860 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7facac0658a0 0x7facac153790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fac9c00c410 tx=0x7fac9c007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:22.132 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.122+0000 7faca0ff9700 1 -- 172.21.15.158:0/713760860 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c0070d0 con 0x7facac0658a0 2023-10-18T17:27:22.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.122+0000 7faca0ff9700 1 -- 172.21.15.158:0/713760860 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9c007230 con 0x7facac0658a0 2023-10-18T17:27:22.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.122+0000 7facb1a39700 1 -- 172.21.15.158:0/713760860 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca40092a0 con 0x7facac0658a0 2023-10-18T17:27:22.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.122+0000 7faca0ff9700 1 -- 172.21.15.158:0/713760860 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c0075f0 con 0x7facac0658a0 2023-10-18T17:27:22.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.122+0000 7facb1a39700 1 -- 172.21.15.158:0/713760860 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facac0a7750 con 0x7facac0658a0 2023-10-18T17:27:22.134 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.122+0000 7facb1a39700 1 -- 172.21.15.158:0/713760860 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facac046f00 con 0x7facac0658a0 2023-10-18T17:27:22.135 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.126+0000 7faca0ff9700 1 -- 172.21.15.158:0/713760860 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fac9c0059b0 con 0x7facac0658a0 2023-10-18T17:27:22.135 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.126+0000 7faca0ff9700 1 --2- 172.21.15.158:0/713760860 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fac9805a540 0x7fac9805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:22.135 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.126+0000 7faca0ff9700 1 -- 172.21.15.158:0/713760860 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fac9c074180 con 0x7facac0658a0 2023-10-18T17:27:22.136 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.126+0000 7facb0a37700 1 --2- 172.21.15.158:0/713760860 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fac9805a540 0x7fac9805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:22.136 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.130+0000 7facb0a37700 1 --2- 172.21.15.158:0/713760860 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fac9805a540 0x7fac9805ca00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7faca800f750 tx=0x7faca800b040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:22.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.134+0000 7faca0ff9700 1 -- 172.21.15.158:0/713760860 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fac9c047640 con 0x7facac0658a0 2023-10-18T17:27:22.333 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.326+0000 7facb1a39700 1 -- 172.21.15.158:0/713760860 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7facac0a8050 con 0x7facac0658a0 2023-10-18T17:27:22.333 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.326+0000 7faca0ff9700 1 -- 172.21.15.158:0/713760860 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fac9c04ac60 con 0x7facac0658a0 2023-10-18T17:27:22.334 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:27:22.336 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.330+0000 7facb1a39700 1 -- 172.21.15.158:0/713760860 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fac9805a540 msgr2=0x7fac9805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:22.336 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.330+0000 7facb1a39700 1 --2- 172.21.15.158:0/713760860 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fac9805a540 0x7fac9805ca00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7faca800f750 tx=0x7faca800b040).stop 2023-10-18T17:27:22.336 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.330+0000 7facb1a39700 1 -- 172.21.15.158:0/713760860 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7facac0658a0 msgr2=0x7facac153790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:22.337 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.330+0000 7facb1a39700 1 --2- 172.21.15.158:0/713760860 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7facac0658a0 0x7facac153790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fac9c00c410 tx=0x7fac9c007bd0).stop 2023-10-18T17:27:22.337 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.330+0000 7facb1a39700 1 -- 172.21.15.158:0/713760860 shutdown_connections 2023-10-18T17:27:22.338 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.330+0000 7facb1a39700 1 --2- 172.21.15.158:0/713760860 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fac9805a540 0x7fac9805ca00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:22.338 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.330+0000 7facb1a39700 1 --2- 172.21.15.158:0/713760860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facac069f20 0x7facac1527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:22.338 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.330+0000 7facb1a39700 1 --2- 172.21.15.158:0/713760860 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7facac0658a0 0x7facac153790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:22.338 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.330+0000 7facb1a39700 1 --2- 172.21.15.158:0/713760860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facac0630e0 0x7facac149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:22.339 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.330+0000 7facb1a39700 1 -- 172.21.15.158:0/713760860 >> 172.21.15.158:0/713760860 conn(0x7facac062ba0 msgr2=0x7facac14b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:22.339 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.330+0000 7facb1a39700 1 -- 172.21.15.158:0/713760860 shutdown_connections 2023-10-18T17:27:22.339 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:22.330+0000 7facb1a39700 1 -- 172.21.15.158:0/713760860 wait complete. 2023-10-18T17:27:22.356 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:27:25.358 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:27:25.519 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.510+0000 7fab3f969700 1 Processor -- start 2023-10-18T17:27:25.520 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.514+0000 7fab3f969700 1 -- start start 2023-10-18T17:27:25.522 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.514+0000 7fab3f969700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fab380666b0 0x7fab380bd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:25.522 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.514+0000 7fab3f969700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab380be230 con 0x7fab38067ff0 2023-10-18T17:27:25.522 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.514+0000 7fab3f969700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab38065cd0 con 0x7fab380bde20 2023-10-18T17:27:25.523 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.514+0000 7fab3f969700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab38066160 con 0x7fab380666b0 2023-10-18T17:27:25.523 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.514+0000 7fab3d705700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fab38067ff0 0x7fab380683d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49870/0 (socket says 172.21.15.158:49870) 2023-10-18T17:27:25.523 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.514+0000 7fab3d705700 1 -- 172.21.15.158:0/1832363121 learned_addr learned my addr 172.21.15.158:0/1832363121 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:27:25.524 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.514+0000 7fab3cf04700 1 --2- 172.21.15.158:0/1832363121 >> v2:172.21.15.183:3300/0 conn(0x7fab380666b0 0x7fab380bd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:25.529 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.514+0000 7fab2ffff700 1 -- 172.21.15.158:0/1832363121 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688274339 0 0) 0x7fab380be230 con 0x7fab38067ff0 2023-10-18T17:27:25.529 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.514+0000 7fab2ffff700 1 -- 172.21.15.158:0/1832363121 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab240033f0 con 0x7fab38067ff0 2023-10-18T17:27:25.529 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.518+0000 7fab2ffff700 1 -- 172.21.15.158:0/1832363121 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678075277 0 0) 0x7fab38065cd0 con 0x7fab380bde20 2023-10-18T17:27:25.529 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.518+0000 7fab2ffff700 1 -- 172.21.15.158:0/1832363121 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab380be230 con 0x7fab380bde20 2023-10-18T17:27:25.529 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.518+0000 7fab3cf04700 1 -- 172.21.15.158:0/1832363121 >> v1:172.21.15.183:6789/0 conn(0x7fab380bde20 legacy=0x7fab38151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:25.530 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.518+0000 7fab3cf04700 1 -- 172.21.15.158:0/1832363121 >> v1:172.21.15.158:6789/0 conn(0x7fab38067ff0 legacy=0x7fab380683d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:25.530 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.518+0000 7fab3cf04700 1 -- 172.21.15.158:0/1832363121 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab38154750 con 0x7fab380666b0 2023-10-18T17:27:25.530 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.518+0000 7fab3cf04700 1 --2- 172.21.15.158:0/1832363121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab380666b0 0x7fab380bd930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fab28009760 tx=0x7fab28009060).ready entity=mon.1 client_cookie=d82e9e51d88127f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:25.530 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.518+0000 7fab2ffff700 1 -- 172.21.15.158:0/1832363121 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2800d4a0 con 0x7fab380666b0 2023-10-18T17:27:25.531 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.518+0000 7fab2ffff700 1 -- 172.21.15.158:0/1832363121 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2800d600 con 0x7fab380666b0 2023-10-18T17:27:25.531 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.518+0000 7fab2ffff700 1 -- 172.21.15.158:0/1832363121 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2800d980 con 0x7fab380666b0 2023-10-18T17:27:25.531 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.518+0000 7fab3f969700 1 -- 172.21.15.158:0/1832363121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab380666b0 msgr2=0x7fab380bd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:25.531 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.518+0000 7fab3f969700 1 --2- 172.21.15.158:0/1832363121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab380666b0 0x7fab380bd930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fab28009760 tx=0x7fab28009060).stop 2023-10-18T17:27:25.531 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.518+0000 7fab3f969700 1 -- 172.21.15.158:0/1832363121 shutdown_connections 2023-10-18T17:27:25.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.518+0000 7fab3f969700 1 --2- 172.21.15.158:0/1832363121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab380666b0 0x7fab380bd930 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:25.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.518+0000 7fab3f969700 1 -- 172.21.15.158:0/1832363121 >> 172.21.15.158:0/1832363121 conn(0x7fab380620d0 msgr2=0x7fab380624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:25.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.518+0000 7fab3f969700 1 -- 172.21.15.158:0/1832363121 shutdown_connections 2023-10-18T17:27:25.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.518+0000 7fab3f969700 1 -- 172.21.15.158:0/1832363121 wait complete. 2023-10-18T17:27:25.532 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3f969700 1 Processor -- start 2023-10-18T17:27:25.533 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3f969700 1 -- start start 2023-10-18T17:27:25.535 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3f969700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab380666b0 0x7fab38168210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:25.535 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3f969700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab38067ff0 0x7fab38164b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:25.535 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3f969700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab380bde20 0x7fab38165010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:25.535 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3f969700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab38164410 con 0x7fab380666b0 2023-10-18T17:27:25.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3f969700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab38167900 con 0x7fab38067ff0 2023-10-18T17:27:25.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3f969700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab380b6500 con 0x7fab380bde20 2023-10-18T17:27:25.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3d705700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab380666b0 0x7fab38168210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:25.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3d705700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab380666b0 0x7fab38168210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:52034/0 (socket says 172.21.15.158:52034) 2023-10-18T17:27:25.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3d705700 1 -- 172.21.15.158:0/3577485147 learned_addr learned my addr 172.21.15.158:0/3577485147 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:25.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3cf04700 1 --2- 172.21.15.158:0/3577485147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab38067ff0 0x7fab38164b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:25.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3df06700 1 --2- 172.21.15.158:0/3577485147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab380bde20 0x7fab38165010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:25.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3d705700 1 -- 172.21.15.158:0/3577485147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab380bde20 msgr2=0x7fab38165010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:25.537 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3d705700 1 --2- 172.21.15.158:0/3577485147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab380bde20 0x7fab38165010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:25.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3d705700 1 -- 172.21.15.158:0/3577485147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab38067ff0 msgr2=0x7fab38164b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:25.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3d705700 1 --2- 172.21.15.158:0/3577485147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab38067ff0 0x7fab38164b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:25.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3d705700 1 -- 172.21.15.158:0/3577485147 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab280092a0 con 0x7fab380666b0 2023-10-18T17:27:25.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3df06700 1 --2- 172.21.15.158:0/3577485147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab380bde20 0x7fab38165010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:27:25.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.522+0000 7fab3d705700 1 --2- 172.21.15.158:0/3577485147 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab380666b0 0x7fab38168210 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fab3400c560 tx=0x7fab34007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:25.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.526+0000 7fab2d7fa700 1 -- 172.21.15.158:0/3577485147 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340072e0 con 0x7fab380666b0 2023-10-18T17:27:25.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.526+0000 7fab2d7fa700 1 -- 172.21.15.158:0/3577485147 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab34007440 con 0x7fab380666b0 2023-10-18T17:27:25.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.526+0000 7fab3f969700 1 -- 172.21.15.158:0/3577485147 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab380c23c0 con 0x7fab380666b0 2023-10-18T17:27:25.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.526+0000 7fab2d7fa700 1 -- 172.21.15.158:0/3577485147 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340057a0 con 0x7fab380666b0 2023-10-18T17:27:25.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.526+0000 7fab3f969700 1 -- 172.21.15.158:0/3577485147 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab380b6220 con 0x7fab380666b0 2023-10-18T17:27:25.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.526+0000 7fab3f969700 1 -- 172.21.15.158:0/3577485147 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3806c190 con 0x7fab380666b0 2023-10-18T17:27:25.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.526+0000 7fab2d7fa700 1 -- 172.21.15.158:0/3577485147 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fab34005b50 con 0x7fab380666b0 2023-10-18T17:27:25.542 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.530+0000 7fab2d7fa700 1 --2- 172.21.15.158:0/3577485147 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fab1c05a510 0x7fab1c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:25.542 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.530+0000 7fab2d7fa700 1 -- 172.21.15.158:0/3577485147 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fab34074190 con 0x7fab380666b0 2023-10-18T17:27:25.542 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.530+0000 7fab3cf04700 1 --2- 172.21.15.158:0/3577485147 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fab1c05a510 0x7fab1c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:25.543 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.530+0000 7fab3cf04700 1 --2- 172.21.15.158:0/3577485147 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fab1c05a510 0x7fab1c05c9d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fab28006d60 tx=0x7fab28016000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:25.543 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.534+0000 7fab2d7fa700 1 -- 172.21.15.158:0/3577485147 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fab34047650 con 0x7fab380666b0 2023-10-18T17:27:25.736 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.730+0000 7fab3f969700 1 -- 172.21.15.158:0/3577485147 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fab38063cf0 con 0x7fab380666b0 2023-10-18T17:27:25.737 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.730+0000 7fab2d7fa700 1 -- 172.21.15.158:0/3577485147 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fab34018020 con 0x7fab380666b0 2023-10-18T17:27:25.738 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:27:25.740 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.734+0000 7fab3f969700 1 -- 172.21.15.158:0/3577485147 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fab1c05a510 msgr2=0x7fab1c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:25.741 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.734+0000 7fab3f969700 1 --2- 172.21.15.158:0/3577485147 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fab1c05a510 0x7fab1c05c9d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fab28006d60 tx=0x7fab28016000).stop 2023-10-18T17:27:25.741 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.734+0000 7fab3f969700 1 -- 172.21.15.158:0/3577485147 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab380666b0 msgr2=0x7fab38168210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:25.741 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.734+0000 7fab3f969700 1 --2- 172.21.15.158:0/3577485147 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab380666b0 0x7fab38168210 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fab3400c560 tx=0x7fab34007d20).stop 2023-10-18T17:27:25.742 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.734+0000 7fab3f969700 1 -- 172.21.15.158:0/3577485147 shutdown_connections 2023-10-18T17:27:25.742 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.734+0000 7fab3f969700 1 --2- 172.21.15.158:0/3577485147 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fab1c05a510 0x7fab1c05c9d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:25.742 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.734+0000 7fab3f969700 1 --2- 172.21.15.158:0/3577485147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab380bde20 0x7fab38165010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:25.742 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.734+0000 7fab3f969700 1 --2- 172.21.15.158:0/3577485147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab38067ff0 0x7fab38164b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:25.743 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.734+0000 7fab3f969700 1 --2- 172.21.15.158:0/3577485147 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fab380666b0 0x7fab38168210 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:25.743 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.734+0000 7fab3f969700 1 -- 172.21.15.158:0/3577485147 >> 172.21.15.158:0/3577485147 conn(0x7fab380620d0 msgr2=0x7fab3814ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:25.743 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.734+0000 7fab3f969700 1 -- 172.21.15.158:0/3577485147 shutdown_connections 2023-10-18T17:27:25.743 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:25.734+0000 7fab3f969700 1 -- 172.21.15.158:0/3577485147 wait complete. 2023-10-18T17:27:25.760 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:27:26.928 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~140s 2023-10-18T17:27:26.928 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~195s 2023-10-18T17:27:26.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~121s 2023-10-18T17:27:26.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~107s 2023-10-18T17:27:26.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~154s 2023-10-18T17:27:26.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~95s 2023-10-18T17:27:28.761 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:27:28.943 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.934+0000 7f326359e700 1 Processor -- start 2023-10-18T17:27:28.943 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.938+0000 7f326359e700 1 -- start start 2023-10-18T17:27:28.947 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.938+0000 7f326359e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3264067d30 0x7f32640630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:28.947 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.938+0000 7f326359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3264068150 0x7f32640635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:28.947 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f326359e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3264068910 con 0x7f326414d170 2023-10-18T17:27:28.949 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f326359e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3264150c10 con 0x7f3264068150 2023-10-18T17:27:28.949 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f326259c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f326414d170 0x7f326406a150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49878/0 (socket says 172.21.15.158:49878) 2023-10-18T17:27:28.949 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f326259c700 1 -- 172.21.15.158:0/234858626 learned_addr learned my addr 172.21.15.158:0/234858626 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:27:28.949 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f326359e700 1 -- 172.21.15.158:0/234858626 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3264150780 con 0x7f3264067d30 2023-10-18T17:27:28.949 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f3262d9d700 1 --2- 172.21.15.158:0/234858626 >> v2:172.21.15.158:3300/0 conn(0x7f3264068150 0x7f32640635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:28.950 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f3261d9b700 1 --2- 172.21.15.158:0/234858626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3264067d30 0x7f32640630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:28.950 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f326159a700 1 -- 172.21.15.158:0/234858626 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390191503 0 0) 0x7f3264068910 con 0x7f326414d170 2023-10-18T17:27:28.950 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f326159a700 1 -- 172.21.15.158:0/234858626 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f324c0033f0 con 0x7f326414d170 2023-10-18T17:27:28.950 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f3261d9b700 1 -- 172.21.15.158:0/234858626 >> v2:172.21.15.158:3300/0 conn(0x7f3264068150 msgr2=0x7f32640635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:27:28.950 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f3261d9b700 1 --2- 172.21.15.158:0/234858626 >> v2:172.21.15.158:3300/0 conn(0x7f3264068150 0x7f32640635d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:28.951 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f3261d9b700 1 -- 172.21.15.158:0/234858626 >> v1:172.21.15.158:6789/0 conn(0x7f326414d170 legacy=0x7f326406a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:28.951 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f3261d9b700 1 -- 172.21.15.158:0/234858626 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3264068630 con 0x7f3264067d30 2023-10-18T17:27:28.951 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f3262d9d700 1 --2- 172.21.15.158:0/234858626 >> v2:172.21.15.158:3300/0 conn(0x7f3264068150 0x7f32640635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:27:28.951 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f3261d9b700 1 --2- 172.21.15.158:0/234858626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3264067d30 0x7f32640630e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f3258009760 tx=0x7f3258009060).ready entity=mon.2 client_cookie=348167f0e59917d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:28.952 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f326159a700 1 -- 172.21.15.158:0/234858626 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325800f510 con 0x7f3264067d30 2023-10-18T17:27:28.953 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f326159a700 1 -- 172.21.15.158:0/234858626 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325800f670 con 0x7f3264067d30 2023-10-18T17:27:28.953 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f326159a700 1 -- 172.21.15.158:0/234858626 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325800f9f0 con 0x7f3264067d30 2023-10-18T17:27:28.953 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f326359e700 1 -- 172.21.15.158:0/234858626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3264067d30 msgr2=0x7f32640630e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:28.953 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f326359e700 1 --2- 172.21.15.158:0/234858626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3264067d30 0x7f32640630e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f3258009760 tx=0x7f3258009060).stop 2023-10-18T17:27:28.953 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f326359e700 1 -- 172.21.15.158:0/234858626 shutdown_connections 2023-10-18T17:27:28.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f326359e700 1 --2- 172.21.15.158:0/234858626 >> v2:172.21.15.158:3300/0 conn(0x7f3264068150 0x7f32640635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:28.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f326359e700 1 --2- 172.21.15.158:0/234858626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3264067d30 0x7f32640630e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:28.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f326359e700 1 -- 172.21.15.158:0/234858626 >> 172.21.15.158:0/234858626 conn(0x7f3264062ba0 msgr2=0x7f32640c6330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:28.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f326359e700 1 -- 172.21.15.158:0/234858626 shutdown_connections 2023-10-18T17:27:28.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.942+0000 7f326359e700 1 -- 172.21.15.158:0/234858626 wait complete. 2023-10-18T17:27:28.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.946+0000 7f326359e700 1 Processor -- start 2023-10-18T17:27:28.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.946+0000 7f326359e700 1 -- start start 2023-10-18T17:27:28.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.946+0000 7f326359e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3264067d30 0x7f32640bf240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:28.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.946+0000 7f326359e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3264068150 0x7f32640c0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:28.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.946+0000 7f326359e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f326414d170 0x7f32641562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:28.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.946+0000 7f326359e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32640bfb90 con 0x7f3264068150 2023-10-18T17:27:28.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.946+0000 7f326359e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3264155240 con 0x7f3264067d30 2023-10-18T17:27:28.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.950+0000 7f326359e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3264155520 con 0x7f326414d170 2023-10-18T17:27:28.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.950+0000 7f326259c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3264067d30 0x7f32640bf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:28.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.950+0000 7f3261d9b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3264068150 0x7f32640c0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:28.958 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.950+0000 7f3262d9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f326414d170 0x7f32641562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:28.958 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.950+0000 7f3262d9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f326414d170 0x7f32641562e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:60918/0 (socket says 172.21.15.158:60918) 2023-10-18T17:27:28.958 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.950+0000 7f3261d9b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3264068150 0x7f32640c0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:52054/0 (socket says 172.21.15.158:52054) 2023-10-18T17:27:28.958 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.950+0000 7f3262d9d700 1 -- 172.21.15.158:0/2490725488 learned_addr learned my addr 172.21.15.158:0/2490725488 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:28.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.950+0000 7f3262d9d700 1 -- 172.21.15.158:0/2490725488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3264067d30 msgr2=0x7f32640bf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:28.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.950+0000 7f3262d9d700 1 --2- 172.21.15.158:0/2490725488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3264067d30 0x7f32640bf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:28.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.950+0000 7f3262d9d700 1 -- 172.21.15.158:0/2490725488 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3264068150 msgr2=0x7f32640c0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:28.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.950+0000 7f3262d9d700 1 --2- 172.21.15.158:0/2490725488 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3264068150 0x7f32640c0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:28.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.950+0000 7f3262d9d700 1 -- 172.21.15.158:0/2490725488 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c009a20 con 0x7f326414d170 2023-10-18T17:27:28.961 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.950+0000 7f3261d9b700 1 --2- 172.21.15.158:0/2490725488 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3264068150 0x7f32640c0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:27:28.961 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.950+0000 7f3262d9d700 1 --2- 172.21.15.158:0/2490725488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f326414d170 0x7f32641562e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f325c009e90 tx=0x7f325c00b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:28.961 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.950+0000 7f32527fc700 1 -- 172.21.15.158:0/2490725488 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c00caa0 con 0x7f326414d170 2023-10-18T17:27:28.961 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.950+0000 7f32527fc700 1 -- 172.21.15.158:0/2490725488 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325c00f040 con 0x7f326414d170 2023-10-18T17:27:28.961 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.950+0000 7f326359e700 1 -- 172.21.15.158:0/2490725488 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32580092a0 con 0x7f326414d170 2023-10-18T17:27:28.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.950+0000 7f32527fc700 1 -- 172.21.15.158:0/2490725488 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c00ce30 con 0x7f326414d170 2023-10-18T17:27:28.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.950+0000 7f326359e700 1 -- 172.21.15.158:0/2490725488 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3264155ae0 con 0x7f326414d170 2023-10-18T17:27:28.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.954+0000 7f326359e700 1 -- 172.21.15.158:0/2490725488 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3264046f00 con 0x7f326414d170 2023-10-18T17:27:28.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.954+0000 7f32527fc700 1 -- 172.21.15.158:0/2490725488 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f325c013610 con 0x7f326414d170 2023-10-18T17:27:28.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.954+0000 7f32527fc700 1 --2- 172.21.15.158:0/2490725488 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f324405a4e0 0x7f324405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:28.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.954+0000 7f32527fc700 1 -- 172.21.15.158:0/2490725488 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f325c0753d0 con 0x7f326414d170 2023-10-18T17:27:28.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.954+0000 7f326259c700 1 --2- 172.21.15.158:0/2490725488 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f324405a4e0 0x7f324405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:28.964 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.958+0000 7f326259c700 1 --2- 172.21.15.158:0/2490725488 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f324405a4e0 0x7f324405c9a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f3254005750 tx=0x7f3254009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:28.973 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:28.966+0000 7f32527fc700 1 -- 172.21.15.158:0/2490725488 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f325c048890 con 0x7f326414d170 2023-10-18T17:27:29.170 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:29.162+0000 7f326359e700 1 -- 172.21.15.158:0/2490725488 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f326414fe50 con 0x7f326414d170 2023-10-18T17:27:29.171 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:29.166+0000 7f32527fc700 1 -- 172.21.15.158:0/2490725488 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f325c04beb0 con 0x7f326414d170 2023-10-18T17:27:29.171 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:27:29.174 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:29.166+0000 7f326359e700 1 -- 172.21.15.158:0/2490725488 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f324405a4e0 msgr2=0x7f324405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:29.175 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:29.166+0000 7f326359e700 1 --2- 172.21.15.158:0/2490725488 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f324405a4e0 0x7f324405c9a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f3254005750 tx=0x7f3254009040).stop 2023-10-18T17:27:29.175 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:29.166+0000 7f326359e700 1 -- 172.21.15.158:0/2490725488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f326414d170 msgr2=0x7f32641562e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:29.175 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:29.166+0000 7f326359e700 1 --2- 172.21.15.158:0/2490725488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f326414d170 0x7f32641562e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f325c009e90 tx=0x7f325c00b040).stop 2023-10-18T17:27:29.175 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:29.166+0000 7f326359e700 1 -- 172.21.15.158:0/2490725488 shutdown_connections 2023-10-18T17:27:29.175 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:29.166+0000 7f326359e700 1 --2- 172.21.15.158:0/2490725488 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f324405a4e0 0x7f324405c9a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:29.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:29.166+0000 7f326359e700 1 --2- 172.21.15.158:0/2490725488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f326414d170 0x7f32641562e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:29.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:29.166+0000 7f326359e700 1 --2- 172.21.15.158:0/2490725488 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3264068150 0x7f32640c0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:29.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:29.166+0000 7f326359e700 1 --2- 172.21.15.158:0/2490725488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3264067d30 0x7f32640bf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:29.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:29.166+0000 7f326359e700 1 -- 172.21.15.158:0/2490725488 >> 172.21.15.158:0/2490725488 conn(0x7f3264062ba0 msgr2=0x7f326414f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:29.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:29.166+0000 7f326359e700 1 -- 172.21.15.158:0/2490725488 shutdown_connections 2023-10-18T17:27:29.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:29.166+0000 7f326359e700 1 -- 172.21.15.158:0/2490725488 wait complete. 2023-10-18T17:27:29.193 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:27:32.195 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:27:32.363 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.358+0000 7f2678d46700 1 Processor -- start 2023-10-18T17:27:32.364 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.358+0000 7f2678d46700 1 -- start start 2023-10-18T17:27:32.366 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.358+0000 7f2678d46700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f26740b9690 0x7f26740b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:32.366 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.358+0000 7f2678d46700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f26740bca50 0x7f267414dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:32.366 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.358+0000 7f2678d46700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2674065620 0x7f2674065a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:32.367 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.358+0000 7f2678d46700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26740bc480 con 0x7f26740b9690 2023-10-18T17:27:32.367 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.358+0000 7f2678d46700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2674065190 con 0x7f26740bca50 2023-10-18T17:27:32.367 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.358+0000 7f2678d46700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26740bb920 con 0x7f2674065620 2023-10-18T17:27:32.368 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.358+0000 7f2669d9b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f26740bca50 0x7f267414dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:32.369 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.358+0000 7f267259c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f26740b9690 0x7f26740b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:32.369 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.358+0000 7f2672d9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2674065620 0x7f2674065a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:32.369 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.358+0000 7f2669d9b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f26740bca50 0x7f267414dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:49938/0 (socket says 172.21.15.158:49938) 2023-10-18T17:27:32.369 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.358+0000 7f267259c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f26740b9690 0x7f26740b9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:48538/0 (socket says 172.21.15.158:48538) 2023-10-18T17:27:32.369 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.358+0000 7f267259c700 1 -- 172.21.15.158:0/706617072 learned_addr learned my addr 172.21.15.158:0/706617072 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:32.370 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.358+0000 7f2672d9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2674065620 0x7f2674065a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:54550/0 (socket says 172.21.15.158:54550) 2023-10-18T17:27:32.370 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.362+0000 7f2672d9d700 1 -- 172.21.15.158:0/706617072 >> v2:172.21.15.183:3300/0 conn(0x7f26740bca50 msgr2=0x7f267414dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:27:32.370 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.362+0000 7f2672d9d700 1 --2- 172.21.15.158:0/706617072 >> v2:172.21.15.183:3300/0 conn(0x7f26740bca50 0x7f267414dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:32.370 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.362+0000 7f2672d9d700 1 -- 172.21.15.158:0/706617072 >> v2:172.21.15.158:3300/0 conn(0x7f26740b9690 msgr2=0x7f26740b9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:27:32.371 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.362+0000 7f2672d9d700 1 --2- 172.21.15.158:0/706617072 >> v2:172.21.15.158:3300/0 conn(0x7f26740b9690 0x7f26740b9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:32.371 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.362+0000 7f2672d9d700 1 -- 172.21.15.158:0/706617072 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26740bbbe0 con 0x7f2674065620 2023-10-18T17:27:32.371 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.362+0000 7f267259c700 1 --2- 172.21.15.158:0/706617072 >> v2:172.21.15.158:3300/0 conn(0x7f26740b9690 0x7f26740b9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:27:32.371 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.362+0000 7f2672d9d700 1 --2- 172.21.15.158:0/706617072 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2674065620 0x7f2674065a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f26740b9f60 tx=0x7f266c009060).ready entity=mon.2 client_cookie=8a720895df5d96ea server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:32.371 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.362+0000 7f2671d9b700 1 -- 172.21.15.158:0/706617072 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c00d4a0 con 0x7f2674065620 2023-10-18T17:27:32.371 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.362+0000 7f2671d9b700 1 -- 172.21.15.158:0/706617072 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c00d600 con 0x7f2674065620 2023-10-18T17:27:32.372 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.362+0000 7f2671d9b700 1 -- 172.21.15.158:0/706617072 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c00d980 con 0x7f2674065620 2023-10-18T17:27:32.373 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.362+0000 7f2678d46700 1 -- 172.21.15.158:0/706617072 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2674065620 msgr2=0x7f2674065a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:32.373 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.362+0000 7f2678d46700 1 --2- 172.21.15.158:0/706617072 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2674065620 0x7f2674065a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f26740b9f60 tx=0x7f266c009060).stop 2023-10-18T17:27:32.373 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.362+0000 7f2678d46700 1 -- 172.21.15.158:0/706617072 shutdown_connections 2023-10-18T17:27:32.373 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.362+0000 7f2678d46700 1 --2- 172.21.15.158:0/706617072 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2674065620 0x7f2674065a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:32.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.362+0000 7f2678d46700 1 --2- 172.21.15.158:0/706617072 >> v2:172.21.15.183:3300/0 conn(0x7f26740bca50 0x7f267414dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:32.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.362+0000 7f2678d46700 1 --2- 172.21.15.158:0/706617072 >> v2:172.21.15.158:3300/0 conn(0x7f26740b9690 0x7f26740b9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:32.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.362+0000 7f2678d46700 1 -- 172.21.15.158:0/706617072 >> 172.21.15.158:0/706617072 conn(0x7f26740620d0 msgr2=0x7f26740624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:32.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.362+0000 7f2678d46700 1 -- 172.21.15.158:0/706617072 shutdown_connections 2023-10-18T17:27:32.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.362+0000 7f2678d46700 1 -- 172.21.15.158:0/706617072 wait complete. 2023-10-18T17:27:32.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.366+0000 7f2678d46700 1 Processor -- start 2023-10-18T17:27:32.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.366+0000 7f2678d46700 1 -- start start 2023-10-18T17:27:32.377 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.366+0000 7f2678d46700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2674065620 0x7f26740c2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:32.377 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.366+0000 7f2678d46700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26740b9690 0x7f26740c1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:32.377 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.366+0000 7f2678d46700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26740c1c60 0x7f26740c1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:32.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.366+0000 7f2678d46700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26740b79c0 con 0x7f26740b9690 2023-10-18T17:27:32.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.366+0000 7f2678d46700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26740b87b0 con 0x7f26740c1c60 2023-10-18T17:27:32.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.366+0000 7f2678d46700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26740c2620 con 0x7f2674065620 2023-10-18T17:27:32.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.366+0000 7f267259c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2674065620 0x7f26740c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:32.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.366+0000 7f267259c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2674065620 0x7f26740c2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:54556/0 (socket says 172.21.15.158:54556) 2023-10-18T17:27:32.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.366+0000 7f2669d9b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26740b9690 0x7f26740c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:32.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.366+0000 7f267259c700 1 -- 172.21.15.158:0/49373148 learned_addr learned my addr 172.21.15.158:0/49373148 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:32.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.366+0000 7f2672d9d700 1 --2- 172.21.15.158:0/49373148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26740c1c60 0x7f26740c1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:32.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.370+0000 7f267259c700 1 -- 172.21.15.158:0/49373148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26740c1c60 msgr2=0x7f26740c1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:32.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.370+0000 7f267259c700 1 --2- 172.21.15.158:0/49373148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26740c1c60 0x7f26740c1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:32.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.370+0000 7f267259c700 1 -- 172.21.15.158:0/49373148 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26740b9690 msgr2=0x7f26740c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:32.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.370+0000 7f267259c700 1 --2- 172.21.15.158:0/49373148 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26740b9690 0x7f26740c1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:32.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.370+0000 7f267259c700 1 -- 172.21.15.158:0/49373148 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2664009ae0 con 0x7f2674065620 2023-10-18T17:27:32.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.370+0000 7f2672d9d700 1 --2- 172.21.15.158:0/49373148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26740c1c60 0x7f26740c1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:27:32.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.370+0000 7f267259c700 1 --2- 172.21.15.158:0/49373148 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2674065620 0x7f26740c2130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f266400c170 tx=0x7f266400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:32.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.370+0000 7f266affd700 1 -- 172.21.15.158:0/49373148 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266400cb30 con 0x7f2674065620 2023-10-18T17:27:32.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.370+0000 7f266affd700 1 -- 172.21.15.158:0/49373148 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266400f040 con 0x7f2674065620 2023-10-18T17:27:32.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.370+0000 7f2678d46700 1 -- 172.21.15.158:0/49373148 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266c0092a0 con 0x7f2674065620 2023-10-18T17:27:32.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.370+0000 7f266affd700 1 -- 172.21.15.158:0/49373148 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266400cea0 con 0x7f2674065620 2023-10-18T17:27:32.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.370+0000 7f2678d46700 1 -- 172.21.15.158:0/49373148 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26740b7e80 con 0x7f2674065620 2023-10-18T17:27:32.382 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.370+0000 7f2678d46700 1 -- 172.21.15.158:0/49373148 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267406c190 con 0x7f2674065620 2023-10-18T17:27:32.383 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.374+0000 7f266affd700 1 -- 172.21.15.158:0/49373148 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2664007400 con 0x7f2674065620 2023-10-18T17:27:32.383 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.374+0000 7f266affd700 1 --2- 172.21.15.158:0/49373148 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f265405a540 0x7f265405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:32.383 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.374+0000 7f266affd700 1 -- 172.21.15.158:0/49373148 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f2664074c60 con 0x7f2674065620 2023-10-18T17:27:32.383 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.374+0000 7f2669d9b700 1 --2- 172.21.15.158:0/49373148 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f265405a540 0x7f265405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:32.384 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.374+0000 7f2669d9b700 1 --2- 172.21.15.158:0/49373148 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f265405a540 0x7f265405ca00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f26740bec90 tx=0x7f265c009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:32.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.386+0000 7f266affd700 1 -- 172.21.15.158:0/49373148 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f26640480c0 con 0x7f2674065620 2023-10-18T17:27:32.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.578+0000 7f2678d46700 1 -- 172.21.15.158:0/49373148 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f26740bbec0 con 0x7f2674065620 2023-10-18T17:27:32.588 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.582+0000 7f266affd700 1 -- 172.21.15.158:0/49373148 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f266404b6e0 con 0x7f2674065620 2023-10-18T17:27:32.588 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:27:32.592 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.586+0000 7f2678d46700 1 -- 172.21.15.158:0/49373148 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f265405a540 msgr2=0x7f265405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:32.593 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.586+0000 7f2678d46700 1 --2- 172.21.15.158:0/49373148 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f265405a540 0x7f265405ca00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f26740bec90 tx=0x7f265c009060).stop 2023-10-18T17:27:32.593 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.586+0000 7f2678d46700 1 -- 172.21.15.158:0/49373148 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2674065620 msgr2=0x7f26740c2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:32.593 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.586+0000 7f2678d46700 1 --2- 172.21.15.158:0/49373148 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2674065620 0x7f26740c2130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f266400c170 tx=0x7f266400b040).stop 2023-10-18T17:27:32.593 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.586+0000 7f2678d46700 1 -- 172.21.15.158:0/49373148 shutdown_connections 2023-10-18T17:27:32.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.586+0000 7f2678d46700 1 --2- 172.21.15.158:0/49373148 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f265405a540 0x7f265405ca00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:32.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.586+0000 7f2678d46700 1 --2- 172.21.15.158:0/49373148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26740c1c60 0x7f26740c1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:32.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.586+0000 7f2678d46700 1 --2- 172.21.15.158:0/49373148 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26740b9690 0x7f26740c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:32.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.586+0000 7f2678d46700 1 --2- 172.21.15.158:0/49373148 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2674065620 0x7f26740c2130 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:32.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.586+0000 7f2678d46700 1 -- 172.21.15.158:0/49373148 >> 172.21.15.158:0/49373148 conn(0x7f26740620d0 msgr2=0x7f267414c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:32.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.586+0000 7f2678d46700 1 -- 172.21.15.158:0/49373148 shutdown_connections 2023-10-18T17:27:32.595 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:32.586+0000 7f2678d46700 1 -- 172.21.15.158:0/49373148 wait complete. 2023-10-18T17:27:32.614 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:27:33.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~147s 2023-10-18T17:27:33.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~201s 2023-10-18T17:27:33.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~127s 2023-10-18T17:27:33.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~114s 2023-10-18T17:27:33.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~160s 2023-10-18T17:27:33.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~101s 2023-10-18T17:27:34.305 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:27:34.312 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:27:35.615 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:27:35.776 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.770+0000 7f04a5379700 1 Processor -- start 2023-10-18T17:27:35.776 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.770+0000 7f04a5379700 1 -- start start 2023-10-18T17:27:35.778 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.770+0000 7f04a5379700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f04a00658a0 0x7f04a0065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:35.778 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.770+0000 7f04a5379700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04a00bd1c0 0x7f04a014ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:35.778 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.770+0000 7f04a5379700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a00be2e0 con 0x7f04a00c2bf0 2023-10-18T17:27:35.778 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.770+0000 7f04a5379700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a00bda80 con 0x7f04a00658a0 2023-10-18T17:27:35.779 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.770+0000 7f04a5379700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a006a7c0 con 0x7f04a00bd1c0 2023-10-18T17:27:35.780 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.770+0000 7f049ffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f04a00658a0 0x7f04a0065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:35.780 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.770+0000 7f04a4b78700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04a00bd1c0 0x7f04a014ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:35.780 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.770+0000 7f049f7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f04a00c2bf0 0x7f04a00630e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:46204/0 (socket says 172.21.15.158:46204) 2023-10-18T17:27:35.780 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.770+0000 7f049ffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f04a00658a0 0x7f04a0065c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:49954/0 (socket says 172.21.15.158:49954) 2023-10-18T17:27:35.781 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.770+0000 7f049f7fe700 1 -- 172.21.15.158:0/3222377920 learned_addr learned my addr 172.21.15.158:0/3222377920 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:27:35.781 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.774+0000 7f049ffff700 1 -- 172.21.15.158:0/3222377920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04a00bd1c0 msgr2=0x7f04a014ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:27:35.781 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.774+0000 7f049ffff700 1 --2- 172.21.15.158:0/3222377920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04a00bd1c0 0x7f04a014ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:35.781 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.774+0000 7f049ffff700 1 -- 172.21.15.158:0/3222377920 >> v1:172.21.15.158:6789/0 conn(0x7f04a00c2bf0 legacy=0x7f04a00630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:35.781 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.774+0000 7f049ffff700 1 -- 172.21.15.158:0/3222377920 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a00be770 con 0x7f04a00658a0 2023-10-18T17:27:35.782 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.774+0000 7f049ffff700 1 --2- 172.21.15.158:0/3222377920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04a00658a0 0x7f04a0065c80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f0498009e60 tx=0x7f0498009780).ready entity=mon.1 client_cookie=a1bcf9317426ce41 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:35.783 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.774+0000 7f049effd700 1 -- 172.21.15.158:0/3222377920 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049800e070 con 0x7f04a00658a0 2023-10-18T17:27:35.783 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.774+0000 7f049effd700 1 -- 172.21.15.158:0/3222377920 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049800bb60 con 0x7f04a00658a0 2023-10-18T17:27:35.783 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.774+0000 7f049effd700 1 -- 172.21.15.158:0/3222377920 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0498012410 con 0x7f04a00658a0 2023-10-18T17:27:35.783 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.774+0000 7f04a5379700 1 -- 172.21.15.158:0/3222377920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04a00658a0 msgr2=0x7f04a0065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:35.783 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.774+0000 7f04a5379700 1 --2- 172.21.15.158:0/3222377920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04a00658a0 0x7f04a0065c80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f0498009e60 tx=0x7f0498009780).stop 2023-10-18T17:27:35.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.774+0000 7f04a5379700 1 -- 172.21.15.158:0/3222377920 shutdown_connections 2023-10-18T17:27:35.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.774+0000 7f04a5379700 1 --2- 172.21.15.158:0/3222377920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04a00bd1c0 0x7f04a014ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:35.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.774+0000 7f04a5379700 1 --2- 172.21.15.158:0/3222377920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04a00658a0 0x7f04a0065c80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:35.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.774+0000 7f04a5379700 1 -- 172.21.15.158:0/3222377920 >> 172.21.15.158:0/3222377920 conn(0x7f04a0062ba0 msgr2=0x7f04a00c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:35.784 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.774+0000 7f04a5379700 1 -- 172.21.15.158:0/3222377920 shutdown_connections 2023-10-18T17:27:35.785 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.774+0000 7f04a5379700 1 -- 172.21.15.158:0/3222377920 wait complete. 2023-10-18T17:27:35.786 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.778+0000 7f04a5379700 1 Processor -- start 2023-10-18T17:27:35.786 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.778+0000 7f04a5379700 1 -- start start 2023-10-18T17:27:35.786 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.778+0000 7f04a5379700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04a00658a0 0x7f04a00c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:35.786 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.778+0000 7f04a5379700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04a00bd1c0 0x7f04a0161030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:35.787 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.778+0000 7f04a5379700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04a00c2bf0 0x7f04a014b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:35.787 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.778+0000 7f04a5379700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a014cdc0 con 0x7f04a00658a0 2023-10-18T17:27:35.787 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.778+0000 7f04a5379700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a014c1b0 con 0x7f04a00c2bf0 2023-10-18T17:27:35.787 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.778+0000 7f04a5379700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a014c490 con 0x7f04a00bd1c0 2023-10-18T17:27:35.787 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.778+0000 7f049ffff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04a00658a0 0x7f04a00c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:35.788 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.778+0000 7f04a4b78700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04a00c2bf0 0x7f04a014b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:35.788 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.778+0000 7f049ffff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04a00658a0 0x7f04a00c0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:48562/0 (socket says 172.21.15.158:48562) 2023-10-18T17:27:35.788 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.778+0000 7f049ffff700 1 -- 172.21.15.158:0/2306371490 learned_addr learned my addr 172.21.15.158:0/2306371490 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:35.788 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.778+0000 7f049f7fe700 1 --2- 172.21.15.158:0/2306371490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04a00bd1c0 0x7f04a0161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:35.789 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.778+0000 7f04a4b78700 1 -- 172.21.15.158:0/2306371490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04a00bd1c0 msgr2=0x7f04a0161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:35.790 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.778+0000 7f04a4b78700 1 --2- 172.21.15.158:0/2306371490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04a00bd1c0 0x7f04a0161030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:35.790 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.778+0000 7f04a4b78700 1 -- 172.21.15.158:0/2306371490 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04a00658a0 msgr2=0x7f04a00c0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:35.790 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.778+0000 7f04a4b78700 1 --2- 172.21.15.158:0/2306371490 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04a00658a0 0x7f04a00c0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:35.790 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.778+0000 7f04a4b78700 1 -- 172.21.15.158:0/2306371490 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0498009a20 con 0x7f04a00c2bf0 2023-10-18T17:27:35.791 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.778+0000 7f049ffff700 1 --2- 172.21.15.158:0/2306371490 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04a00658a0 0x7f04a00c0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:27:35.791 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.782+0000 7f04a4b78700 1 --2- 172.21.15.158:0/2306371490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04a00c2bf0 0x7f04a014b160 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f048800e900 tx=0x7f0488009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:35.791 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.782+0000 7f0497fff700 1 -- 172.21.15.158:0/2306371490 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0488012600 con 0x7f04a00c2bf0 2023-10-18T17:27:35.791 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.782+0000 7f0497fff700 1 -- 172.21.15.158:0/2306371490 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0488012760 con 0x7f04a00c2bf0 2023-10-18T17:27:35.791 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.782+0000 7f0497fff700 1 -- 172.21.15.158:0/2306371490 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0488012ae0 con 0x7f04a00c2bf0 2023-10-18T17:27:35.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.782+0000 7f04a5379700 1 -- 172.21.15.158:0/2306371490 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a014c770 con 0x7f04a00c2bf0 2023-10-18T17:27:35.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.782+0000 7f04a5379700 1 -- 172.21.15.158:0/2306371490 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a0065d10 con 0x7f04a00c2bf0 2023-10-18T17:27:35.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.782+0000 7f04a5379700 1 -- 172.21.15.158:0/2306371490 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a00b5880 con 0x7f04a00c2bf0 2023-10-18T17:27:35.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.786+0000 7f0497fff700 1 -- 172.21.15.158:0/2306371490 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f048801b400 con 0x7f04a00c2bf0 2023-10-18T17:27:35.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.786+0000 7f0497fff700 1 --2- 172.21.15.158:0/2306371490 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f048005a510 0x7f048005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:35.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.786+0000 7f0497fff700 1 -- 172.21.15.158:0/2306371490 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f0488074ed0 con 0x7f04a00c2bf0 2023-10-18T17:27:35.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.786+0000 7f049ffff700 1 --2- 172.21.15.158:0/2306371490 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f048005a510 0x7f048005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:35.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.786+0000 7f049ffff700 1 --2- 172.21.15.158:0/2306371490 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f048005a510 0x7f048005c9d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f0498012540 tx=0x7f0498009780).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:35.803 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.794+0000 7f0497fff700 1 -- 172.21.15.158:0/2306371490 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f04a00b5880 con 0x7f04a00c2bf0 2023-10-18T17:27:36.005 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.998+0000 7f04a5379700 1 -- 172.21.15.158:0/2306371490 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f04a00a6880 con 0x7f04a00c2bf0 2023-10-18T17:27:36.006 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:35.998+0000 7f0497fff700 1 -- 172.21.15.158:0/2306371490 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f04a00a6880 con 0x7f04a00c2bf0 2023-10-18T17:27:36.007 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:27:36.010 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:36.002+0000 7f04a5379700 1 -- 172.21.15.158:0/2306371490 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f048005a510 msgr2=0x7f048005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:36.011 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:36.002+0000 7f04a5379700 1 --2- 172.21.15.158:0/2306371490 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f048005a510 0x7f048005c9d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f0498012540 tx=0x7f0498009780).stop 2023-10-18T17:27:36.011 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:36.002+0000 7f04a5379700 1 -- 172.21.15.158:0/2306371490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04a00c2bf0 msgr2=0x7f04a014b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:36.011 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:36.002+0000 7f04a5379700 1 --2- 172.21.15.158:0/2306371490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04a00c2bf0 0x7f04a014b160 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f048800e900 tx=0x7f0488009060).stop 2023-10-18T17:27:36.011 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:36.002+0000 7f04a5379700 1 -- 172.21.15.158:0/2306371490 shutdown_connections 2023-10-18T17:27:36.011 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:36.002+0000 7f04a5379700 1 --2- 172.21.15.158:0/2306371490 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f048005a510 0x7f048005c9d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:36.012 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:36.002+0000 7f04a5379700 1 --2- 172.21.15.158:0/2306371490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04a00c2bf0 0x7f04a014b160 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:36.012 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:36.002+0000 7f04a5379700 1 --2- 172.21.15.158:0/2306371490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04a00bd1c0 0x7f04a0161030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:36.012 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:36.002+0000 7f04a5379700 1 --2- 172.21.15.158:0/2306371490 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04a00658a0 0x7f04a00c0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:36.012 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:36.002+0000 7f04a5379700 1 -- 172.21.15.158:0/2306371490 >> 172.21.15.158:0/2306371490 conn(0x7f04a0062ba0 msgr2=0x7f04a0067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:36.013 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:36.006+0000 7f04a5379700 1 -- 172.21.15.158:0/2306371490 shutdown_connections 2023-10-18T17:27:36.013 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:36.006+0000 7f04a5379700 1 -- 172.21.15.158:0/2306371490 wait complete. 2023-10-18T17:27:36.033 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:27:39.034 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:27:39.202 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.194+0000 7f9c903a9700 1 Processor -- start 2023-10-18T17:27:39.203 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.194+0000 7f9c903a9700 1 -- start start 2023-10-18T17:27:39.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.198+0000 7f9c903a9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c88067ff0 0x7f9c880683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:39.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.198+0000 7f9c903a9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9c88151410 0x7f9c881518c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:39.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.198+0000 7f9c903a9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c88065cd0 con 0x7f9c880666b0 2023-10-18T17:27:39.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.198+0000 7f9c903a9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c88066160 con 0x7f9c88151410 2023-10-18T17:27:39.207 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.198+0000 7f9c903a9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c88154750 con 0x7f9c88067ff0 2023-10-18T17:27:39.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c8e145700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c88067ff0 0x7f9c880683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:39.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c8e145700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c88067ff0 0x7f9c880683d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:48442/0 (socket says 172.21.15.158:48442) 2023-10-18T17:27:39.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c8e145700 1 -- 172.21.15.158:0/3837663469 learned_addr learned my addr 172.21.15.158:0/3837663469 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:39.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c8e946700 1 --2- 172.21.15.158:0/3837663469 >> v2:172.21.15.158:3300/0 conn(0x7f9c88151410 0x7f9c881518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:39.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c8d143700 1 -- 172.21.15.158:0/3837663469 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342713498 0 0) 0x7f9c88065cd0 con 0x7f9c880666b0 2023-10-18T17:27:39.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c8d143700 1 -- 172.21.15.158:0/3837663469 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c740033f0 con 0x7f9c880666b0 2023-10-18T17:27:39.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c8e145700 1 -- 172.21.15.158:0/3837663469 >> v2:172.21.15.158:3300/0 conn(0x7f9c88151410 msgr2=0x7f9c881518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:27:39.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c8e145700 1 --2- 172.21.15.158:0/3837663469 >> v2:172.21.15.158:3300/0 conn(0x7f9c88151410 0x7f9c881518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:39.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c8e145700 1 -- 172.21.15.158:0/3837663469 >> v1:172.21.15.158:6789/0 conn(0x7f9c880666b0 legacy=0x7f9c880bd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:39.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c8e145700 1 -- 172.21.15.158:0/3837663469 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c88065100 con 0x7f9c88067ff0 2023-10-18T17:27:39.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c8e145700 1 --2- 172.21.15.158:0/3837663469 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c88067ff0 0x7f9c880683d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f9c84006fd0 tx=0x7f9c840090f0).ready entity=mon.2 client_cookie=74fb6b97f8bda22d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:39.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c8d143700 1 -- 172.21.15.158:0/3837663469 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8400f510 con 0x7f9c88067ff0 2023-10-18T17:27:39.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c8d143700 1 -- 172.21.15.158:0/3837663469 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8400f670 con 0x7f9c88067ff0 2023-10-18T17:27:39.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c8d143700 1 -- 172.21.15.158:0/3837663469 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8400f9f0 con 0x7f9c88067ff0 2023-10-18T17:27:39.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c903a9700 1 -- 172.21.15.158:0/3837663469 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c88067ff0 msgr2=0x7f9c880683d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:39.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c903a9700 1 --2- 172.21.15.158:0/3837663469 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c88067ff0 0x7f9c880683d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f9c84006fd0 tx=0x7f9c840090f0).stop 2023-10-18T17:27:39.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c903a9700 1 -- 172.21.15.158:0/3837663469 shutdown_connections 2023-10-18T17:27:39.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c903a9700 1 --2- 172.21.15.158:0/3837663469 >> v2:172.21.15.158:3300/0 conn(0x7f9c88151410 0x7f9c881518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:39.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c903a9700 1 --2- 172.21.15.158:0/3837663469 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c88067ff0 0x7f9c880683d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:39.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c903a9700 1 -- 172.21.15.158:0/3837663469 >> 172.21.15.158:0/3837663469 conn(0x7f9c880620d0 msgr2=0x7f9c880624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:39.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c903a9700 1 -- 172.21.15.158:0/3837663469 shutdown_connections 2023-10-18T17:27:39.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.202+0000 7f9c903a9700 1 -- 172.21.15.158:0/3837663469 wait complete. 2023-10-18T17:27:39.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.206+0000 7f9c903a9700 1 Processor -- start 2023-10-18T17:27:39.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.206+0000 7f9c903a9700 1 -- start start 2023-10-18T17:27:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.206+0000 7f9c903a9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c880666b0 0x7f9c8815a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.206+0000 7f9c903a9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c88067ff0 0x7f9c880ba850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.206+0000 7f9c903a9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c88151410 0x7f9c880bad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.206+0000 7f9c903a9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c88159340 con 0x7f9c880666b0 2023-10-18T17:27:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.206+0000 7f9c903a9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8815a670 con 0x7f9c88067ff0 2023-10-18T17:27:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.206+0000 7f9c903a9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c880b99c0 con 0x7f9c88151410 2023-10-18T17:27:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.206+0000 7f9c8e145700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c880666b0 0x7f9c8815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:39.218 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.206+0000 7f9c8e145700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c880666b0 0x7f9c8815a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:50888/0 (socket says 172.21.15.158:50888) 2023-10-18T17:27:39.218 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.206+0000 7f9c8e145700 1 -- 172.21.15.158:0/1890148013 learned_addr learned my addr 172.21.15.158:0/1890148013 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:39.218 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.206+0000 7f9c8e946700 1 --2- 172.21.15.158:0/1890148013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c88151410 0x7f9c880bad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:39.218 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.206+0000 7f9c8d944700 1 --2- 172.21.15.158:0/1890148013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c88067ff0 0x7f9c880ba850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:39.218 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.206+0000 7f9c8e145700 1 -- 172.21.15.158:0/1890148013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c88151410 msgr2=0x7f9c880bad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:39.219 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.206+0000 7f9c8e145700 1 --2- 172.21.15.158:0/1890148013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c88151410 0x7f9c880bad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:39.219 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.206+0000 7f9c8e145700 1 -- 172.21.15.158:0/1890148013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c88067ff0 msgr2=0x7f9c880ba850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:39.219 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.206+0000 7f9c8e145700 1 --2- 172.21.15.158:0/1890148013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c88067ff0 0x7f9c880ba850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:39.219 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.206+0000 7f9c8e145700 1 -- 172.21.15.158:0/1890148013 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c84009370 con 0x7f9c880666b0 2023-10-18T17:27:39.219 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.206+0000 7f9c8d944700 1 --2- 172.21.15.158:0/1890148013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c88067ff0 0x7f9c880ba850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:27:39.220 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.210+0000 7f9c8e145700 1 --2- 172.21.15.158:0/1890148013 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c880666b0 0x7f9c8815a180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f9c84009df0 tx=0x7f9c84017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:39.220 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.210+0000 7f9c7e7fc700 1 -- 172.21.15.158:0/1890148013 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8400fe80 con 0x7f9c880666b0 2023-10-18T17:27:39.220 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.210+0000 7f9c7e7fc700 1 -- 172.21.15.158:0/1890148013 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8400f7e0 con 0x7f9c880666b0 2023-10-18T17:27:39.220 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.210+0000 7f9c903a9700 1 -- 172.21.15.158:0/1890148013 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c88159800 con 0x7f9c880666b0 2023-10-18T17:27:39.220 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.210+0000 7f9c7e7fc700 1 -- 172.21.15.158:0/1890148013 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84024680 con 0x7f9c880666b0 2023-10-18T17:27:39.220 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.210+0000 7f9c903a9700 1 -- 172.21.15.158:0/1890148013 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c88159520 con 0x7f9c880666b0 2023-10-18T17:27:39.221 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.210+0000 7f9c903a9700 1 -- 172.21.15.158:0/1890148013 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8806c190 con 0x7f9c880666b0 2023-10-18T17:27:39.222 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.210+0000 7f9c7e7fc700 1 -- 172.21.15.158:0/1890148013 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9c84021070 con 0x7f9c880666b0 2023-10-18T17:27:39.222 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.214+0000 7f9c7e7fc700 1 --2- 172.21.15.158:0/1890148013 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9c6c05a510 0x7f9c6c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:39.222 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.214+0000 7f9c7e7fc700 1 -- 172.21.15.158:0/1890148013 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f9c84076500 con 0x7f9c880666b0 2023-10-18T17:27:39.222 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.214+0000 7f9c8d944700 1 --2- 172.21.15.158:0/1890148013 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9c6c05a510 0x7f9c6c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:39.222 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.214+0000 7f9c8d944700 1 --2- 172.21.15.158:0/1890148013 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9c6c05a510 0x7f9c6c05c9d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f9c78007fd0 tx=0x7f9c78009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:39.227 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.222+0000 7f9c7e7fc700 1 -- 172.21.15.158:0/1890148013 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f9c84049bb0 con 0x7f9c880666b0 2023-10-18T17:27:39.423 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.414+0000 7f9c903a9700 1 -- 172.21.15.158:0/1890148013 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9c880653a0 con 0x7f9c880666b0 2023-10-18T17:27:39.424 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.418+0000 7f9c7e7fc700 1 -- 172.21.15.158:0/1890148013 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f9c8404d150 con 0x7f9c880666b0 2023-10-18T17:27:39.424 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:27:39.426 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.418+0000 7f9c903a9700 1 -- 172.21.15.158:0/1890148013 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9c6c05a510 msgr2=0x7f9c6c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:39.426 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.418+0000 7f9c903a9700 1 --2- 172.21.15.158:0/1890148013 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9c6c05a510 0x7f9c6c05c9d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f9c78007fd0 tx=0x7f9c78009040).stop 2023-10-18T17:27:39.427 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.418+0000 7f9c903a9700 1 -- 172.21.15.158:0/1890148013 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c880666b0 msgr2=0x7f9c8815a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:39.427 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.418+0000 7f9c903a9700 1 --2- 172.21.15.158:0/1890148013 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c880666b0 0x7f9c8815a180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f9c84009df0 tx=0x7f9c84017000).stop 2023-10-18T17:27:39.427 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.418+0000 7f9c903a9700 1 -- 172.21.15.158:0/1890148013 shutdown_connections 2023-10-18T17:27:39.428 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.418+0000 7f9c903a9700 1 --2- 172.21.15.158:0/1890148013 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f9c6c05a510 0x7f9c6c05c9d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:39.428 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.418+0000 7f9c903a9700 1 --2- 172.21.15.158:0/1890148013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c88151410 0x7f9c880bad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:39.428 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.418+0000 7f9c903a9700 1 --2- 172.21.15.158:0/1890148013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c88067ff0 0x7f9c880ba850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:39.428 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.418+0000 7f9c903a9700 1 --2- 172.21.15.158:0/1890148013 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c880666b0 0x7f9c8815a180 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:39.428 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.418+0000 7f9c903a9700 1 -- 172.21.15.158:0/1890148013 >> 172.21.15.158:0/1890148013 conn(0x7f9c880620d0 msgr2=0x7f9c88154920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:39.429 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.418+0000 7f9c903a9700 1 -- 172.21.15.158:0/1890148013 shutdown_connections 2023-10-18T17:27:39.429 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:39.418+0000 7f9c903a9700 1 -- 172.21.15.158:0/1890148013 wait complete. 2023-10-18T17:27:39.445 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:27:39.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~153s 2023-10-18T17:27:39.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~207s 2023-10-18T17:27:39.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~133s 2023-10-18T17:27:39.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~120s 2023-10-18T17:27:39.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~166s 2023-10-18T17:27:39.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~107s 2023-10-18T17:27:42.447 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:27:42.619 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.609+0000 7fdd3f1a9700 1 Processor -- start 2023-10-18T17:27:42.619 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.609+0000 7fdd3f1a9700 1 -- start start 2023-10-18T17:27:42.620 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.613+0000 7fdd3f1a9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdd380b9690 0x7fdd380b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:42.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.613+0000 7fdd3f1a9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd380bc480 con 0x7fdd380bca50 2023-10-18T17:27:42.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.613+0000 7fdd3f1a9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd38065190 con 0x7fdd38065d30 2023-10-18T17:27:42.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.613+0000 7fdd3f1a9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd380bb920 con 0x7fdd380b9690 2023-10-18T17:27:42.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.613+0000 7fdd2ffff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fdd380bca50 0x7fdd38065620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:35438/0 (socket says 172.21.15.158:35438) 2023-10-18T17:27:42.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.613+0000 7fdd2ffff700 1 -- 172.21.15.158:0/1155375203 learned_addr learned my addr 172.21.15.158:0/1155375203 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:27:42.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.613+0000 7fdd3cf45700 1 --2- 172.21.15.158:0/1155375203 >> v2:172.21.15.183:3300/0 conn(0x7fdd380b9690 0x7fdd380b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:42.624 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.613+0000 7fdd2f7fe700 1 -- 172.21.15.158:0/1155375203 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184050257 0 0) 0x7fdd380bc480 con 0x7fdd380bca50 2023-10-18T17:27:42.624 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.613+0000 7fdd2f7fe700 1 -- 172.21.15.158:0/1155375203 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd200033f0 con 0x7fdd380bca50 2023-10-18T17:27:42.624 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.613+0000 7fdd2f7fe700 1 -- 172.21.15.158:0/1155375203 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380954656 0 0) 0x7fdd38065190 con 0x7fdd38065d30 2023-10-18T17:27:42.624 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.613+0000 7fdd2f7fe700 1 -- 172.21.15.158:0/1155375203 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd380bc480 con 0x7fdd38065d30 2023-10-18T17:27:42.624 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.613+0000 7fdd3cf45700 1 -- 172.21.15.158:0/1155375203 >> v1:172.21.15.183:6789/0 conn(0x7fdd38065d30 legacy=0x7fdd380b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:42.625 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.613+0000 7fdd3cf45700 1 -- 172.21.15.158:0/1155375203 >> v1:172.21.15.158:6789/0 conn(0x7fdd380bca50 legacy=0x7fdd38065620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:42.625 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.613+0000 7fdd3cf45700 1 -- 172.21.15.158:0/1155375203 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd380bbbe0 con 0x7fdd380b9690 2023-10-18T17:27:42.625 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.613+0000 7fdd3cf45700 1 --2- 172.21.15.158:0/1155375203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd380b9690 0x7fdd380b9a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fdd34009e60 tx=0x7fdd34009780).ready entity=mon.1 client_cookie=ea12b78a3d586e20 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:42.625 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.613+0000 7fdd2f7fe700 1 -- 172.21.15.158:0/1155375203 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400e070 con 0x7fdd380b9690 2023-10-18T17:27:42.625 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.613+0000 7fdd2f7fe700 1 -- 172.21.15.158:0/1155375203 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3400bab0 con 0x7fdd380b9690 2023-10-18T17:27:42.626 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.613+0000 7fdd2f7fe700 1 -- 172.21.15.158:0/1155375203 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400be30 con 0x7fdd380b9690 2023-10-18T17:27:42.626 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.617+0000 7fdd3f1a9700 1 -- 172.21.15.158:0/1155375203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd380b9690 msgr2=0x7fdd380b9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:42.626 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.617+0000 7fdd3f1a9700 1 --2- 172.21.15.158:0/1155375203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd380b9690 0x7fdd380b9a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fdd34009e60 tx=0x7fdd34009780).stop 2023-10-18T17:27:42.626 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.617+0000 7fdd3f1a9700 1 -- 172.21.15.158:0/1155375203 shutdown_connections 2023-10-18T17:27:42.626 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.617+0000 7fdd3f1a9700 1 --2- 172.21.15.158:0/1155375203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd380b9690 0x7fdd380b9a70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:42.627 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.617+0000 7fdd3f1a9700 1 -- 172.21.15.158:0/1155375203 >> 172.21.15.158:0/1155375203 conn(0x7fdd380620d0 msgr2=0x7fdd380624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:42.627 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.617+0000 7fdd3f1a9700 1 -- 172.21.15.158:0/1155375203 shutdown_connections 2023-10-18T17:27:42.627 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.617+0000 7fdd3f1a9700 1 -- 172.21.15.158:0/1155375203 wait complete. 2023-10-18T17:27:42.629 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.617+0000 7fdd3f1a9700 1 Processor -- start 2023-10-18T17:27:42.629 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.617+0000 7fdd3f1a9700 1 -- start start 2023-10-18T17:27:42.630 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.617+0000 7fdd3f1a9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd38065d30 0x7fdd38165430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:42.630 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.617+0000 7fdd3f1a9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd380b9690 0x7fdd380c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:42.630 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.617+0000 7fdd3f1a9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd380c2c40 0x7fdd380bfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:42.630 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.617+0000 7fdd3f1a9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd38153f00 con 0x7fdd38065d30 2023-10-18T17:27:42.631 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.617+0000 7fdd3f1a9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd38165920 con 0x7fdd380b9690 2023-10-18T17:27:42.631 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.617+0000 7fdd3f1a9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd38153310 con 0x7fdd380c2c40 2023-10-18T17:27:42.631 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.621+0000 7fdd3cf45700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd38065d30 0x7fdd38165430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:42.631 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.621+0000 7fdd3cf45700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd38065d30 0x7fdd38165430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:50902/0 (socket says 172.21.15.158:50902) 2023-10-18T17:27:42.631 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.621+0000 7fdd3cf45700 1 -- 172.21.15.158:0/2067841423 learned_addr learned my addr 172.21.15.158:0/2067841423 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:42.632 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.621+0000 7fdd2ffff700 1 --2- 172.21.15.158:0/2067841423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd380b9690 0x7fdd380c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:42.632 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.621+0000 7fdd3d746700 1 --2- 172.21.15.158:0/2067841423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd380c2c40 0x7fdd380bfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:42.632 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.621+0000 7fdd3cf45700 1 -- 172.21.15.158:0/2067841423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd380c2c40 msgr2=0x7fdd380bfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:42.632 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.621+0000 7fdd3cf45700 1 --2- 172.21.15.158:0/2067841423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd380c2c40 0x7fdd380bfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:42.632 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.621+0000 7fdd3cf45700 1 -- 172.21.15.158:0/2067841423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd380b9690 msgr2=0x7fdd380c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:42.633 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.621+0000 7fdd3cf45700 1 --2- 172.21.15.158:0/2067841423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd380b9690 0x7fdd380c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:42.633 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.621+0000 7fdd3cf45700 1 -- 172.21.15.158:0/2067841423 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd34009a20 con 0x7fdd38065d30 2023-10-18T17:27:42.633 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.621+0000 7fdd3cf45700 1 --2- 172.21.15.158:0/2067841423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd38065d30 0x7fdd38165430 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fdd38067680 tx=0x7fdd380bb400).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:42.633 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.621+0000 7fdd2cff9700 1 -- 172.21.15.158:0/2067841423 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34012db0 con 0x7fdd38065d30 2023-10-18T17:27:42.633 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.621+0000 7fdd2cff9700 1 -- 172.21.15.158:0/2067841423 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3401d420 con 0x7fdd38065d30 2023-10-18T17:27:42.634 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.621+0000 7fdd2cff9700 1 -- 172.21.15.158:0/2067841423 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3401d7c0 con 0x7fdd38065d30 2023-10-18T17:27:42.634 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.621+0000 7fdd3f1a9700 1 -- 172.21.15.158:0/2067841423 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd38152260 con 0x7fdd38065d30 2023-10-18T17:27:42.634 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.621+0000 7fdd3f1a9700 1 -- 172.21.15.158:0/2067841423 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd38153840 con 0x7fdd38065d30 2023-10-18T17:27:42.635 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.621+0000 7fdd3f1a9700 1 -- 172.21.15.158:0/2067841423 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3806c190 con 0x7fdd38065d30 2023-10-18T17:27:42.635 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.625+0000 7fdd2cff9700 1 -- 172.21.15.158:0/2067841423 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdd3401db30 con 0x7fdd38065d30 2023-10-18T17:27:42.635 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.625+0000 7fdd2cff9700 1 --2- 172.21.15.158:0/2067841423 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fdd2405a4e0 0x7fdd2405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:42.636 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.625+0000 7fdd2cff9700 1 -- 172.21.15.158:0/2067841423 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fdd340765d0 con 0x7fdd38065d30 2023-10-18T17:27:42.636 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.625+0000 7fdd2ffff700 1 --2- 172.21.15.158:0/2067841423 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fdd2405a4e0 0x7fdd2405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:42.636 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.625+0000 7fdd2ffff700 1 --2- 172.21.15.158:0/2067841423 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fdd2405a4e0 0x7fdd2405c9a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fdd380beea0 tx=0x7fdd28009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:42.640 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.633+0000 7fdd2cff9700 1 -- 172.21.15.158:0/2067841423 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fdd34049a90 con 0x7fdd38065d30 2023-10-18T17:27:42.831 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.821+0000 7fdd3f1a9700 1 -- 172.21.15.158:0/2067841423 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdd380bbec0 con 0x7fdd38065d30 2023-10-18T17:27:42.832 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.825+0000 7fdd2cff9700 1 -- 172.21.15.158:0/2067841423 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fdd3404d0b0 con 0x7fdd38065d30 2023-10-18T17:27:42.832 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:27:42.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.825+0000 7fdd3f1a9700 1 -- 172.21.15.158:0/2067841423 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fdd2405a4e0 msgr2=0x7fdd2405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:42.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.825+0000 7fdd3f1a9700 1 --2- 172.21.15.158:0/2067841423 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fdd2405a4e0 0x7fdd2405c9a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fdd380beea0 tx=0x7fdd28009040).stop 2023-10-18T17:27:42.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.825+0000 7fdd3f1a9700 1 -- 172.21.15.158:0/2067841423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd38065d30 msgr2=0x7fdd38165430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:42.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.825+0000 7fdd3f1a9700 1 --2- 172.21.15.158:0/2067841423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd38065d30 0x7fdd38165430 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fdd38067680 tx=0x7fdd380bb400).stop 2023-10-18T17:27:42.835 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.825+0000 7fdd3f1a9700 1 -- 172.21.15.158:0/2067841423 shutdown_connections 2023-10-18T17:27:42.836 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.825+0000 7fdd3f1a9700 1 --2- 172.21.15.158:0/2067841423 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fdd2405a4e0 0x7fdd2405c9a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:42.836 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.825+0000 7fdd3f1a9700 1 --2- 172.21.15.158:0/2067841423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd380c2c40 0x7fdd380bfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:42.836 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.825+0000 7fdd3f1a9700 1 --2- 172.21.15.158:0/2067841423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd380b9690 0x7fdd380c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:42.836 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.825+0000 7fdd3f1a9700 1 --2- 172.21.15.158:0/2067841423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd38065d30 0x7fdd38165430 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:42.836 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.825+0000 7fdd3f1a9700 1 -- 172.21.15.158:0/2067841423 >> 172.21.15.158:0/2067841423 conn(0x7fdd380620d0 msgr2=0x7fdd38151350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:42.837 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.825+0000 7fdd3f1a9700 1 -- 172.21.15.158:0/2067841423 shutdown_connections 2023-10-18T17:27:42.837 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:42.825+0000 7fdd3f1a9700 1 -- 172.21.15.158:0/2067841423 wait complete. 2023-10-18T17:27:42.856 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:27:45.857 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:27:45.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~159s 2023-10-18T17:27:45.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~214s 2023-10-18T17:27:45.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~139s 2023-10-18T17:27:45.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~126s 2023-10-18T17:27:45.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~173s 2023-10-18T17:27:45.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~114s 2023-10-18T17:27:46.017 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.013+0000 7ff47b59e700 1 Processor -- start 2023-10-18T17:27:46.017 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.013+0000 7ff47b59e700 1 -- start start 2023-10-18T17:27:46.020 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff47b59e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff47c065c80 0x7ff47c14cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:46.021 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff47b59e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47c06a760 con 0x7ff47c0658a0 2023-10-18T17:27:46.021 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff47b59e700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47c0c2d40 con 0x7ff47c069f20 2023-10-18T17:27:46.021 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff47b59e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47c150bf0 con 0x7ff47c065c80 2023-10-18T17:27:46.021 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff47a59c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7ff47c0658a0 0x7ff47c0c2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:35448/0 (socket says 172.21.15.158:35448) 2023-10-18T17:27:46.021 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff47a59c700 1 -- 172.21.15.158:0/1923227847 learned_addr learned my addr 172.21.15.158:0/1923227847 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:27:46.022 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff47ad9d700 1 --2- 172.21.15.158:0/1923227847 >> v2:172.21.15.158:3300/0 conn(0x7ff47c065c80 0x7ff47c14cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:46.023 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff479d9b700 1 -- 172.21.15.158:0/1923227847 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850689738 0 0) 0x7ff47c0c2d40 con 0x7ff47c069f20 2023-10-18T17:27:46.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff479d9b700 1 -- 172.21.15.158:0/1923227847 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4680033f0 con 0x7ff47c069f20 2023-10-18T17:27:46.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff479d9b700 1 -- 172.21.15.158:0/1923227847 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808467436 0 0) 0x7ff47c06a760 con 0x7ff47c0658a0 2023-10-18T17:27:46.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff47ad9d700 1 -- 172.21.15.158:0/1923227847 >> v1:172.21.15.183:6789/0 conn(0x7ff47c069f20 legacy=0x7ff47c0630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:46.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff47ad9d700 1 -- 172.21.15.158:0/1923227847 >> v1:172.21.15.158:6789/0 conn(0x7ff47c0658a0 legacy=0x7ff47c0c2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:46.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff47ad9d700 1 -- 172.21.15.158:0/1923227847 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c06a480 con 0x7ff47c065c80 2023-10-18T17:27:46.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff47ad9d700 1 --2- 172.21.15.158:0/1923227847 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff47c065c80 0x7ff47c14cda0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7ff474009e60 tx=0x7ff474009780).ready entity=mon.0 client_cookie=51cb737340e4d463 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:46.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff479d9b700 1 -- 172.21.15.158:0/1923227847 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47400e070 con 0x7ff47c065c80 2023-10-18T17:27:46.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff479d9b700 1 -- 172.21.15.158:0/1923227847 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47400bbf0 con 0x7ff47c065c80 2023-10-18T17:27:46.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff479d9b700 1 -- 172.21.15.158:0/1923227847 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff474012410 con 0x7ff47c065c80 2023-10-18T17:27:46.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff47b59e700 1 -- 172.21.15.158:0/1923227847 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff47c065c80 msgr2=0x7ff47c14cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:46.026 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff47b59e700 1 --2- 172.21.15.158:0/1923227847 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff47c065c80 0x7ff47c14cda0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7ff474009e60 tx=0x7ff474009780).stop 2023-10-18T17:27:46.026 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff47b59e700 1 -- 172.21.15.158:0/1923227847 shutdown_connections 2023-10-18T17:27:46.026 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff47b59e700 1 --2- 172.21.15.158:0/1923227847 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff47c065c80 0x7ff47c14cda0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:46.027 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.017+0000 7ff47b59e700 1 -- 172.21.15.158:0/1923227847 >> 172.21.15.158:0/1923227847 conn(0x7ff47c062ba0 msgr2=0x7ff47c0c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:46.027 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.021+0000 7ff47b59e700 1 -- 172.21.15.158:0/1923227847 shutdown_connections 2023-10-18T17:27:46.027 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.021+0000 7ff47b59e700 1 -- 172.21.15.158:0/1923227847 wait complete. 2023-10-18T17:27:46.029 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.021+0000 7ff47b59e700 1 Processor -- start 2023-10-18T17:27:46.029 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.021+0000 7ff47b59e700 1 -- start start 2023-10-18T17:27:46.030 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.021+0000 7ff47b59e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff47c0658a0 0x7ff47c0bb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:46.030 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.021+0000 7ff47b59e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff47c065c80 0x7ff47c162f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:46.030 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.021+0000 7ff47b59e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff47c069f20 0x7ff47c163430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:46.030 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.021+0000 7ff47b59e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c0b9090 con 0x7ff47c069f20 2023-10-18T17:27:46.030 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.021+0000 7ff47b59e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c0b5af0 con 0x7ff47c0658a0 2023-10-18T17:27:46.031 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.021+0000 7ff47b59e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c0b8b40 con 0x7ff47c065c80 2023-10-18T17:27:46.031 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.021+0000 7ff47a59c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff47c0658a0 0x7ff47c0bb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:46.031 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.021+0000 7ff47a59c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff47c0658a0 0x7ff47c0bb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:41026/0 (socket says 172.21.15.158:41026) 2023-10-18T17:27:46.031 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.021+0000 7ff47a59c700 1 -- 172.21.15.158:0/3506135766 learned_addr learned my addr 172.21.15.158:0/3506135766 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:46.031 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.021+0000 7ff47ad9d700 1 --2- 172.21.15.158:0/3506135766 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff47c069f20 0x7ff47c163430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:46.032 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.021+0000 7ff473fff700 1 --2- 172.21.15.158:0/3506135766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff47c065c80 0x7ff47c162f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:46.032 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.025+0000 7ff47a59c700 1 -- 172.21.15.158:0/3506135766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff47c065c80 msgr2=0x7ff47c162f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:46.032 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.025+0000 7ff47a59c700 1 --2- 172.21.15.158:0/3506135766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff47c065c80 0x7ff47c162f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:46.032 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.025+0000 7ff47a59c700 1 -- 172.21.15.158:0/3506135766 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff47c069f20 msgr2=0x7ff47c163430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:46.032 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.025+0000 7ff47a59c700 1 --2- 172.21.15.158:0/3506135766 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff47c069f20 0x7ff47c163430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:46.033 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.025+0000 7ff47a59c700 1 -- 172.21.15.158:0/3506135766 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff474009a20 con 0x7ff47c0658a0 2023-10-18T17:27:46.033 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.025+0000 7ff47a59c700 1 --2- 172.21.15.158:0/3506135766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff47c0658a0 0x7ff47c0bb2c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7ff46c00c510 tx=0x7ff46c007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:46.033 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.025+0000 7ff4727fc700 1 -- 172.21.15.158:0/3506135766 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c00ce80 con 0x7ff47c0658a0 2023-10-18T17:27:46.033 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.025+0000 7ff4727fc700 1 -- 172.21.15.158:0/3506135766 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c0072e0 con 0x7ff47c0658a0 2023-10-18T17:27:46.034 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.025+0000 7ff4727fc700 1 -- 172.21.15.158:0/3506135766 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c007660 con 0x7ff47c0658a0 2023-10-18T17:27:46.034 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.025+0000 7ff47b59e700 1 -- 172.21.15.158:0/3506135766 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47c0bb7b0 con 0x7ff47c0658a0 2023-10-18T17:27:46.034 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.025+0000 7ff47b59e700 1 -- 172.21.15.158:0/3506135766 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47c0ba7e0 con 0x7ff47c0658a0 2023-10-18T17:27:46.035 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.025+0000 7ff47b59e700 1 -- 172.21.15.158:0/3506135766 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47c046f00 con 0x7ff47c0658a0 2023-10-18T17:27:46.035 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.025+0000 7ff4727fc700 1 -- 172.21.15.158:0/3506135766 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff46c0059b0 con 0x7ff47c0658a0 2023-10-18T17:27:46.035 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.029+0000 7ff4727fc700 1 --2- 172.21.15.158:0/3506135766 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff45c05a510 0x7ff45c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:46.036 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.029+0000 7ff4727fc700 1 -- 172.21.15.158:0/3506135766 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7ff46c0740d0 con 0x7ff47c0658a0 2023-10-18T17:27:46.036 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.029+0000 7ff473fff700 1 --2- 172.21.15.158:0/3506135766 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff45c05a510 0x7ff45c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:46.036 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.029+0000 7ff473fff700 1 --2- 172.21.15.158:0/3506135766 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff45c05a510 0x7ff45c05c9d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7ff47c0a5210 tx=0x7ff464007bd0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:46.042 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.037+0000 7ff4727fc700 1 -- 172.21.15.158:0/3506135766 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7ff46c047650 con 0x7ff47c0658a0 2023-10-18T17:27:46.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.229+0000 7ff47b59e700 1 -- 172.21.15.158:0/3506135766 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff47c0661a0 con 0x7ff47c0658a0 2023-10-18T17:27:46.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.229+0000 7ff4727fc700 1 -- 172.21.15.158:0/3506135766 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7ff46c007db0 con 0x7ff47c0658a0 2023-10-18T17:27:46.235 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:27:46.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.237+0000 7ff47b59e700 1 -- 172.21.15.158:0/3506135766 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff45c05a510 msgr2=0x7ff45c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:46.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.237+0000 7ff47b59e700 1 --2- 172.21.15.158:0/3506135766 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff45c05a510 0x7ff45c05c9d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7ff47c0a5210 tx=0x7ff464007bd0).stop 2023-10-18T17:27:46.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.237+0000 7ff47b59e700 1 -- 172.21.15.158:0/3506135766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff47c0658a0 msgr2=0x7ff47c0bb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:46.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.237+0000 7ff47b59e700 1 --2- 172.21.15.158:0/3506135766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff47c0658a0 0x7ff47c0bb2c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7ff46c00c510 tx=0x7ff46c007c70).stop 2023-10-18T17:27:46.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.237+0000 7ff47b59e700 1 -- 172.21.15.158:0/3506135766 shutdown_connections 2023-10-18T17:27:46.241 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.237+0000 7ff47b59e700 1 --2- 172.21.15.158:0/3506135766 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff45c05a510 0x7ff45c05c9d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:46.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.237+0000 7ff47b59e700 1 --2- 172.21.15.158:0/3506135766 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff47c069f20 0x7ff47c163430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:46.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.237+0000 7ff47b59e700 1 --2- 172.21.15.158:0/3506135766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff47c065c80 0x7ff47c162f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:46.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.237+0000 7ff47b59e700 1 --2- 172.21.15.158:0/3506135766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff47c0658a0 0x7ff47c0bb2c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:46.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.237+0000 7ff47b59e700 1 -- 172.21.15.158:0/3506135766 >> 172.21.15.158:0/3506135766 conn(0x7ff47c062ba0 msgr2=0x7ff47c0bc520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:46.242 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.237+0000 7ff47b59e700 1 -- 172.21.15.158:0/3506135766 shutdown_connections 2023-10-18T17:27:46.243 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:46.237+0000 7ff47b59e700 1 -- 172.21.15.158:0/3506135766 wait complete. 2023-10-18T17:27:46.261 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:27:49.262 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:27:49.430 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.425+0000 7fcb17e1b700 1 Processor -- start 2023-10-18T17:27:49.431 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.425+0000 7fcb17e1b700 1 -- start start 2023-10-18T17:27:49.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb17e1b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcb10067ff0 0x7fcb100683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:49.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb17e1b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb10066900 con 0x7fcb100bca50 2023-10-18T17:27:49.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb17e1b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb100659a0 con 0x7fcb10065e30 2023-10-18T17:27:49.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb17e1b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb10068a50 con 0x7fcb10067ff0 2023-10-18T17:27:49.433 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb15bb7700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcb10067ff0 0x7fcb100683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:49.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb153b6700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fcb10065e30 0x7fcb100bdc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:55370/0 (socket says 172.21.15.158:55370) 2023-10-18T17:27:49.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb153b6700 1 -- 172.21.15.158:0/1621448724 learned_addr learned my addr 172.21.15.158:0/1621448724 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:27:49.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb163b8700 1 --1- 172.21.15.158:0/1621448724 >> v1:172.21.15.158:6789/0 conn(0x7fcb100bca50 0x7fcb10150890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:44440/0 (socket says 172.21.15.158:44440) 2023-10-18T17:27:49.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb15bb7700 1 -- 172.21.15.158:0/1621448724 >> v1:172.21.15.183:6789/0 conn(0x7fcb10065e30 legacy=0x7fcb100bdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:49.434 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb15bb7700 1 -- 172.21.15.158:0/1621448724 >> v1:172.21.15.158:6789/0 conn(0x7fcb100bca50 legacy=0x7fcb10150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:49.435 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb15bb7700 1 -- 172.21.15.158:0/1621448724 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb10066620 con 0x7fcb10067ff0 2023-10-18T17:27:49.435 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb15bb7700 1 --2- 172.21.15.158:0/1621448724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb10067ff0 0x7fcb100683d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fcb0c009760 tx=0x7fcb0c009060).ready entity=mon.1 client_cookie=f604188935c142bc server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:49.436 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb14bb5700 1 -- 172.21.15.158:0/1621448724 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c00b610 con 0x7fcb10067ff0 2023-10-18T17:27:49.436 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb14bb5700 1 -- 172.21.15.158:0/1621448724 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c00b770 con 0x7fcb10067ff0 2023-10-18T17:27:49.437 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb14bb5700 1 -- 172.21.15.158:0/1621448724 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c00baf0 con 0x7fcb10067ff0 2023-10-18T17:27:49.437 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb17e1b700 1 -- 172.21.15.158:0/1621448724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb10067ff0 msgr2=0x7fcb100683d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:49.437 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb17e1b700 1 --2- 172.21.15.158:0/1621448724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb10067ff0 0x7fcb100683d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fcb0c009760 tx=0x7fcb0c009060).stop 2023-10-18T17:27:49.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb17e1b700 1 -- 172.21.15.158:0/1621448724 shutdown_connections 2023-10-18T17:27:49.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb17e1b700 1 --2- 172.21.15.158:0/1621448724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb10067ff0 0x7fcb100683d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:49.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb17e1b700 1 -- 172.21.15.158:0/1621448724 >> 172.21.15.158:0/1621448724 conn(0x7fcb100620d0 msgr2=0x7fcb100624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:49.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.429+0000 7fcb17e1b700 1 -- 172.21.15.158:0/1621448724 shutdown_connections 2023-10-18T17:27:49.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.433+0000 7fcb17e1b700 1 -- 172.21.15.158:0/1621448724 wait complete. 2023-10-18T17:27:49.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.433+0000 7fcb17e1b700 1 Processor -- start 2023-10-18T17:27:49.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.433+0000 7fcb17e1b700 1 -- start start 2023-10-18T17:27:49.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.433+0000 7fcb17e1b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb10065e30 0x7fcb1014add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:49.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.433+0000 7fcb17e1b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcb10067ff0 0x7fcb1014b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:49.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.433+0000 7fcb17e1b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb100bca50 0x7fcb1014ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:49.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.433+0000 7fcb17e1b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb101642c0 con 0x7fcb10067ff0 2023-10-18T17:27:49.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.433+0000 7fcb17e1b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb100c2630 con 0x7fcb100bca50 2023-10-18T17:27:49.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.433+0000 7fcb17e1b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb100bc370 con 0x7fcb10065e30 2023-10-18T17:27:49.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.433+0000 7fcb15bb7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb10065e30 0x7fcb1014add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:49.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.433+0000 7fcb163b8700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb100bca50 0x7fcb1014ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:49.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.433+0000 7fcb15bb7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb10065e30 0x7fcb1014add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:46108/0 (socket says 172.21.15.158:46108) 2023-10-18T17:27:49.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.433+0000 7fcb15bb7700 1 -- 172.21.15.158:0/2071660913 learned_addr learned my addr 172.21.15.158:0/2071660913 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:49.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.433+0000 7fcb153b6700 1 --2- 172.21.15.158:0/2071660913 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcb10067ff0 0x7fcb1014b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:49.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.437+0000 7fcb15bb7700 1 -- 172.21.15.158:0/2071660913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb100bca50 msgr2=0x7fcb1014ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:49.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.437+0000 7fcb15bb7700 1 --2- 172.21.15.158:0/2071660913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb100bca50 0x7fcb1014ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:49.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.437+0000 7fcb15bb7700 1 -- 172.21.15.158:0/2071660913 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcb10067ff0 msgr2=0x7fcb1014b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:49.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.437+0000 7fcb15bb7700 1 --2- 172.21.15.158:0/2071660913 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcb10067ff0 0x7fcb1014b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:49.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.437+0000 7fcb15bb7700 1 -- 172.21.15.158:0/2071660913 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c0092a0 con 0x7fcb10065e30 2023-10-18T17:27:49.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.437+0000 7fcb153b6700 1 --2- 172.21.15.158:0/2071660913 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcb10067ff0 0x7fcb1014b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:27:49.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.437+0000 7fcb15bb7700 1 --2- 172.21.15.158:0/2071660913 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb10065e30 0x7fcb1014add0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fcb0c009eb0 tx=0x7fcb0c017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:49.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.437+0000 7fcb01ffb700 1 -- 172.21.15.158:0/2071660913 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c00baf0 con 0x7fcb10065e30 2023-10-18T17:27:49.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.437+0000 7fcb01ffb700 1 -- 172.21.15.158:0/2071660913 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c000c90 con 0x7fcb10065e30 2023-10-18T17:27:49.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.437+0000 7fcb01ffb700 1 -- 172.21.15.158:0/2071660913 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c01b650 con 0x7fcb10065e30 2023-10-18T17:27:49.448 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.437+0000 7fcb17e1b700 1 -- 172.21.15.158:0/2071660913 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb101633a0 con 0x7fcb10065e30 2023-10-18T17:27:49.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.437+0000 7fcb17e1b700 1 -- 172.21.15.158:0/2071660913 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb10163920 con 0x7fcb10065e30 2023-10-18T17:27:49.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.437+0000 7fcb17e1b700 1 -- 172.21.15.158:0/2071660913 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1006c190 con 0x7fcb10065e30 2023-10-18T17:27:49.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.437+0000 7fcb01ffb700 1 -- 172.21.15.158:0/2071660913 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcb0c01ba00 con 0x7fcb10065e30 2023-10-18T17:27:49.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.441+0000 7fcb01ffb700 1 --2- 172.21.15.158:0/2071660913 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcaf405a540 0x7fcaf405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:49.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.441+0000 7fcb01ffb700 1 -- 172.21.15.158:0/2071660913 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fcb0c076a70 con 0x7fcb10065e30 2023-10-18T17:27:49.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.441+0000 7fcb153b6700 1 --2- 172.21.15.158:0/2071660913 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcaf405a540 0x7fcaf405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:49.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.441+0000 7fcb153b6700 1 --2- 172.21.15.158:0/2071660913 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcaf405a540 0x7fcaf405ca00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fcb10150a20 tx=0x7fcb04009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:49.454 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.449+0000 7fcb01ffb700 1 -- 172.21.15.158:0/2071660913 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fcb0c049fb0 con 0x7fcb10065e30 2023-10-18T17:27:49.654 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.649+0000 7fcb17e1b700 1 -- 172.21.15.158:0/2071660913 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcb10063cf0 con 0x7fcb10065e30 2023-10-18T17:27:49.655 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.649+0000 7fcb01ffb700 1 -- 172.21.15.158:0/2071660913 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fcb0c01bcb0 con 0x7fcb10065e30 2023-10-18T17:27:49.656 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:27:49.660 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.657+0000 7fcb17e1b700 1 -- 172.21.15.158:0/2071660913 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcaf405a540 msgr2=0x7fcaf405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:49.660 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.657+0000 7fcb17e1b700 1 --2- 172.21.15.158:0/2071660913 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcaf405a540 0x7fcaf405ca00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fcb10150a20 tx=0x7fcb04009040).stop 2023-10-18T17:27:49.660 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.657+0000 7fcb17e1b700 1 -- 172.21.15.158:0/2071660913 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb10065e30 msgr2=0x7fcb1014add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:49.661 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.657+0000 7fcb17e1b700 1 --2- 172.21.15.158:0/2071660913 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb10065e30 0x7fcb1014add0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fcb0c009eb0 tx=0x7fcb0c017000).stop 2023-10-18T17:27:49.661 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.657+0000 7fcb17e1b700 1 -- 172.21.15.158:0/2071660913 shutdown_connections 2023-10-18T17:27:49.661 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.657+0000 7fcb17e1b700 1 --2- 172.21.15.158:0/2071660913 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fcaf405a540 0x7fcaf405ca00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:49.661 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.657+0000 7fcb17e1b700 1 --2- 172.21.15.158:0/2071660913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb100bca50 0x7fcb1014ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:49.661 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.657+0000 7fcb17e1b700 1 --2- 172.21.15.158:0/2071660913 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcb10067ff0 0x7fcb1014b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:49.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.657+0000 7fcb17e1b700 1 --2- 172.21.15.158:0/2071660913 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb10065e30 0x7fcb1014add0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:49.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.657+0000 7fcb17e1b700 1 -- 172.21.15.158:0/2071660913 >> 172.21.15.158:0/2071660913 conn(0x7fcb100620d0 msgr2=0x7fcb1014cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:49.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.657+0000 7fcb17e1b700 1 -- 172.21.15.158:0/2071660913 shutdown_connections 2023-10-18T17:27:49.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:49.657+0000 7fcb17e1b700 1 -- 172.21.15.158:0/2071660913 wait complete. 2023-10-18T17:27:49.680 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:27:52.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~166s 2023-10-18T17:27:52.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~220s 2023-10-18T17:27:52.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~146s 2023-10-18T17:27:52.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~133s 2023-10-18T17:27:52.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~179s 2023-10-18T17:27:52.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~120s 2023-10-18T17:27:52.681 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:27:52.840 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.837+0000 7fd3c0369700 1 Processor -- start 2023-10-18T17:27:52.840 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.837+0000 7fd3c0369700 1 -- start start 2023-10-18T17:27:52.844 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3c0369700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd3b8067ff0 0x7fd3b80683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:52.844 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3c0369700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd3b80bca50 0x7fd3b8150890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:52.844 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3c0369700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b8066900 con 0x7fd3b8065e30 2023-10-18T17:27:52.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3c0369700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b8068a50 con 0x7fd3b80bca50 2023-10-18T17:27:52.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3c0369700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b80659a0 con 0x7fd3b8067ff0 2023-10-18T17:27:52.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3be906700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd3b80bca50 0x7fd3b8150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:52.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3be105700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd3b8067ff0 0x7fd3b80683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:52.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3be105700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd3b8067ff0 0x7fd3b80683d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:40590/0 (socket says 172.21.15.158:40590) 2023-10-18T17:27:52.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3be105700 1 -- 172.21.15.158:0/230056785 learned_addr learned my addr 172.21.15.158:0/230056785 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:52.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3be906700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd3b80bca50 0x7fd3b8150890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:45924/0 (socket says 172.21.15.158:45924) 2023-10-18T17:27:52.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3be906700 1 -- 172.21.15.158:0/230056785 >> v2:172.21.15.183:3300/0 conn(0x7fd3b8067ff0 msgr2=0x7fd3b80683d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:27:52.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3be906700 1 --2- 172.21.15.158:0/230056785 >> v2:172.21.15.183:3300/0 conn(0x7fd3b8067ff0 0x7fd3b80683d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:52.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3be906700 1 -- 172.21.15.158:0/230056785 >> v1:172.21.15.183:6789/0 conn(0x7fd3b8065e30 legacy=0x7fd3b80bdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:52.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3be906700 1 -- 172.21.15.158:0/230056785 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b8066620 con 0x7fd3b80bca50 2023-10-18T17:27:52.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3be906700 1 --2- 172.21.15.158:0/230056785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3b80bca50 0x7fd3b8150890 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fd3b805e8c0 tx=0x7fd3b0009780).ready entity=mon.0 client_cookie=14d547d029668925 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:52.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3bd103700 1 -- 172.21.15.158:0/230056785 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b000e070 con 0x7fd3b80bca50 2023-10-18T17:27:52.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3bd103700 1 -- 172.21.15.158:0/230056785 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b000bbf0 con 0x7fd3b80bca50 2023-10-18T17:27:52.849 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3bd103700 1 -- 172.21.15.158:0/230056785 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0012410 con 0x7fd3b80bca50 2023-10-18T17:27:52.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3c0369700 1 -- 172.21.15.158:0/230056785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3b80bca50 msgr2=0x7fd3b8150890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:52.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3c0369700 1 --2- 172.21.15.158:0/230056785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3b80bca50 0x7fd3b8150890 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fd3b805e8c0 tx=0x7fd3b0009780).stop 2023-10-18T17:27:52.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3c0369700 1 -- 172.21.15.158:0/230056785 shutdown_connections 2023-10-18T17:27:52.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3c0369700 1 --2- 172.21.15.158:0/230056785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3b80bca50 0x7fd3b8150890 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:52.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3c0369700 1 --2- 172.21.15.158:0/230056785 >> v2:172.21.15.183:3300/0 conn(0x7fd3b8067ff0 0x7fd3b80683d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:52.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.841+0000 7fd3c0369700 1 -- 172.21.15.158:0/230056785 >> 172.21.15.158:0/230056785 conn(0x7fd3b80620d0 msgr2=0x7fd3b80624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:52.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.845+0000 7fd3c0369700 1 -- 172.21.15.158:0/230056785 shutdown_connections 2023-10-18T17:27:52.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.845+0000 7fd3c0369700 1 -- 172.21.15.158:0/230056785 wait complete. 2023-10-18T17:27:52.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.845+0000 7fd3c0369700 1 Processor -- start 2023-10-18T17:27:52.852 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.845+0000 7fd3c0369700 1 -- start start 2023-10-18T17:27:52.854 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.845+0000 7fd3c0369700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3b8065e30 0x7fd3b8150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:52.854 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.845+0000 7fd3c0369700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3b8067ff0 0x7fd3b80c1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:52.854 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.845+0000 7fd3c0369700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3b80bca50 0x7fd3b815fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:52.855 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.845+0000 7fd3c0369700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b814fb70 con 0x7fd3b80bca50 2023-10-18T17:27:52.855 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.845+0000 7fd3c0369700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b8160260 con 0x7fd3b8067ff0 2023-10-18T17:27:52.855 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.845+0000 7fd3c0369700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80c2e70 con 0x7fd3b8065e30 2023-10-18T17:27:52.855 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.845+0000 7fd3be906700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3b80bca50 0x7fd3b815fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:52.856 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.845+0000 7fd3be105700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3b8065e30 0x7fd3b8150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:52.856 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.845+0000 7fd3be105700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3b8065e30 0x7fd3b8150000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:46116/0 (socket says 172.21.15.158:46116) 2023-10-18T17:27:52.856 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.845+0000 7fd3bd904700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3b8067ff0 0x7fd3b80c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:52.856 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.845+0000 7fd3be105700 1 -- 172.21.15.158:0/2952901433 learned_addr learned my addr 172.21.15.158:0/2952901433 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:52.856 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.845+0000 7fd3be906700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3b80bca50 0x7fd3b815fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:45938/0 (socket says 172.21.15.158:45938) 2023-10-18T17:27:52.857 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.849+0000 7fd3be906700 1 -- 172.21.15.158:0/2952901433 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3b8065e30 msgr2=0x7fd3b8150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:52.857 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.849+0000 7fd3be906700 1 --2- 172.21.15.158:0/2952901433 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3b8065e30 0x7fd3b8150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:52.857 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.849+0000 7fd3be906700 1 -- 172.21.15.158:0/2952901433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3b8067ff0 msgr2=0x7fd3b80c1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:52.857 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.849+0000 7fd3be906700 1 --2- 172.21.15.158:0/2952901433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3b8067ff0 0x7fd3b80c1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:52.857 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.849+0000 7fd3be906700 1 -- 172.21.15.158:0/2952901433 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b0009a20 con 0x7fd3b80bca50 2023-10-18T17:27:52.858 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.849+0000 7fd3be906700 1 --2- 172.21.15.158:0/2952901433 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3b80bca50 0x7fd3b815fd70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fd3b80688c0 tx=0x7fd3b80bf7f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:52.858 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.849+0000 7fd3ae7fc700 1 -- 172.21.15.158:0/2952901433 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0012410 con 0x7fd3b80bca50 2023-10-18T17:27:52.858 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.849+0000 7fd3ae7fc700 1 -- 172.21.15.158:0/2952901433 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b001d630 con 0x7fd3b80bca50 2023-10-18T17:27:52.858 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.849+0000 7fd3ae7fc700 1 -- 172.21.15.158:0/2952901433 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b001d9b0 con 0x7fd3b80bca50 2023-10-18T17:27:52.858 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.849+0000 7fd3c0369700 1 -- 172.21.15.158:0/2952901433 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b81506a0 con 0x7fd3b80bca50 2023-10-18T17:27:52.859 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.849+0000 7fd3c0369700 1 -- 172.21.15.158:0/2952901433 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b814f800 con 0x7fd3b80bca50 2023-10-18T17:27:52.859 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.849+0000 7fd3c0369700 1 -- 172.21.15.158:0/2952901433 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b8150b80 con 0x7fd3b80bca50 2023-10-18T17:27:52.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.853+0000 7fd3ae7fc700 1 -- 172.21.15.158:0/2952901433 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd3b0027460 con 0x7fd3b80bca50 2023-10-18T17:27:52.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.853+0000 7fd3ae7fc700 1 --2- 172.21.15.158:0/2952901433 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fd39c05a510 0x7fd39c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:52.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.853+0000 7fd3ae7fc700 1 -- 172.21.15.158:0/2952901433 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fd3b0076890 con 0x7fd3b80bca50 2023-10-18T17:27:52.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.853+0000 7fd3be105700 1 --2- 172.21.15.158:0/2952901433 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fd39c05a510 0x7fd39c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:52.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.853+0000 7fd3be105700 1 --2- 172.21.15.158:0/2952901433 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fd39c05a510 0x7fd39c05c9d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fd3b4009c60 tx=0x7fd3b40090f0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:52.863 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:52.861+0000 7fd3ae7fc700 1 -- 172.21.15.158:0/2952901433 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fd3b0049db0 con 0x7fd3b80bca50 2023-10-18T17:27:53.062 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:53.057+0000 7fd3c0369700 1 -- 172.21.15.158:0/2952901433 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd3b806c190 con 0x7fd3b80bca50 2023-10-18T17:27:53.063 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:53.057+0000 7fd3ae7fc700 1 -- 172.21.15.158:0/2952901433 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fd3b004d3d0 con 0x7fd3b80bca50 2023-10-18T17:27:53.063 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:27:53.065 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:53.061+0000 7fd3c0369700 1 -- 172.21.15.158:0/2952901433 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fd39c05a510 msgr2=0x7fd39c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:53.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:53.061+0000 7fd3c0369700 1 --2- 172.21.15.158:0/2952901433 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fd39c05a510 0x7fd39c05c9d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fd3b4009c60 tx=0x7fd3b40090f0).stop 2023-10-18T17:27:53.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:53.061+0000 7fd3c0369700 1 -- 172.21.15.158:0/2952901433 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3b80bca50 msgr2=0x7fd3b815fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:53.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:53.061+0000 7fd3c0369700 1 --2- 172.21.15.158:0/2952901433 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3b80bca50 0x7fd3b815fd70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fd3b80688c0 tx=0x7fd3b80bf7f0).stop 2023-10-18T17:27:53.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:53.061+0000 7fd3c0369700 1 -- 172.21.15.158:0/2952901433 shutdown_connections 2023-10-18T17:27:53.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:53.061+0000 7fd3c0369700 1 --2- 172.21.15.158:0/2952901433 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fd39c05a510 0x7fd39c05c9d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:53.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:53.061+0000 7fd3c0369700 1 --2- 172.21.15.158:0/2952901433 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3b80bca50 0x7fd3b815fd70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:53.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:53.061+0000 7fd3c0369700 1 --2- 172.21.15.158:0/2952901433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3b8067ff0 0x7fd3b80c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:53.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:53.061+0000 7fd3c0369700 1 --2- 172.21.15.158:0/2952901433 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3b8065e30 0x7fd3b8150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:53.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:53.061+0000 7fd3c0369700 1 -- 172.21.15.158:0/2952901433 >> 172.21.15.158:0/2952901433 conn(0x7fd3b80620d0 msgr2=0x7fd3b814b320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:53.068 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:53.061+0000 7fd3c0369700 1 -- 172.21.15.158:0/2952901433 shutdown_connections 2023-10-18T17:27:53.068 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:53.061+0000 7fd3c0369700 1 -- 172.21.15.158:0/2952901433 wait complete. 2023-10-18T17:27:53.086 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:27:56.087 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:27:56.265 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.261+0000 7f6c87307700 1 Processor -- start 2023-10-18T17:27:56.265 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.261+0000 7f6c87307700 1 -- start start 2023-10-18T17:27:56.268 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c87307700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6c800c24d0 0x7f6c800c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:56.268 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c87307700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c80151570 0x7f6c80151a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:56.268 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c87307700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c80068fd0 con 0x7f6c80068b90 2023-10-18T17:27:56.268 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c87307700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c800bd560 con 0x7f6c800c24d0 2023-10-18T17:27:56.269 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c87307700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c80151ef0 con 0x7f6c80151570 2023-10-18T17:27:56.270 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c86305700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6c800c24d0 0x7f6c800c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:56.271 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c85b04700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f6c80068b90 0x7f6c800bcd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:55388/0 (socket says 172.21.15.158:55388) 2023-10-18T17:27:56.271 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c85b04700 1 -- 172.21.15.158:0/4185434218 learned_addr learned my addr 172.21.15.158:0/4185434218 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:27:56.271 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c86b06700 1 --2- 172.21.15.158:0/4185434218 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c80151570 0x7f6c80151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:56.271 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c86305700 1 -- 172.21.15.158:0/4185434218 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c80151570 msgr2=0x7f6c80151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:27:56.272 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c86305700 1 --2- 172.21.15.158:0/4185434218 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c80151570 0x7f6c80151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:56.272 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c86305700 1 -- 172.21.15.158:0/4185434218 >> v1:172.21.15.183:6789/0 conn(0x7f6c80068b90 legacy=0x7f6c800bcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:56.272 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c86305700 1 -- 172.21.15.158:0/4185434218 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c80153660 con 0x7f6c800c24d0 2023-10-18T17:27:56.272 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c85303700 1 -- 172.21.15.158:0/4185434218 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4179904008 0 0) 0x7f6c70001110 con 0x7f6c80068b90 2023-10-18T17:27:56.272 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c86305700 1 --2- 172.21.15.158:0/4185434218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c800c24d0 0x7f6c800c28b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f6c7c009760 tx=0x7f6c7c009060).ready entity=mon.1 client_cookie=ffa479218f8b4231 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:56.273 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c85303700 1 -- 172.21.15.158:0/4185434218 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00b610 con 0x7f6c800c24d0 2023-10-18T17:27:56.273 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c85303700 1 -- 172.21.15.158:0/4185434218 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c00b770 con 0x7f6c800c24d0 2023-10-18T17:27:56.273 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c85303700 1 -- 172.21.15.158:0/4185434218 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00baf0 con 0x7f6c800c24d0 2023-10-18T17:27:56.273 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c87307700 1 -- 172.21.15.158:0/4185434218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c800c24d0 msgr2=0x7f6c800c28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:56.273 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c87307700 1 --2- 172.21.15.158:0/4185434218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c800c24d0 0x7f6c800c28b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f6c7c009760 tx=0x7f6c7c009060).stop 2023-10-18T17:27:56.274 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c87307700 1 -- 172.21.15.158:0/4185434218 shutdown_connections 2023-10-18T17:27:56.274 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c87307700 1 --2- 172.21.15.158:0/4185434218 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c80151570 0x7f6c80151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:56.274 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c87307700 1 --2- 172.21.15.158:0/4185434218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c800c24d0 0x7f6c800c28b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:56.274 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c87307700 1 -- 172.21.15.158:0/4185434218 >> 172.21.15.158:0/4185434218 conn(0x7f6c8005dc20 msgr2=0x7f6c80065d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:56.274 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c87307700 1 -- 172.21.15.158:0/4185434218 shutdown_connections 2023-10-18T17:27:56.274 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.265+0000 7f6c87307700 1 -- 172.21.15.158:0/4185434218 wait complete. 2023-10-18T17:27:56.276 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c87307700 1 Processor -- start 2023-10-18T17:27:56.276 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c87307700 1 -- start start 2023-10-18T17:27:56.277 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c87307700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c80068b90 0x7f6c80150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:56.277 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c87307700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c800c24d0 0x7f6c8015ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:56.277 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c87307700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c80151570 0x7f6c8015e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:56.277 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c87307700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8015e7d0 con 0x7f6c80068b90 2023-10-18T17:27:56.277 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c87307700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c80161fc0 con 0x7f6c800c24d0 2023-10-18T17:27:56.278 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c87307700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c801622a0 con 0x7f6c80151570 2023-10-18T17:27:56.278 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c86305700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c80068b90 0x7f6c80150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:56.278 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c86b06700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c80151570 0x7f6c8015e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:56.278 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c86b06700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c80151570 0x7f6c8015e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:46126/0 (socket says 172.21.15.158:46126) 2023-10-18T17:27:56.278 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c85b04700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c800c24d0 0x7f6c8015ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:56.279 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c86305700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c80068b90 0x7f6c80150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:45950/0 (socket says 172.21.15.158:45950) 2023-10-18T17:27:56.279 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c86b06700 1 -- 172.21.15.158:0/1564059130 learned_addr learned my addr 172.21.15.158:0/1564059130 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:56.279 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c86b06700 1 -- 172.21.15.158:0/1564059130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c800c24d0 msgr2=0x7f6c8015ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:56.279 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c86b06700 1 --2- 172.21.15.158:0/1564059130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c800c24d0 0x7f6c8015ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:56.280 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c86b06700 1 -- 172.21.15.158:0/1564059130 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c80068b90 msgr2=0x7f6c80150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:56.280 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c86b06700 1 --2- 172.21.15.158:0/1564059130 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c80068b90 0x7f6c80150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:56.280 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c86b06700 1 -- 172.21.15.158:0/1564059130 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0092a0 con 0x7f6c80151570 2023-10-18T17:27:56.280 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.269+0000 7f6c86305700 1 --2- 172.21.15.158:0/1564059130 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c80068b90 0x7f6c80150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:27:56.280 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.273+0000 7f6c86b06700 1 --2- 172.21.15.158:0/1564059130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c80151570 0x7f6c8015e2e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f6c78007f50 tx=0x7f6c78009860).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:56.281 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.273+0000 7f6c767fc700 1 -- 172.21.15.158:0/1564059130 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7800eb70 con 0x7f6c80151570 2023-10-18T17:27:56.281 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.273+0000 7f6c767fc700 1 -- 172.21.15.158:0/1564059130 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7800ecd0 con 0x7f6c80151570 2023-10-18T17:27:56.281 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.273+0000 7f6c767fc700 1 -- 172.21.15.158:0/1564059130 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c78014610 con 0x7f6c80151570 2023-10-18T17:27:56.281 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.273+0000 7f6c87307700 1 -- 172.21.15.158:0/1564059130 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c80162580 con 0x7f6c80151570 2023-10-18T17:27:56.282 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.273+0000 7f6c87307700 1 -- 172.21.15.158:0/1564059130 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c80162b40 con 0x7f6c80151570 2023-10-18T17:27:56.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.273+0000 7f6c87307700 1 -- 172.21.15.158:0/1564059130 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c80046f00 con 0x7f6c80151570 2023-10-18T17:27:56.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.273+0000 7f6c767fc700 1 -- 172.21.15.158:0/1564059130 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6c78014980 con 0x7f6c80151570 2023-10-18T17:27:56.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.277+0000 7f6c767fc700 1 --2- 172.21.15.158:0/1564059130 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6c6405a510 0x7f6c6405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:56.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.277+0000 7f6c767fc700 1 -- 172.21.15.158:0/1564059130 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f6c78074ea0 con 0x7f6c80151570 2023-10-18T17:27:56.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.277+0000 7f6c86305700 1 --2- 172.21.15.158:0/1564059130 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6c6405a510 0x7f6c6405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:56.284 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.277+0000 7f6c86305700 1 --2- 172.21.15.158:0/1564059130 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6c6405a510 0x7f6c6405c9d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f6c7c00b3d0 tx=0x7f6c7c017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:56.287 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.281+0000 7f6c767fc700 1 -- 172.21.15.158:0/1564059130 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f6c78048360 con 0x7f6c80151570 2023-10-18T17:27:56.484 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.481+0000 7f6c87307700 1 -- 172.21.15.158:0/1564059130 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6c80153940 con 0x7f6c80151570 2023-10-18T17:27:56.484 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.481+0000 7f6c767fc700 1 -- 172.21.15.158:0/1564059130 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f6c7804b980 con 0x7f6c80151570 2023-10-18T17:27:56.485 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:27:56.488 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.481+0000 7f6c87307700 1 -- 172.21.15.158:0/1564059130 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6c6405a510 msgr2=0x7f6c6405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:56.488 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.481+0000 7f6c87307700 1 --2- 172.21.15.158:0/1564059130 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6c6405a510 0x7f6c6405c9d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f6c7c00b3d0 tx=0x7f6c7c017000).stop 2023-10-18T17:27:56.488 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.485+0000 7f6c87307700 1 -- 172.21.15.158:0/1564059130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c80151570 msgr2=0x7f6c8015e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:56.488 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.485+0000 7f6c87307700 1 --2- 172.21.15.158:0/1564059130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c80151570 0x7f6c8015e2e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f6c78007f50 tx=0x7f6c78009860).stop 2023-10-18T17:27:56.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.485+0000 7f6c87307700 1 -- 172.21.15.158:0/1564059130 shutdown_connections 2023-10-18T17:27:56.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.485+0000 7f6c87307700 1 --2- 172.21.15.158:0/1564059130 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6c6405a510 0x7f6c6405c9d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:56.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.485+0000 7f6c87307700 1 --2- 172.21.15.158:0/1564059130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c80151570 0x7f6c8015e2e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:56.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.485+0000 7f6c87307700 1 --2- 172.21.15.158:0/1564059130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c800c24d0 0x7f6c8015ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:56.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.485+0000 7f6c87307700 1 --2- 172.21.15.158:0/1564059130 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c80068b90 0x7f6c80150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:56.490 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.485+0000 7f6c87307700 1 -- 172.21.15.158:0/1564059130 >> 172.21.15.158:0/1564059130 conn(0x7f6c8005dc20 msgr2=0x7f6c800b4550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:56.490 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.485+0000 7f6c87307700 1 -- 172.21.15.158:0/1564059130 shutdown_connections 2023-10-18T17:27:56.490 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:56.485+0000 7f6c87307700 1 -- 172.21.15.158:0/1564059130 wait complete. 2023-10-18T17:27:56.505 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:27:58.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~172s 2023-10-18T17:27:58.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~226s 2023-10-18T17:27:58.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~152s 2023-10-18T17:27:58.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~139s 2023-10-18T17:27:58.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~185s 2023-10-18T17:27:58.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~126s 2023-10-18T17:27:59.506 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:27:59.656 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.653+0000 7f26fdce4700 1 Processor -- start 2023-10-18T17:27:59.656 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.653+0000 7f26fdce4700 1 -- start start 2023-10-18T17:27:59.658 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.653+0000 7f26fdce4700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26f8063040 0x7f26f8063490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:59.658 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.653+0000 7f26fdce4700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f80c7150 con 0x7f26f8065ae0 2023-10-18T17:27:59.659 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.653+0000 7f26fdce4700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f8150b60 con 0x7f26f8065700 2023-10-18T17:27:59.659 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.653+0000 7f26fdce4700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f8068530 con 0x7f26f8063040 2023-10-18T17:27:59.659 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.653+0000 7f26fd4e3700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26f8063040 0x7f26f8063490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:59.659 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.653+0000 7f26fcce2700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f26f8065700 0x7f26f8067d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:37764/0 (socket says 172.21.15.158:37764) 2023-10-18T17:27:59.659 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.653+0000 7f26fcce2700 1 -- 172.21.15.158:0/1124856699 learned_addr learned my addr 172.21.15.158:0/1124856699 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:27:59.661 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.653+0000 7f26fd4e3700 1 -- 172.21.15.158:0/1124856699 >> v1:172.21.15.183:6789/0 conn(0x7f26f8065700 legacy=0x7f26f8067d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:59.661 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.653+0000 7f26fd4e3700 1 -- 172.21.15.158:0/1124856699 >> v1:172.21.15.158:6789/0 conn(0x7f26f8065ae0 legacy=0x7f26f80c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:59.661 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.653+0000 7f26fd4e3700 1 -- 172.21.15.158:0/1124856699 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f8068810 con 0x7f26f8063040 2023-10-18T17:27:59.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.653+0000 7f26fd4e3700 1 --2- 172.21.15.158:0/1124856699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26f8063040 0x7f26f8063490 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f26f0009e90 tx=0x7f26f0009780).ready entity=mon.2 client_cookie=c90e907c9228d836 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:59.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.657+0000 7f26f77fe700 1 -- 172.21.15.158:0/1124856699 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f000e070 con 0x7f26f8063040 2023-10-18T17:27:59.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.657+0000 7f26f77fe700 1 -- 172.21.15.158:0/1124856699 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f000bc90 con 0x7f26f8063040 2023-10-18T17:27:59.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.657+0000 7f26f77fe700 1 -- 172.21.15.158:0/1124856699 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0012620 con 0x7f26f8063040 2023-10-18T17:27:59.662 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.657+0000 7f26fdce4700 1 -- 172.21.15.158:0/1124856699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26f8063040 msgr2=0x7f26f8063490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:59.663 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.657+0000 7f26fdce4700 1 --2- 172.21.15.158:0/1124856699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26f8063040 0x7f26f8063490 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f26f0009e90 tx=0x7f26f0009780).stop 2023-10-18T17:27:59.663 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.657+0000 7f26fdce4700 1 -- 172.21.15.158:0/1124856699 shutdown_connections 2023-10-18T17:27:59.663 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.657+0000 7f26fdce4700 1 --2- 172.21.15.158:0/1124856699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26f8063040 0x7f26f8063490 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:59.663 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.657+0000 7f26fdce4700 1 -- 172.21.15.158:0/1124856699 >> 172.21.15.158:0/1124856699 conn(0x7f26f8062ba0 msgr2=0x7f26f80c6330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:59.663 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.657+0000 7f26fdce4700 1 -- 172.21.15.158:0/1124856699 shutdown_connections 2023-10-18T17:27:59.664 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.657+0000 7f26fdce4700 1 -- 172.21.15.158:0/1124856699 wait complete. 2023-10-18T17:27:59.664 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26fdce4700 1 Processor -- start 2023-10-18T17:27:59.664 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26fdce4700 1 -- start start 2023-10-18T17:27:59.665 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26fdce4700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26f8063040 0x7f26f8152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:59.666 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26fdce4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26f8065700 0x7f26f814b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:59.666 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26fdce4700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26f8065ae0 0x7f26f814cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:59.666 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26fdce4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f814ab90 con 0x7f26f8065700 2023-10-18T17:27:59.666 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26fdce4700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f8161370 con 0x7f26f8065ae0 2023-10-18T17:27:59.667 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26fdce4700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f8161640 con 0x7f26f8063040 2023-10-18T17:27:59.668 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26f7fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26f8065700 0x7f26f814b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:59.668 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26fcce2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26f8063040 0x7f26f8152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:59.669 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26f7fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26f8065700 0x7f26f814b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:43136/0 (socket says 172.21.15.158:43136) 2023-10-18T17:27:59.669 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26f7fff700 1 -- 172.21.15.158:0/1467009651 learned_addr learned my addr 172.21.15.158:0/1467009651 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:27:59.669 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26fd4e3700 1 --2- 172.21.15.158:0/1467009651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26f8065ae0 0x7f26f814cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:59.669 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26fcce2700 1 -- 172.21.15.158:0/1467009651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26f8065ae0 msgr2=0x7f26f814cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:59.669 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26fcce2700 1 --2- 172.21.15.158:0/1467009651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26f8065ae0 0x7f26f814cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:59.670 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26fcce2700 1 -- 172.21.15.158:0/1467009651 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26f8065700 msgr2=0x7f26f814b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:59.670 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26fcce2700 1 --2- 172.21.15.158:0/1467009651 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26f8065700 0x7f26f814b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:59.670 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26fcce2700 1 -- 172.21.15.158:0/1467009651 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f0009a20 con 0x7f26f8063040 2023-10-18T17:27:59.670 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26f7fff700 1 --2- 172.21.15.158:0/1467009651 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26f8065700 0x7f26f814b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:27:59.670 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.661+0000 7f26fcce2700 1 --2- 172.21.15.158:0/1467009651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26f8063040 0x7f26f8152b90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f26ec00c410 tx=0x7f26ec007d30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:59.671 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.665+0000 7f26f4ff9700 1 -- 172.21.15.158:0/1467009651 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec0070d0 con 0x7f26f8063040 2023-10-18T17:27:59.671 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.665+0000 7f26f4ff9700 1 -- 172.21.15.158:0/1467009651 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ec007230 con 0x7f26f8063040 2023-10-18T17:27:59.671 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.665+0000 7f26fdce4700 1 -- 172.21.15.158:0/1467009651 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f814a540 con 0x7f26f8063040 2023-10-18T17:27:59.671 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.665+0000 7f26f4ff9700 1 -- 172.21.15.158:0/1467009651 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec0075b0 con 0x7f26f8063040 2023-10-18T17:27:59.671 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.665+0000 7f26fdce4700 1 -- 172.21.15.158:0/1467009651 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f80c45d0 con 0x7f26f8063040 2023-10-18T17:27:59.672 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.665+0000 7f26fdce4700 1 -- 172.21.15.158:0/1467009651 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f814a3a0 con 0x7f26f8063040 2023-10-18T17:27:59.672 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.665+0000 7f26f4ff9700 1 -- 172.21.15.158:0/1467009651 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f26ec0059b0 con 0x7f26f8063040 2023-10-18T17:27:59.673 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.669+0000 7f26f4ff9700 1 --2- 172.21.15.158:0/1467009651 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f26dc05a510 0x7f26dc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:27:59.673 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.669+0000 7f26f4ff9700 1 -- 172.21.15.158:0/1467009651 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f26ec073d40 con 0x7f26f8063040 2023-10-18T17:27:59.673 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.669+0000 7f26f7fff700 1 --2- 172.21.15.158:0/1467009651 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f26dc05a510 0x7f26dc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:27:59.674 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.669+0000 7f26f7fff700 1 --2- 172.21.15.158:0/1467009651 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f26dc05a510 0x7f26dc05c9d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f26f8156d10 tx=0x7f26e4009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:27:59.682 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.677+0000 7f26f4ff9700 1 -- 172.21.15.158:0/1467009651 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f26f814a3a0 con 0x7f26f8063040 2023-10-18T17:27:59.874 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.869+0000 7f26fdce4700 1 -- 172.21.15.158:0/1467009651 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f26f814a3a0 con 0x7f26f8063040 2023-10-18T17:27:59.875 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.869+0000 7f26f4ff9700 1 -- 172.21.15.158:0/1467009651 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f26f814a3a0 con 0x7f26f8063040 2023-10-18T17:27:59.876 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:27:59.879 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.873+0000 7f26fdce4700 1 -- 172.21.15.158:0/1467009651 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f26dc05a510 msgr2=0x7f26dc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:59.879 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.873+0000 7f26fdce4700 1 --2- 172.21.15.158:0/1467009651 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f26dc05a510 0x7f26dc05c9d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f26f8156d10 tx=0x7f26e4009040).stop 2023-10-18T17:27:59.881 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.873+0000 7f26fdce4700 1 -- 172.21.15.158:0/1467009651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26f8063040 msgr2=0x7f26f8152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:27:59.882 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.877+0000 7f26fdce4700 1 --2- 172.21.15.158:0/1467009651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26f8063040 0x7f26f8152b90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f26ec00c410 tx=0x7f26ec007d30).stop 2023-10-18T17:27:59.882 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.877+0000 7f26fdce4700 1 -- 172.21.15.158:0/1467009651 shutdown_connections 2023-10-18T17:27:59.882 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.877+0000 7f26fdce4700 1 --2- 172.21.15.158:0/1467009651 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f26dc05a510 0x7f26dc05c9d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:59.882 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.877+0000 7f26fdce4700 1 --2- 172.21.15.158:0/1467009651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26f8065ae0 0x7f26f814cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:59.882 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.877+0000 7f26fdce4700 1 --2- 172.21.15.158:0/1467009651 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f26f8065700 0x7f26f814b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:59.883 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.877+0000 7f26fdce4700 1 --2- 172.21.15.158:0/1467009651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26f8063040 0x7f26f8152b90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:27:59.883 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.877+0000 7f26fdce4700 1 -- 172.21.15.158:0/1467009651 >> 172.21.15.158:0/1467009651 conn(0x7f26f8062ba0 msgr2=0x7f26f80c4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:27:59.884 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.877+0000 7f26fdce4700 1 -- 172.21.15.158:0/1467009651 shutdown_connections 2023-10-18T17:27:59.884 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:27:59.877+0000 7f26fdce4700 1 -- 172.21.15.158:0/1467009651 wait complete. 2023-10-18T17:27:59.900 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:28:02.901 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:28:03.061 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.057+0000 7fb68ac79700 1 Processor -- start 2023-10-18T17:28:03.062 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.057+0000 7fb68ac79700 1 -- start start 2023-10-18T17:28:03.063 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.057+0000 7fb68ac79700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb6841513e0 0x7fb684067d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:03.063 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.057+0000 7fb68ac79700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb6841517c0 0x7fb68406a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:03.063 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.057+0000 7fb68ac79700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb684154b00 con 0x7fb6840630e0 2023-10-18T17:28:03.063 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.057+0000 7fb68ac79700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb684069380 con 0x7fb6841513e0 2023-10-18T17:28:03.064 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.057+0000 7fb68ac79700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb684154f90 con 0x7fb6841517c0 2023-10-18T17:28:03.065 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb689c77700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb6841513e0 0x7fb684067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:03.065 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb68a478700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fb6840630e0 0x7fb684065700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:37768/0 (socket says 172.21.15.158:37768) 2023-10-18T17:28:03.065 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb68a478700 1 -- 172.21.15.158:0/2682878004 learned_addr learned my addr 172.21.15.158:0/2682878004 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:28:03.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb689476700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb6841517c0 0x7fb68406a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:03.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb688c75700 1 -- 172.21.15.158:0/2682878004 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2207172559 0 0) 0x7fb684154b00 con 0x7fb6840630e0 2023-10-18T17:28:03.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb688c75700 1 -- 172.21.15.158:0/2682878004 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6700033f0 con 0x7fb6840630e0 2023-10-18T17:28:03.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb689c77700 1 -- 172.21.15.158:0/2682878004 >> v2:172.21.15.183:3300/0 conn(0x7fb6841517c0 msgr2=0x7fb68406a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:28:03.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb689c77700 1 --2- 172.21.15.158:0/2682878004 >> v2:172.21.15.183:3300/0 conn(0x7fb6841517c0 0x7fb68406a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:03.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb689c77700 1 -- 172.21.15.158:0/2682878004 >> v1:172.21.15.183:6789/0 conn(0x7fb6840630e0 legacy=0x7fb684065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:03.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb689c77700 1 -- 172.21.15.158:0/2682878004 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb684068570 con 0x7fb6841513e0 2023-10-18T17:28:03.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb689c77700 1 --2- 172.21.15.158:0/2682878004 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6841513e0 0x7fb684067d30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fb6840c3030 tx=0x7fb680009060).ready entity=mon.0 client_cookie=a06bcdcc897bd45b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:03.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb688c75700 1 -- 172.21.15.158:0/2682878004 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68000f510 con 0x7fb6841513e0 2023-10-18T17:28:03.068 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb688c75700 1 -- 172.21.15.158:0/2682878004 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68000f670 con 0x7fb6841513e0 2023-10-18T17:28:03.068 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb688c75700 1 -- 172.21.15.158:0/2682878004 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68000f9f0 con 0x7fb6841513e0 2023-10-18T17:28:03.069 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb68ac79700 1 -- 172.21.15.158:0/2682878004 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6841513e0 msgr2=0x7fb684067d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:03.069 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb68ac79700 1 --2- 172.21.15.158:0/2682878004 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6841513e0 0x7fb684067d30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fb6840c3030 tx=0x7fb680009060).stop 2023-10-18T17:28:03.069 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb68ac79700 1 -- 172.21.15.158:0/2682878004 shutdown_connections 2023-10-18T17:28:03.070 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb68ac79700 1 --2- 172.21.15.158:0/2682878004 >> v2:172.21.15.183:3300/0 conn(0x7fb6841517c0 0x7fb68406a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:03.070 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb68ac79700 1 --2- 172.21.15.158:0/2682878004 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6841513e0 0x7fb684067d30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:03.071 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb68ac79700 1 -- 172.21.15.158:0/2682878004 >> 172.21.15.158:0/2682878004 conn(0x7fb684062ba0 msgr2=0x7fb6840c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:03.071 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb68ac79700 1 -- 172.21.15.158:0/2682878004 shutdown_connections 2023-10-18T17:28:03.071 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.061+0000 7fb68ac79700 1 -- 172.21.15.158:0/2682878004 wait complete. 2023-10-18T17:28:03.071 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.065+0000 7fb68ac79700 1 Processor -- start 2023-10-18T17:28:03.071 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.065+0000 7fb68ac79700 1 -- start start 2023-10-18T17:28:03.074 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.065+0000 7fb68ac79700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6840630e0 0x7fb6840b99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:03.074 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.065+0000 7fb68ac79700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6841513e0 0x7fb6841683d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:03.074 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.065+0000 7fb68ac79700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6841517c0 0x7fb684158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:03.075 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.065+0000 7fb68ac79700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840c2a60 con 0x7fb6841517c0 2023-10-18T17:28:03.075 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.065+0000 7fb68ac79700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840b9ed0 con 0x7fb6841513e0 2023-10-18T17:28:03.075 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.065+0000 7fb68ac79700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840c1a30 con 0x7fb6840630e0 2023-10-18T17:28:03.075 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.065+0000 7fb689c77700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6840630e0 0x7fb6840b99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:03.075 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.065+0000 7fb689476700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6841513e0 0x7fb6841683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:03.076 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.069+0000 7fb689476700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6841513e0 0x7fb6841683d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:50642/0 (socket says 172.21.15.158:50642) 2023-10-18T17:28:03.076 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.069+0000 7fb689476700 1 -- 172.21.15.158:0/2338085086 learned_addr learned my addr 172.21.15.158:0/2338085086 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:03.076 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.069+0000 7fb68a478700 1 --2- 172.21.15.158:0/2338085086 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6841517c0 0x7fb684158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:03.076 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.069+0000 7fb689476700 1 -- 172.21.15.158:0/2338085086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6840630e0 msgr2=0x7fb6840b99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:03.076 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.069+0000 7fb689476700 1 --2- 172.21.15.158:0/2338085086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6840630e0 0x7fb6840b99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:03.077 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.069+0000 7fb689476700 1 -- 172.21.15.158:0/2338085086 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6841517c0 msgr2=0x7fb684158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:03.077 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.069+0000 7fb689476700 1 --2- 172.21.15.158:0/2338085086 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6841517c0 0x7fb684158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:03.077 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.069+0000 7fb689476700 1 -- 172.21.15.158:0/2338085086 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6800092a0 con 0x7fb6841513e0 2023-10-18T17:28:03.077 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.069+0000 7fb689476700 1 --2- 172.21.15.158:0/2338085086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6841513e0 0x7fb6841683d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fb67400e930 tx=0x7fb674009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:03.077 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.069+0000 7fb679ffb700 1 -- 172.21.15.158:0/2338085086 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb674012600 con 0x7fb6841513e0 2023-10-18T17:28:03.078 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.069+0000 7fb679ffb700 1 -- 172.21.15.158:0/2338085086 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb674012760 con 0x7fb6841513e0 2023-10-18T17:28:03.078 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.069+0000 7fb679ffb700 1 -- 172.21.15.158:0/2338085086 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb674012ae0 con 0x7fb6841513e0 2023-10-18T17:28:03.078 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.069+0000 7fb68ac79700 1 -- 172.21.15.158:0/2338085086 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6841688c0 con 0x7fb6841513e0 2023-10-18T17:28:03.078 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.069+0000 7fb68ac79700 1 -- 172.21.15.158:0/2338085086 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6840c1100 con 0x7fb6841513e0 2023-10-18T17:28:03.079 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.069+0000 7fb68ac79700 1 -- 172.21.15.158:0/2338085086 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb684046f00 con 0x7fb6841513e0 2023-10-18T17:28:03.079 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.073+0000 7fb679ffb700 1 -- 172.21.15.158:0/2338085086 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb67401b400 con 0x7fb6841513e0 2023-10-18T17:28:03.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.073+0000 7fb679ffb700 1 --2- 172.21.15.158:0/2338085086 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb66805a510 0x7fb66805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:03.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.073+0000 7fb679ffb700 1 -- 172.21.15.158:0/2338085086 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fb674074e10 con 0x7fb6841513e0 2023-10-18T17:28:03.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.073+0000 7fb689c77700 1 --2- 172.21.15.158:0/2338085086 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb66805a510 0x7fb66805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:03.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.073+0000 7fb689c77700 1 --2- 172.21.15.158:0/2338085086 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb66805a510 0x7fb66805c9d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fb6840c3030 tx=0x7fb680017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:03.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.085+0000 7fb679ffb700 1 -- 172.21.15.158:0/2338085086 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fb674078030 con 0x7fb6841513e0 2023-10-18T17:28:03.284 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.281+0000 7fb68ac79700 1 -- 172.21.15.158:0/2338085086 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb6841541d0 con 0x7fb6841513e0 2023-10-18T17:28:03.285 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.281+0000 7fb679ffb700 1 -- 172.21.15.158:0/2338085086 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fb674048270 con 0x7fb6841513e0 2023-10-18T17:28:03.286 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:28:03.288 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.285+0000 7fb68ac79700 1 -- 172.21.15.158:0/2338085086 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb66805a510 msgr2=0x7fb66805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:03.289 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.285+0000 7fb68ac79700 1 --2- 172.21.15.158:0/2338085086 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb66805a510 0x7fb66805c9d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fb6840c3030 tx=0x7fb680017000).stop 2023-10-18T17:28:03.289 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.285+0000 7fb68ac79700 1 -- 172.21.15.158:0/2338085086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6841513e0 msgr2=0x7fb6841683d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:03.289 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.285+0000 7fb68ac79700 1 --2- 172.21.15.158:0/2338085086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6841513e0 0x7fb6841683d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fb67400e930 tx=0x7fb674009060).stop 2023-10-18T17:28:03.289 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.285+0000 7fb68ac79700 1 -- 172.21.15.158:0/2338085086 shutdown_connections 2023-10-18T17:28:03.289 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.285+0000 7fb68ac79700 1 --2- 172.21.15.158:0/2338085086 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb66805a510 0x7fb66805c9d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:03.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.285+0000 7fb68ac79700 1 --2- 172.21.15.158:0/2338085086 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6841517c0 0x7fb684158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:03.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.285+0000 7fb68ac79700 1 --2- 172.21.15.158:0/2338085086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6841513e0 0x7fb6841683d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:03.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.285+0000 7fb68ac79700 1 --2- 172.21.15.158:0/2338085086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6840630e0 0x7fb6840b99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:03.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.285+0000 7fb68ac79700 1 -- 172.21.15.158:0/2338085086 >> 172.21.15.158:0/2338085086 conn(0x7fb684062ba0 msgr2=0x7fb684150630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:03.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.285+0000 7fb68ac79700 1 -- 172.21.15.158:0/2338085086 shutdown_connections 2023-10-18T17:28:03.291 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:03.285+0000 7fb68ac79700 1 -- 172.21.15.158:0/2338085086 wait complete. 2023-10-18T17:28:03.307 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:28:04.377 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:28:04.386 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:28:04.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~178s 2023-10-18T17:28:04.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~233s 2023-10-18T17:28:04.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~158s 2023-10-18T17:28:04.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~145s 2023-10-18T17:28:04.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~192s 2023-10-18T17:28:04.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~133s 2023-10-18T17:28:06.309 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:28:06.475 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.469+0000 7f3f7e9f9700 1 Processor -- start 2023-10-18T17:28:06.475 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.469+0000 7f3f7e9f9700 1 -- start start 2023-10-18T17:28:06.477 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.473+0000 7f3f7e9f9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3f780be300 0x7f3f780bc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:06.477 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.473+0000 7f3f7e9f9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f780686b0 0x7f3f78068af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:06.477 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.473+0000 7f3f7e9f9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f780bd1a0 con 0x7f3f780bdf20 2023-10-18T17:28:06.478 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.473+0000 7f3f7e9f9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f78069e70 con 0x7f3f780be300 2023-10-18T17:28:06.478 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.473+0000 7f3f7e9f9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f780bd480 con 0x7f3f780686b0 2023-10-18T17:28:06.479 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.473+0000 7f3f7e1f8700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f780686b0 0x7f3f78068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:06.479 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.473+0000 7f3f7d9f7700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f3f780bdf20 0x7f3f780c2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:37782/0 (socket says 172.21.15.158:37782) 2023-10-18T17:28:06.480 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.473+0000 7f3f7d9f7700 1 -- 172.21.15.158:0/3517936456 learned_addr learned my addr 172.21.15.158:0/3517936456 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:28:06.480 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.473+0000 7f3f7d1f6700 1 --2- 172.21.15.158:0/3517936456 >> v2:172.21.15.183:3300/0 conn(0x7f3f780be300 0x7f3f780bc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:06.480 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.473+0000 7f3f7c9f5700 1 -- 172.21.15.158:0/3517936456 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526881672 0 0) 0x7f3f780bd1a0 con 0x7f3f780bdf20 2023-10-18T17:28:06.480 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.473+0000 7f3f7c9f5700 1 -- 172.21.15.158:0/3517936456 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f640033f0 con 0x7f3f780bdf20 2023-10-18T17:28:06.480 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.473+0000 7f3f7e1f8700 1 -- 172.21.15.158:0/3517936456 >> v2:172.21.15.183:3300/0 conn(0x7f3f780be300 msgr2=0x7f3f780bc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:28:06.481 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.473+0000 7f3f7e1f8700 1 --2- 172.21.15.158:0/3517936456 >> v2:172.21.15.183:3300/0 conn(0x7f3f780be300 0x7f3f780bc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:06.481 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.473+0000 7f3f7e1f8700 1 -- 172.21.15.158:0/3517936456 >> v1:172.21.15.183:6789/0 conn(0x7f3f780bdf20 legacy=0x7f3f780c2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:06.481 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.473+0000 7f3f7e1f8700 1 -- 172.21.15.158:0/3517936456 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f780bd760 con 0x7f3f780686b0 2023-10-18T17:28:06.481 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.473+0000 7f3f7e1f8700 1 --2- 172.21.15.158:0/3517936456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f780686b0 0x7f3f78068af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f3f70009e60 tx=0x7f3f70009780).ready entity=mon.2 client_cookie=5523353d206cf88f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:06.481 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.473+0000 7f3f7c9f5700 1 -- 172.21.15.158:0/3517936456 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7000e070 con 0x7f3f780686b0 2023-10-18T17:28:06.482 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.473+0000 7f3f7c9f5700 1 -- 172.21.15.158:0/3517936456 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7000bab0 con 0x7f3f780686b0 2023-10-18T17:28:06.482 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.473+0000 7f3f7c9f5700 1 -- 172.21.15.158:0/3517936456 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7000be30 con 0x7f3f780686b0 2023-10-18T17:28:06.483 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.477+0000 7f3f7e9f9700 1 -- 172.21.15.158:0/3517936456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f780686b0 msgr2=0x7f3f78068af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:06.483 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.477+0000 7f3f7e9f9700 1 --2- 172.21.15.158:0/3517936456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f780686b0 0x7f3f78068af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f3f70009e60 tx=0x7f3f70009780).stop 2023-10-18T17:28:06.483 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.477+0000 7f3f7e9f9700 1 -- 172.21.15.158:0/3517936456 shutdown_connections 2023-10-18T17:28:06.483 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.477+0000 7f3f7e9f9700 1 --2- 172.21.15.158:0/3517936456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f780686b0 0x7f3f78068af0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:06.484 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.477+0000 7f3f7e9f9700 1 --2- 172.21.15.158:0/3517936456 >> v2:172.21.15.183:3300/0 conn(0x7f3f780be300 0x7f3f780bc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:06.484 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.477+0000 7f3f7e9f9700 1 -- 172.21.15.158:0/3517936456 >> 172.21.15.158:0/3517936456 conn(0x7f3f78062ba0 msgr2=0x7f3f780c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:06.484 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.477+0000 7f3f7e9f9700 1 -- 172.21.15.158:0/3517936456 shutdown_connections 2023-10-18T17:28:06.484 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.477+0000 7f3f7e9f9700 1 -- 172.21.15.158:0/3517936456 wait complete. 2023-10-18T17:28:06.484 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.477+0000 7f3f7e9f9700 1 Processor -- start 2023-10-18T17:28:06.486 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7e9f9700 1 -- start start 2023-10-18T17:28:06.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7e9f9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3f780686b0 0x7f3f780c0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:06.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7e9f9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f780bdf20 0x7f3f781613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:06.490 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7e9f9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f780be300 0x7f3f780657d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:06.490 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7e9f9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f780a5cb0 con 0x7f3f780686b0 2023-10-18T17:28:06.490 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7e9f9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f78160f40 con 0x7f3f780be300 2023-10-18T17:28:06.490 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7e9f9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7815dba0 con 0x7f3f780bdf20 2023-10-18T17:28:06.490 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7d9f7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3f780686b0 0x7f3f780c0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:06.491 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7d1f6700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f780bdf20 0x7f3f781613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:06.491 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7e1f8700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f780be300 0x7f3f780657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:06.491 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7d9f7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3f780686b0 0x7f3f780c0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:43162/0 (socket says 172.21.15.158:43162) 2023-10-18T17:28:06.492 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7d1f6700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f780bdf20 0x7f3f781613d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:42530/0 (socket says 172.21.15.158:42530) 2023-10-18T17:28:06.492 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7d9f7700 1 -- 172.21.15.158:0/2593834223 learned_addr learned my addr 172.21.15.158:0/2593834223 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:06.494 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7d1f6700 1 -- 172.21.15.158:0/2593834223 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f780be300 msgr2=0x7f3f780657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:06.494 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7d1f6700 1 --2- 172.21.15.158:0/2593834223 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f780be300 0x7f3f780657d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:06.494 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7d1f6700 1 -- 172.21.15.158:0/2593834223 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3f780686b0 msgr2=0x7f3f780c0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:06.494 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7d1f6700 1 --2- 172.21.15.158:0/2593834223 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3f780686b0 0x7f3f780c0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:06.494 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7d1f6700 1 -- 172.21.15.158:0/2593834223 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f70009a20 con 0x7f3f780bdf20 2023-10-18T17:28:06.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7e1f8700 1 --2- 172.21.15.158:0/2593834223 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f780be300 0x7f3f780657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:28:06.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7d9f7700 1 --2- 172.21.15.158:0/2593834223 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3f780686b0 0x7f3f780c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:28:06.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f7d1f6700 1 --2- 172.21.15.158:0/2593834223 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f780bdf20 0x7f3f781613d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f3f6800e720 tx=0x7f3f68009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:06.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.481+0000 7f3f6dffb700 1 -- 172.21.15.158:0/2593834223 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68012600 con 0x7f3f780bdf20 2023-10-18T17:28:06.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.485+0000 7f3f6dffb700 1 -- 172.21.15.158:0/2593834223 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f68012760 con 0x7f3f780bdf20 2023-10-18T17:28:06.496 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.485+0000 7f3f6dffb700 1 -- 172.21.15.158:0/2593834223 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68012ae0 con 0x7f3f780bdf20 2023-10-18T17:28:06.496 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.485+0000 7f3f7e9f9700 1 -- 172.21.15.158:0/2593834223 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f7815de80 con 0x7f3f780bdf20 2023-10-18T17:28:06.496 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.485+0000 7f3f7e9f9700 1 -- 172.21.15.158:0/2593834223 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7815e440 con 0x7f3f780bdf20 2023-10-18T17:28:06.496 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.485+0000 7f3f7e9f9700 1 -- 172.21.15.158:0/2593834223 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f78160d10 con 0x7f3f780bdf20 2023-10-18T17:28:06.497 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.485+0000 7f3f6dffb700 1 -- 172.21.15.158:0/2593834223 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3f6801b400 con 0x7f3f780bdf20 2023-10-18T17:28:06.497 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.489+0000 7f3f6dffb700 1 --2- 172.21.15.158:0/2593834223 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f3f5c05a510 0x7f3f5c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:06.497 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.489+0000 7f3f6dffb700 1 -- 172.21.15.158:0/2593834223 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f3f68074cd0 con 0x7f3f780bdf20 2023-10-18T17:28:06.497 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.489+0000 7f3f7d9f7700 1 --2- 172.21.15.158:0/2593834223 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f3f5c05a510 0x7f3f5c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:06.497 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.489+0000 7f3f7d9f7700 1 --2- 172.21.15.158:0/2593834223 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f3f5c05a510 0x7f3f5c05c9d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f3f74005750 tx=0x7f3f74009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:06.504 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.501+0000 7f3f6dffb700 1 -- 172.21.15.158:0/2593834223 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f3f78160d10 con 0x7f3f780bdf20 2023-10-18T17:28:06.704 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.701+0000 7f3f7e9f9700 1 -- 172.21.15.158:0/2593834223 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3f7815e660 con 0x7f3f780bdf20 2023-10-18T17:28:06.705 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.701+0000 7f3f6dffb700 1 -- 172.21.15.158:0/2593834223 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f3f680481f0 con 0x7f3f780bdf20 2023-10-18T17:28:06.705 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:28:06.708 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.705+0000 7f3f7e9f9700 1 -- 172.21.15.158:0/2593834223 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f3f5c05a510 msgr2=0x7f3f5c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:06.708 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.705+0000 7f3f7e9f9700 1 --2- 172.21.15.158:0/2593834223 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f3f5c05a510 0x7f3f5c05c9d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f3f74005750 tx=0x7f3f74009040).stop 2023-10-18T17:28:06.708 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.705+0000 7f3f7e9f9700 1 -- 172.21.15.158:0/2593834223 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f780bdf20 msgr2=0x7f3f781613d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:06.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.705+0000 7f3f7e9f9700 1 --2- 172.21.15.158:0/2593834223 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f780bdf20 0x7f3f781613d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f3f6800e720 tx=0x7f3f68009060).stop 2023-10-18T17:28:06.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.705+0000 7f3f7e9f9700 1 -- 172.21.15.158:0/2593834223 shutdown_connections 2023-10-18T17:28:06.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.705+0000 7f3f7e9f9700 1 --2- 172.21.15.158:0/2593834223 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f3f5c05a510 0x7f3f5c05c9d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:06.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.705+0000 7f3f7e9f9700 1 --2- 172.21.15.158:0/2593834223 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f780be300 0x7f3f780657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:06.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.705+0000 7f3f7e9f9700 1 --2- 172.21.15.158:0/2593834223 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f780bdf20 0x7f3f781613d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:06.710 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.705+0000 7f3f7e9f9700 1 --2- 172.21.15.158:0/2593834223 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3f780686b0 0x7f3f780c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:06.710 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.705+0000 7f3f7e9f9700 1 -- 172.21.15.158:0/2593834223 >> 172.21.15.158:0/2593834223 conn(0x7f3f78062ba0 msgr2=0x7f3f7814c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:06.710 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.705+0000 7f3f7e9f9700 1 -- 172.21.15.158:0/2593834223 shutdown_connections 2023-10-18T17:28:06.710 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:06.705+0000 7f3f7e9f9700 1 -- 172.21.15.158:0/2593834223 wait complete. 2023-10-18T17:28:06.726 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:28:09.727 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:28:09.888 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.885+0000 7f2b93fff700 1 Processor -- start 2023-10-18T17:28:09.888 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.885+0000 7f2b93fff700 1 -- start start 2023-10-18T17:28:09.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b93fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2b940a9fb0 0x7f2b94150060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:09.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b93fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2b940bf670 0x7f2b9414c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:09.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b93fff700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b940bac20 con 0x7f2b9414fc80 2023-10-18T17:28:09.893 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b93fff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b94068920 con 0x7f2b940bf670 2023-10-18T17:28:09.893 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b93fff700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b940b91c0 con 0x7f2b940a9fb0 2023-10-18T17:28:09.893 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b92ffd700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f2b9414fc80 0x7f2b94068210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:44344/0 (socket says 172.21.15.158:44344) 2023-10-18T17:28:09.893 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b92ffd700 1 -- 172.21.15.158:0/428611599 learned_addr learned my addr 172.21.15.158:0/428611599 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:28:09.894 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b937fe700 1 --2- 172.21.15.158:0/428611599 >> v2:172.21.15.158:3300/0 conn(0x7f2b940bf670 0x7f2b9414c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:09.894 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b927fc700 1 --2- 172.21.15.158:0/428611599 >> v2:172.21.15.183:3300/0 conn(0x7f2b940a9fb0 0x7f2b94150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:09.894 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b937fe700 1 -- 172.21.15.158:0/428611599 >> v2:172.21.15.183:3300/0 conn(0x7f2b940a9fb0 msgr2=0x7f2b94150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:28:09.894 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b937fe700 1 --2- 172.21.15.158:0/428611599 >> v2:172.21.15.183:3300/0 conn(0x7f2b940a9fb0 0x7f2b94150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:09.894 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b937fe700 1 -- 172.21.15.158:0/428611599 >> v1:172.21.15.183:6789/0 conn(0x7f2b9414fc80 legacy=0x7f2b94068210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:09.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b937fe700 1 -- 172.21.15.158:0/428611599 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b94150620 con 0x7f2b940bf670 2023-10-18T17:28:09.895 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b91ffb700 1 -- 172.21.15.158:0/428611599 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343420304 0 0) 0x7f2b940bac20 con 0x7f2b9414fc80 2023-10-18T17:28:09.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b937fe700 1 --2- 172.21.15.158:0/428611599 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2b940bf670 0x7f2b9414c9f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f2b94067690 tx=0x7f2b8c009780).ready entity=mon.0 client_cookie=c39734b2e9afec36 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:09.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b91ffb700 1 -- 172.21.15.158:0/428611599 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c00e070 con 0x7f2b940bf670 2023-10-18T17:28:09.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b91ffb700 1 -- 172.21.15.158:0/428611599 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c00bbf0 con 0x7f2b940bf670 2023-10-18T17:28:09.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b91ffb700 1 -- 172.21.15.158:0/428611599 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c012410 con 0x7f2b940bf670 2023-10-18T17:28:09.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b93fff700 1 -- 172.21.15.158:0/428611599 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2b940bf670 msgr2=0x7f2b9414c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:09.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b93fff700 1 --2- 172.21.15.158:0/428611599 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2b940bf670 0x7f2b9414c9f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f2b94067690 tx=0x7f2b8c009780).stop 2023-10-18T17:28:09.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b93fff700 1 -- 172.21.15.158:0/428611599 shutdown_connections 2023-10-18T17:28:09.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b93fff700 1 --2- 172.21.15.158:0/428611599 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2b940bf670 0x7f2b9414c9f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:09.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b93fff700 1 --2- 172.21.15.158:0/428611599 >> v2:172.21.15.183:3300/0 conn(0x7f2b940a9fb0 0x7f2b94150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:09.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b93fff700 1 -- 172.21.15.158:0/428611599 >> 172.21.15.158:0/428611599 conn(0x7f2b94062b50 msgr2=0x7f2b94067b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:09.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b93fff700 1 -- 172.21.15.158:0/428611599 shutdown_connections 2023-10-18T17:28:09.899 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.889+0000 7f2b93fff700 1 -- 172.21.15.158:0/428611599 wait complete. 2023-10-18T17:28:09.901 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.893+0000 7f2b93fff700 1 Processor -- start 2023-10-18T17:28:09.901 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.893+0000 7f2b93fff700 1 -- start start 2023-10-18T17:28:09.901 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.893+0000 7f2b93fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b940a9fb0 0x7f2b94066070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:09.901 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.893+0000 7f2b93fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2b940bf670 0x7f2b9413f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:09.902 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.893+0000 7f2b93fff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b9414fc80 0x7f2b94067c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:09.902 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.893+0000 7f2b93fff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b94150250 con 0x7f2b940bf670 2023-10-18T17:28:09.902 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.893+0000 7f2b93fff700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b94141e20 con 0x7f2b9414fc80 2023-10-18T17:28:09.902 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.893+0000 7f2b93fff700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b94163be0 con 0x7f2b940a9fb0 2023-10-18T17:28:09.902 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.893+0000 7f2b927fc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2b940bf670 0x7f2b9413f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:09.903 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.893+0000 7f2b927fc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2b940bf670 0x7f2b9413f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:48612/0 (socket says 172.21.15.158:48612) 2023-10-18T17:28:09.903 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.893+0000 7f2b927fc700 1 -- 172.21.15.158:0/1676001198 learned_addr learned my addr 172.21.15.158:0/1676001198 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:09.903 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.893+0000 7f2b937fe700 1 --2- 172.21.15.158:0/1676001198 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b9414fc80 0x7f2b94067c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:09.903 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.893+0000 7f2b92ffd700 1 --2- 172.21.15.158:0/1676001198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b940a9fb0 0x7f2b94066070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:09.903 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.893+0000 7f2b927fc700 1 -- 172.21.15.158:0/1676001198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b940a9fb0 msgr2=0x7f2b94066070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:09.904 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.893+0000 7f2b927fc700 1 --2- 172.21.15.158:0/1676001198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b940a9fb0 0x7f2b94066070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:09.904 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.893+0000 7f2b927fc700 1 -- 172.21.15.158:0/1676001198 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b9414fc80 msgr2=0x7f2b94067c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:09.904 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.893+0000 7f2b927fc700 1 --2- 172.21.15.158:0/1676001198 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b9414fc80 0x7f2b94067c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:09.904 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.893+0000 7f2b927fc700 1 -- 172.21.15.158:0/1676001198 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c009a20 con 0x7f2b940bf670 2023-10-18T17:28:09.904 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.897+0000 7f2b927fc700 1 --2- 172.21.15.158:0/1676001198 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2b940bf670 0x7f2b9413f600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f2b8800e930 tx=0x7f2b88009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:09.905 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.897+0000 7f2b7affd700 1 -- 172.21.15.158:0/1676001198 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8800c700 con 0x7f2b940bf670 2023-10-18T17:28:09.905 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.897+0000 7f2b7affd700 1 -- 172.21.15.158:0/1676001198 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8800c860 con 0x7f2b940bf670 2023-10-18T17:28:09.905 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.897+0000 7f2b7affd700 1 -- 172.21.15.158:0/1676001198 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8800cbe0 con 0x7f2b940bf670 2023-10-18T17:28:09.906 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.897+0000 7f2b93fff700 1 -- 172.21.15.158:0/1676001198 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b94163ec0 con 0x7f2b940bf670 2023-10-18T17:28:09.906 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.897+0000 7f2b93fff700 1 -- 172.21.15.158:0/1676001198 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b941417d0 con 0x7f2b940bf670 2023-10-18T17:28:09.908 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.897+0000 7f2b93fff700 1 -- 172.21.15.158:0/1676001198 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b94046f00 con 0x7f2b940bf670 2023-10-18T17:28:09.908 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.897+0000 7f2b7affd700 1 -- 172.21.15.158:0/1676001198 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2b8801b400 con 0x7f2b940bf670 2023-10-18T17:28:09.909 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.901+0000 7f2b7affd700 1 --2- 172.21.15.158:0/1676001198 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f2b8005a540 0x7f2b8005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:09.909 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.901+0000 7f2b7affd700 1 -- 172.21.15.158:0/1676001198 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f2b88074f30 con 0x7f2b940bf670 2023-10-18T17:28:09.909 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.901+0000 7f2b92ffd700 1 --2- 172.21.15.158:0/1676001198 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f2b8005a540 0x7f2b8005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:09.910 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.901+0000 7f2b92ffd700 1 --2- 172.21.15.158:0/1676001198 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f2b8005a540 0x7f2b8005ca00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f2b8400c7d0 tx=0x7f2b84009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:09.911 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:09.905+0000 7f2b7affd700 1 -- 172.21.15.158:0/1676001198 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f2b88048450 con 0x7f2b940bf670 2023-10-18T17:28:10.110 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:10.105+0000 7f2b93fff700 1 -- 172.21.15.158:0/1676001198 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2b940a9aa0 con 0x7f2b940bf670 2023-10-18T17:28:10.110 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:10.105+0000 7f2b7affd700 1 -- 172.21.15.158:0/1676001198 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f2b8804ba70 con 0x7f2b940bf670 2023-10-18T17:28:10.111 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:28:10.113 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:10.109+0000 7f2b93fff700 1 -- 172.21.15.158:0/1676001198 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f2b8005a540 msgr2=0x7f2b8005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:10.113 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:10.109+0000 7f2b93fff700 1 --2- 172.21.15.158:0/1676001198 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f2b8005a540 0x7f2b8005ca00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f2b8400c7d0 tx=0x7f2b84009040).stop 2023-10-18T17:28:10.113 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:10.109+0000 7f2b93fff700 1 -- 172.21.15.158:0/1676001198 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2b940bf670 msgr2=0x7f2b9413f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:10.113 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:10.109+0000 7f2b93fff700 1 --2- 172.21.15.158:0/1676001198 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2b940bf670 0x7f2b9413f600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f2b8800e930 tx=0x7f2b88009060).stop 2023-10-18T17:28:10.114 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:10.109+0000 7f2b93fff700 1 -- 172.21.15.158:0/1676001198 shutdown_connections 2023-10-18T17:28:10.115 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:10.109+0000 7f2b93fff700 1 --2- 172.21.15.158:0/1676001198 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f2b8005a540 0x7f2b8005ca00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:10.115 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:10.109+0000 7f2b93fff700 1 --2- 172.21.15.158:0/1676001198 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b9414fc80 0x7f2b94067c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:10.115 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:10.109+0000 7f2b93fff700 1 --2- 172.21.15.158:0/1676001198 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2b940bf670 0x7f2b9413f600 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:10.115 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:10.109+0000 7f2b93fff700 1 --2- 172.21.15.158:0/1676001198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b940a9fb0 0x7f2b94066070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:10.115 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:10.109+0000 7f2b93fff700 1 -- 172.21.15.158:0/1676001198 >> 172.21.15.158:0/1676001198 conn(0x7f2b94062b50 msgr2=0x7f2b9414d910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:10.116 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:10.109+0000 7f2b93fff700 1 -- 172.21.15.158:0/1676001198 shutdown_connections 2023-10-18T17:28:10.116 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:10.109+0000 7f2b93fff700 1 -- 172.21.15.158:0/1676001198 wait complete. 2023-10-18T17:28:10.132 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:28:11.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~185s 2023-10-18T17:28:11.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~239s 2023-10-18T17:28:11.116 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~165s 2023-10-18T17:28:11.116 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~152s 2023-10-18T17:28:11.116 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~198s 2023-10-18T17:28:11.116 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~139s 2023-10-18T17:28:13.133 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:28:13.293 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.289+0000 7f5406f46700 1 Processor -- start 2023-10-18T17:28:13.293 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.289+0000 7f5406f46700 1 -- start start 2023-10-18T17:28:13.295 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.289+0000 7f5406f46700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5400065e30 0x7f54000683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:13.296 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.289+0000 7f5406f46700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f54000bca50 0x7f5400150890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:13.296 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f5406f46700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5400066900 con 0x7f5400067ff0 2023-10-18T17:28:13.296 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f5406f46700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5400068a50 con 0x7f5400065e30 2023-10-18T17:28:13.296 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f5406f46700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54000659a0 con 0x7f54000bca50 2023-10-18T17:28:13.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f53fffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5400065e30 0x7f54000683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:13.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f5404ce2700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f5400067ff0 0x7f54000bdc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:44360/0 (socket says 172.21.15.158:44360) 2023-10-18T17:28:13.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f53fffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5400065e30 0x7f54000683d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:48628/0 (socket says 172.21.15.158:48628) 2023-10-18T17:28:13.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f5404ce2700 1 -- 172.21.15.158:0/3373046858 learned_addr learned my addr 172.21.15.158:0/3373046858 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:28:13.299 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f54054e3700 1 --2- 172.21.15.158:0/3373046858 >> v2:172.21.15.183:3300/0 conn(0x7f54000bca50 0x7f5400150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:13.299 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f53fffff700 1 -- 172.21.15.158:0/3373046858 >> v2:172.21.15.183:3300/0 conn(0x7f54000bca50 msgr2=0x7f5400150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:28:13.299 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f53fffff700 1 --2- 172.21.15.158:0/3373046858 >> v2:172.21.15.183:3300/0 conn(0x7f54000bca50 0x7f5400150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:13.299 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f53fffff700 1 -- 172.21.15.158:0/3373046858 >> v1:172.21.15.183:6789/0 conn(0x7f5400067ff0 legacy=0x7f54000bdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:13.299 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f53fffff700 1 -- 172.21.15.158:0/3373046858 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5400066620 con 0x7f5400065e30 2023-10-18T17:28:13.300 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f53fffff700 1 --2- 172.21.15.158:0/3373046858 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5400065e30 0x7f54000683d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f54000630f0 tx=0x7f53f0009060).ready entity=mon.0 client_cookie=ae3ddbfb8576091e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:13.300 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f53ff7fe700 1 -- 172.21.15.158:0/3373046858 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f000b610 con 0x7f5400065e30 2023-10-18T17:28:13.300 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f53ff7fe700 1 -- 172.21.15.158:0/3373046858 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f000b770 con 0x7f5400065e30 2023-10-18T17:28:13.300 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f53ff7fe700 1 -- 172.21.15.158:0/3373046858 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f000baf0 con 0x7f5400065e30 2023-10-18T17:28:13.301 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f5406f46700 1 -- 172.21.15.158:0/3373046858 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5400065e30 msgr2=0x7f54000683d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:13.301 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f5406f46700 1 --2- 172.21.15.158:0/3373046858 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5400065e30 0x7f54000683d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f54000630f0 tx=0x7f53f0009060).stop 2023-10-18T17:28:13.301 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f5406f46700 1 -- 172.21.15.158:0/3373046858 shutdown_connections 2023-10-18T17:28:13.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f5406f46700 1 --2- 172.21.15.158:0/3373046858 >> v2:172.21.15.183:3300/0 conn(0x7f54000bca50 0x7f5400150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:13.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f5406f46700 1 --2- 172.21.15.158:0/3373046858 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5400065e30 0x7f54000683d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:13.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f5406f46700 1 -- 172.21.15.158:0/3373046858 >> 172.21.15.158:0/3373046858 conn(0x7f54000620d0 msgr2=0x7f54000624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:13.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f5406f46700 1 -- 172.21.15.158:0/3373046858 shutdown_connections 2023-10-18T17:28:13.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.293+0000 7f5406f46700 1 -- 172.21.15.158:0/3373046858 wait complete. 2023-10-18T17:28:13.303 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.297+0000 7f5406f46700 1 Processor -- start 2023-10-18T17:28:13.303 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.297+0000 7f5406f46700 1 -- start start 2023-10-18T17:28:13.305 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f5406f46700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5400065e30 0x7f54000b8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:13.305 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f5406f46700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5400067ff0 0x7f54000ba240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:13.305 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f5406f46700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54000bca50 0x7f540014b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:13.306 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f5406f46700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5400164230 con 0x7f54000bca50 2023-10-18T17:28:13.306 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f5406f46700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54001601e0 con 0x7f5400065e30 2023-10-18T17:28:13.306 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f5406f46700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54001604c0 con 0x7f5400067ff0 2023-10-18T17:28:13.306 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f53fffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5400067ff0 0x7f54000ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:13.306 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f5404ce2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5400065e30 0x7f54000b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:13.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f53fffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5400067ff0 0x7f54000ba240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:45862/0 (socket says 172.21.15.158:45862) 2023-10-18T17:28:13.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f53fffff700 1 -- 172.21.15.158:0/4017480349 learned_addr learned my addr 172.21.15.158:0/4017480349 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:13.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f54054e3700 1 --2- 172.21.15.158:0/4017480349 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54000bca50 0x7f540014b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:13.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f53fffff700 1 -- 172.21.15.158:0/4017480349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5400065e30 msgr2=0x7f54000b8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:13.307 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f53fffff700 1 --2- 172.21.15.158:0/4017480349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5400065e30 0x7f54000b8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:13.308 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f53fffff700 1 -- 172.21.15.158:0/4017480349 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54000bca50 msgr2=0x7f540014b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:13.308 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f53fffff700 1 --2- 172.21.15.158:0/4017480349 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54000bca50 0x7f540014b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:13.308 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f53fffff700 1 -- 172.21.15.158:0/4017480349 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f00092a0 con 0x7f5400067ff0 2023-10-18T17:28:13.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f53fffff700 1 --2- 172.21.15.158:0/4017480349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5400067ff0 0x7f54000ba240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f53f0009fd0 tx=0x7f53f0017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:13.309 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f53fcff9700 1 -- 172.21.15.158:0/4017480349 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f000b610 con 0x7f5400067ff0 2023-10-18T17:28:13.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f53fcff9700 1 -- 172.21.15.158:0/4017480349 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f000b8e0 con 0x7f5400067ff0 2023-10-18T17:28:13.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f53fcff9700 1 -- 172.21.15.158:0/4017480349 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f001b440 con 0x7f5400067ff0 2023-10-18T17:28:13.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f5406f46700 1 -- 172.21.15.158:0/4017480349 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54001607a0 con 0x7f5400067ff0 2023-10-18T17:28:13.310 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.301+0000 7f5406f46700 1 -- 172.21.15.158:0/4017480349 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5400160fa0 con 0x7f5400067ff0 2023-10-18T17:28:13.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.305+0000 7f5406f46700 1 -- 172.21.15.158:0/4017480349 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540006c190 con 0x7f5400067ff0 2023-10-18T17:28:13.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.305+0000 7f53fcff9700 1 -- 172.21.15.158:0/4017480349 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f53f001b7f0 con 0x7f5400067ff0 2023-10-18T17:28:13.311 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.305+0000 7f53fcff9700 1 --2- 172.21.15.158:0/4017480349 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f53ec05a510 0x7f53ec05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:13.312 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.305+0000 7f53fcff9700 1 -- 172.21.15.158:0/4017480349 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f53f0076380 con 0x7f5400067ff0 2023-10-18T17:28:13.312 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.305+0000 7f5404ce2700 1 --2- 172.21.15.158:0/4017480349 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f53ec05a510 0x7f53ec05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:13.312 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.309+0000 7f5404ce2700 1 --2- 172.21.15.158:0/4017480349 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f53ec05a510 0x7f53ec05c9d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f53f4007fd0 tx=0x7f53f4009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:13.319 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.313+0000 7f53fcff9700 1 -- 172.21.15.158:0/4017480349 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f53f0049840 con 0x7f5400067ff0 2023-10-18T17:28:13.516 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.513+0000 7f5406f46700 1 -- 172.21.15.158:0/4017480349 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f54000b8ec0 con 0x7f5400067ff0 2023-10-18T17:28:13.517 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.513+0000 7f53fcff9700 1 -- 172.21.15.158:0/4017480349 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f53f004ce60 con 0x7f5400067ff0 2023-10-18T17:28:13.518 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:28:13.522 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.517+0000 7f5406f46700 1 -- 172.21.15.158:0/4017480349 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f53ec05a510 msgr2=0x7f53ec05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:13.523 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.517+0000 7f5406f46700 1 --2- 172.21.15.158:0/4017480349 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f53ec05a510 0x7f53ec05c9d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f53f4007fd0 tx=0x7f53f4009040).stop 2023-10-18T17:28:13.523 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.517+0000 7f5406f46700 1 -- 172.21.15.158:0/4017480349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5400067ff0 msgr2=0x7f54000ba240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:13.523 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.517+0000 7f5406f46700 1 --2- 172.21.15.158:0/4017480349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5400067ff0 0x7f54000ba240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f53f0009fd0 tx=0x7f53f0017000).stop 2023-10-18T17:28:13.523 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.517+0000 7f5406f46700 1 -- 172.21.15.158:0/4017480349 shutdown_connections 2023-10-18T17:28:13.523 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.517+0000 7f5406f46700 1 --2- 172.21.15.158:0/4017480349 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f53ec05a510 0x7f53ec05c9d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:13.524 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.517+0000 7f5406f46700 1 --2- 172.21.15.158:0/4017480349 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54000bca50 0x7f540014b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:13.524 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.517+0000 7f5406f46700 1 --2- 172.21.15.158:0/4017480349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5400067ff0 0x7f54000ba240 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:13.524 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.517+0000 7f5406f46700 1 --2- 172.21.15.158:0/4017480349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5400065e30 0x7f54000b8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:13.524 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.517+0000 7f5406f46700 1 -- 172.21.15.158:0/4017480349 >> 172.21.15.158:0/4017480349 conn(0x7f54000620d0 msgr2=0x7f54000b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:13.524 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.517+0000 7f5406f46700 1 -- 172.21.15.158:0/4017480349 shutdown_connections 2023-10-18T17:28:13.525 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:13.517+0000 7f5406f46700 1 -- 172.21.15.158:0/4017480349 wait complete. 2023-10-18T17:28:13.542 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:28:16.544 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:28:16.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.705+0000 7f16ac49b700 1 Processor -- start 2023-10-18T17:28:16.709 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.705+0000 7f16ac49b700 1 -- start start 2023-10-18T17:28:16.711 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.705+0000 7f16ac49b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16a4064e50 0x7f16a4065230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:16.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.705+0000 7f16ac49b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a414c1f0 con 0x7f16a40bc410 2023-10-18T17:28:16.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.705+0000 7f16ac49b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a414c4d0 con 0x7f16a41501a0 2023-10-18T17:28:16.712 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.705+0000 7f16ac49b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a40bd9b0 con 0x7f16a4064e50 2023-10-18T17:28:16.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.709+0000 7f16a9a36700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f16a41501a0 0x7f16a40bd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:44370/0 (socket says 172.21.15.158:44370) 2023-10-18T17:28:16.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.709+0000 7f16a9a36700 1 -- 172.21.15.158:0/4014358259 learned_addr learned my addr 172.21.15.158:0/4014358259 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:28:16.713 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.709+0000 7f16aa237700 1 --2- 172.21.15.158:0/4014358259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16a4064e50 0x7f16a4065230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:16.714 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.709+0000 7f16a9235700 1 -- 172.21.15.158:0/4014358259 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369939284 0 0) 0x7f16a414c4d0 con 0x7f16a41501a0 2023-10-18T17:28:16.715 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.709+0000 7f16a9235700 1 -- 172.21.15.158:0/4014358259 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1690004500 con 0x7f16a41501a0 2023-10-18T17:28:16.715 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.709+0000 7f16a9235700 1 -- 172.21.15.158:0/4014358259 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707534074 0 0) 0x7f16a414c1f0 con 0x7f16a40bc410 2023-10-18T17:28:16.715 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.709+0000 7f16a9235700 1 -- 172.21.15.158:0/4014358259 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16a414c4d0 con 0x7f16a40bc410 2023-10-18T17:28:16.715 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.709+0000 7f16aa237700 1 -- 172.21.15.158:0/4014358259 >> v1:172.21.15.183:6789/0 conn(0x7f16a41501a0 legacy=0x7f16a40bd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:16.715 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.709+0000 7f16aa237700 1 -- 172.21.15.158:0/4014358259 >> v1:172.21.15.158:6789/0 conn(0x7f16a40bc410 legacy=0x7f16a40623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:16.716 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.709+0000 7f16aa237700 1 -- 172.21.15.158:0/4014358259 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a414c7b0 con 0x7f16a4064e50 2023-10-18T17:28:16.716 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.709+0000 7f16aa237700 1 --2- 172.21.15.158:0/4014358259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16a4064e50 0x7f16a4065230 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f16a0009790 tx=0x7f16a0009060).ready entity=mon.2 client_cookie=1a5b2be0c5cf2eba server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:16.716 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.709+0000 7f16a9235700 1 -- 172.21.15.158:0/4014358259 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a000f510 con 0x7f16a4064e50 2023-10-18T17:28:16.716 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.709+0000 7f16a9235700 1 -- 172.21.15.158:0/4014358259 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a000f670 con 0x7f16a4064e50 2023-10-18T17:28:16.716 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.709+0000 7f16a9235700 1 -- 172.21.15.158:0/4014358259 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a000f9f0 con 0x7f16a4064e50 2023-10-18T17:28:16.717 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.709+0000 7f16ac49b700 1 -- 172.21.15.158:0/4014358259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16a4064e50 msgr2=0x7f16a4065230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:16.717 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.709+0000 7f16ac49b700 1 --2- 172.21.15.158:0/4014358259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16a4064e50 0x7f16a4065230 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f16a0009790 tx=0x7f16a0009060).stop 2023-10-18T17:28:16.718 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.709+0000 7f16ac49b700 1 -- 172.21.15.158:0/4014358259 shutdown_connections 2023-10-18T17:28:16.718 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.709+0000 7f16ac49b700 1 --2- 172.21.15.158:0/4014358259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16a4064e50 0x7f16a4065230 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:16.718 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.709+0000 7f16ac49b700 1 -- 172.21.15.158:0/4014358259 >> 172.21.15.158:0/4014358259 conn(0x7f16a40bfe30 msgr2=0x7f16a40645a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:16.718 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.713+0000 7f16ac49b700 1 -- 172.21.15.158:0/4014358259 shutdown_connections 2023-10-18T17:28:16.718 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.713+0000 7f16ac49b700 1 -- 172.21.15.158:0/4014358259 wait complete. 2023-10-18T17:28:16.719 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.713+0000 7f16ac49b700 1 Processor -- start 2023-10-18T17:28:16.719 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.713+0000 7f16ac49b700 1 -- start start 2023-10-18T17:28:16.721 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f16ac49b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16a4064e50 0x7f16a414f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:16.721 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f16ac49b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16a40bc410 0x7f16a414b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:16.721 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f16ac49b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16a41501a0 0x7f16a4163b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:16.722 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f16ac49b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a40bb870 con 0x7f16a4064e50 2023-10-18T17:28:16.722 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f16ac49b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a40bbaa0 con 0x7f16a41501a0 2023-10-18T17:28:16.722 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f16ac49b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a414fa20 con 0x7f16a40bc410 2023-10-18T17:28:16.722 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f16aa237700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16a4064e50 0x7f16a414f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:16.722 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f16aa237700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16a4064e50 0x7f16a414f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:48646/0 (socket says 172.21.15.158:48646) 2023-10-18T17:28:16.723 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f16aa237700 1 -- 172.21.15.158:0/2977119083 learned_addr learned my addr 172.21.15.158:0/2977119083 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:16.723 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f16a9a36700 1 --2- 172.21.15.158:0/2977119083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16a40bc410 0x7f16a414b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:16.726 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f16aaa38700 1 --2- 172.21.15.158:0/2977119083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16a41501a0 0x7f16a4163b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:16.727 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f16aa237700 1 -- 172.21.15.158:0/2977119083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16a40bc410 msgr2=0x7f16a414b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:16.727 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f16aa237700 1 --2- 172.21.15.158:0/2977119083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16a40bc410 0x7f16a414b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:16.727 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f16aa237700 1 -- 172.21.15.158:0/2977119083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16a41501a0 msgr2=0x7f16a4163b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:16.728 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f16aa237700 1 --2- 172.21.15.158:0/2977119083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16a41501a0 0x7f16a4163b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:16.728 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f16aa237700 1 -- 172.21.15.158:0/2977119083 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a00092a0 con 0x7f16a4064e50 2023-10-18T17:28:16.728 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f16aa237700 1 --2- 172.21.15.158:0/2977119083 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16a4064e50 0x7f16a414f530 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f16a406bf60 tx=0x7f16a0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:16.728 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f169a7fc700 1 -- 172.21.15.158:0/2977119083 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a000fe80 con 0x7f16a4064e50 2023-10-18T17:28:16.729 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f169a7fc700 1 -- 172.21.15.158:0/2977119083 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a000f7e0 con 0x7f16a4064e50 2023-10-18T17:28:16.729 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f169a7fc700 1 -- 172.21.15.158:0/2977119083 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a001b640 con 0x7f16a4064e50 2023-10-18T17:28:16.729 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f16ac49b700 1 -- 172.21.15.158:0/2977119083 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a40bbd40 con 0x7f16a4064e50 2023-10-18T17:28:16.729 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.717+0000 7f16ac49b700 1 -- 172.21.15.158:0/2977119083 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a40b5540 con 0x7f16a4064e50 2023-10-18T17:28:16.729 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.721+0000 7f16ac49b700 1 -- 172.21.15.158:0/2977119083 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a4063500 con 0x7f16a4064e50 2023-10-18T17:28:16.730 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.721+0000 7f169a7fc700 1 -- 172.21.15.158:0/2977119083 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f16a001b9b0 con 0x7f16a4064e50 2023-10-18T17:28:16.730 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.725+0000 7f169a7fc700 1 --2- 172.21.15.158:0/2977119083 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f168805a510 0x7f168805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:16.731 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.725+0000 7f169a7fc700 1 -- 172.21.15.158:0/2977119083 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f16a0076190 con 0x7f16a4064e50 2023-10-18T17:28:16.731 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.725+0000 7f16a9a36700 1 --2- 172.21.15.158:0/2977119083 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f168805a510 0x7f168805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:16.731 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.725+0000 7f16a9a36700 1 --2- 172.21.15.158:0/2977119083 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f168805a510 0x7f168805c9d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f16a414db00 tx=0x7f1694009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:16.733 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.729+0000 7f169a7fc700 1 -- 172.21.15.158:0/2977119083 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f16a0049650 con 0x7f16a4064e50 2023-10-18T17:28:16.928 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.925+0000 7f16ac49b700 1 -- 172.21.15.158:0/2977119083 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f16a406c190 con 0x7f16a4064e50 2023-10-18T17:28:16.929 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.925+0000 7f169a7fc700 1 -- 172.21.15.158:0/2977119083 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f16a004cc70 con 0x7f16a4064e50 2023-10-18T17:28:16.929 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:28:16.935 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.925+0000 7f16ac49b700 1 -- 172.21.15.158:0/2977119083 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f168805a510 msgr2=0x7f168805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:16.935 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.925+0000 7f16ac49b700 1 --2- 172.21.15.158:0/2977119083 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f168805a510 0x7f168805c9d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f16a414db00 tx=0x7f1694009040).stop 2023-10-18T17:28:16.935 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.925+0000 7f16ac49b700 1 -- 172.21.15.158:0/2977119083 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16a4064e50 msgr2=0x7f16a414f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:16.936 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.925+0000 7f16ac49b700 1 --2- 172.21.15.158:0/2977119083 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16a4064e50 0x7f16a414f530 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f16a406bf60 tx=0x7f16a0017000).stop 2023-10-18T17:28:16.936 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.929+0000 7f16ac49b700 1 -- 172.21.15.158:0/2977119083 shutdown_connections 2023-10-18T17:28:16.936 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.929+0000 7f16ac49b700 1 --2- 172.21.15.158:0/2977119083 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f168805a510 0x7f168805c9d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:16.936 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.929+0000 7f16ac49b700 1 --2- 172.21.15.158:0/2977119083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16a41501a0 0x7f16a4163b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:16.936 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.929+0000 7f16ac49b700 1 --2- 172.21.15.158:0/2977119083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16a40bc410 0x7f16a414b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:16.937 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.929+0000 7f16ac49b700 1 --2- 172.21.15.158:0/2977119083 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16a4064e50 0x7f16a414f530 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:16.937 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.929+0000 7f16ac49b700 1 -- 172.21.15.158:0/2977119083 >> 172.21.15.158:0/2977119083 conn(0x7f16a40bfe30 msgr2=0x7f16a4145060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:16.937 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.929+0000 7f16ac49b700 1 -- 172.21.15.158:0/2977119083 shutdown_connections 2023-10-18T17:28:16.937 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:16.929+0000 7f16ac49b700 1 -- 172.21.15.158:0/2977119083 wait complete. 2023-10-18T17:28:16.950 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:28:17.430 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~191s 2023-10-18T17:28:17.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~245s 2023-10-18T17:28:17.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~171s 2023-10-18T17:28:17.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~158s 2023-10-18T17:28:17.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~204s 2023-10-18T17:28:17.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~145s 2023-10-18T17:28:19.951 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:28:20.115 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.109+0000 7fc430a1a700 1 Processor -- start 2023-10-18T17:28:20.116 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.109+0000 7fc430a1a700 1 -- start start 2023-10-18T17:28:20.118 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.113+0000 7fc430a1a700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc42c0658a0 0x7fc42c065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:20.119 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.113+0000 7fc430a1a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc42c0be2e0 con 0x7fc42c0c2bf0 2023-10-18T17:28:20.119 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.113+0000 7fc430a1a700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc42c0be770 con 0x7fc42c0bd1c0 2023-10-18T17:28:20.119 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.113+0000 7fc430a1a700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc42c0bda80 con 0x7fc42c0658a0 2023-10-18T17:28:20.119 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.113+0000 7fc42ad9d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc42c0658a0 0x7fc42c065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:20.120 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.113+0000 7fc42b59e700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fc42c0bd1c0 0x7fc42c14ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:34984/0 (socket says 172.21.15.158:34984) 2023-10-18T17:28:20.120 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.113+0000 7fc42b59e700 1 -- 172.21.15.158:0/2627307302 learned_addr learned my addr 172.21.15.158:0/2627307302 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:28:20.121 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.117+0000 7fc42ad9d700 1 -- 172.21.15.158:0/2627307302 >> v1:172.21.15.183:6789/0 conn(0x7fc42c0bd1c0 legacy=0x7fc42c14ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:20.121 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.117+0000 7fc42ad9d700 1 -- 172.21.15.158:0/2627307302 >> v1:172.21.15.158:6789/0 conn(0x7fc42c0c2bf0 legacy=0x7fc42c0630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:20.121 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.117+0000 7fc42ad9d700 1 -- 172.21.15.158:0/2627307302 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c0b9580 con 0x7fc42c0658a0 2023-10-18T17:28:20.121 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.117+0000 7fc42a59c700 1 -- 172.21.15.158:0/2627307302 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815862658 0 0) 0x7fc42c0be770 con 0x7fc42c0bd1c0 2023-10-18T17:28:20.122 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.117+0000 7fc42ad9d700 1 --2- 172.21.15.158:0/2627307302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc42c0658a0 0x7fc42c065c80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fc41c009760 tx=0x7fc41c009060).ready entity=mon.1 client_cookie=6ec2bdacab5bd338 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:20.122 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.117+0000 7fc42a59c700 1 -- 172.21.15.158:0/2627307302 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c00b580 con 0x7fc42c0658a0 2023-10-18T17:28:20.122 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.117+0000 7fc42a59c700 1 -- 172.21.15.158:0/2627307302 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41c00b6e0 con 0x7fc42c0658a0 2023-10-18T17:28:20.122 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.117+0000 7fc42a59c700 1 -- 172.21.15.158:0/2627307302 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c00ba60 con 0x7fc42c0658a0 2023-10-18T17:28:20.123 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.117+0000 7fc430a1a700 1 -- 172.21.15.158:0/2627307302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc42c0658a0 msgr2=0x7fc42c065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:20.123 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.117+0000 7fc430a1a700 1 --2- 172.21.15.158:0/2627307302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc42c0658a0 0x7fc42c065c80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fc41c009760 tx=0x7fc41c009060).stop 2023-10-18T17:28:20.123 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.117+0000 7fc430a1a700 1 -- 172.21.15.158:0/2627307302 shutdown_connections 2023-10-18T17:28:20.124 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.117+0000 7fc430a1a700 1 --2- 172.21.15.158:0/2627307302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc42c0658a0 0x7fc42c065c80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:20.124 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.117+0000 7fc430a1a700 1 -- 172.21.15.158:0/2627307302 >> 172.21.15.158:0/2627307302 conn(0x7fc42c062ba0 msgr2=0x7fc42c0c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:20.124 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.117+0000 7fc430a1a700 1 -- 172.21.15.158:0/2627307302 shutdown_connections 2023-10-18T17:28:20.124 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.117+0000 7fc430a1a700 1 -- 172.21.15.158:0/2627307302 wait complete. 2023-10-18T17:28:20.125 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.121+0000 7fc430a1a700 1 Processor -- start 2023-10-18T17:28:20.125 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.121+0000 7fc430a1a700 1 -- start start 2023-10-18T17:28:20.127 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.121+0000 7fc430a1a700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc42c0658a0 0x7fc42c152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:20.127 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.121+0000 7fc430a1a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc42c0bd1c0 0x7fc42c0c0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:20.127 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.121+0000 7fc430a1a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc42c0c2bf0 0x7fc42c0c1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:20.127 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.121+0000 7fc430a1a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c0b8870 con 0x7fc42c0c2bf0 2023-10-18T17:28:20.128 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.121+0000 7fc430a1a700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c0c1780 con 0x7fc42c0658a0 2023-10-18T17:28:20.128 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.121+0000 7fc430a1a700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c14cc90 con 0x7fc42c0bd1c0 2023-10-18T17:28:20.130 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.121+0000 7fc42b59e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc42c0c2bf0 0x7fc42c0c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:20.130 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.121+0000 7fc423fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc42c0bd1c0 0x7fc42c0c0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:20.130 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.125+0000 7fc42ad9d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc42c0658a0 0x7fc42c152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:20.130 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.125+0000 7fc423fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc42c0bd1c0 0x7fc42c0c0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:34620/0 (socket says 172.21.15.158:34620) 2023-10-18T17:28:20.130 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.125+0000 7fc423fff700 1 -- 172.21.15.158:0/274558408 learned_addr learned my addr 172.21.15.158:0/274558408 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:20.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.125+0000 7fc423fff700 1 -- 172.21.15.158:0/274558408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc42c0658a0 msgr2=0x7fc42c152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:20.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.125+0000 7fc423fff700 1 --2- 172.21.15.158:0/274558408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc42c0658a0 0x7fc42c152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:20.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.125+0000 7fc423fff700 1 -- 172.21.15.158:0/274558408 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc42c0c2bf0 msgr2=0x7fc42c0c1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:20.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.125+0000 7fc423fff700 1 --2- 172.21.15.158:0/274558408 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc42c0c2bf0 0x7fc42c0c1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:20.131 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.125+0000 7fc423fff700 1 -- 172.21.15.158:0/274558408 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c0092a0 con 0x7fc42c0bd1c0 2023-10-18T17:28:20.132 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.125+0000 7fc42b59e700 1 --2- 172.21.15.158:0/274558408 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc42c0c2bf0 0x7fc42c0c1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:28:20.132 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.125+0000 7fc42ad9d700 1 --2- 172.21.15.158:0/274558408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc42c0658a0 0x7fc42c152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:28:20.132 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.125+0000 7fc423fff700 1 --2- 172.21.15.158:0/274558408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc42c0bd1c0 0x7fc42c0c0da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fc41400c4c0 tx=0x7fc414007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:20.132 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.125+0000 7fc422ffd700 1 -- 172.21.15.158:0/274558408 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41400ce70 con 0x7fc42c0bd1c0 2023-10-18T17:28:20.132 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.125+0000 7fc422ffd700 1 -- 172.21.15.158:0/274558408 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc414001e90 con 0x7fc42c0bd1c0 2023-10-18T17:28:20.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.125+0000 7fc430a1a700 1 -- 172.21.15.158:0/274558408 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc42c161c70 con 0x7fc42c0bd1c0 2023-10-18T17:28:20.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.125+0000 7fc422ffd700 1 -- 172.21.15.158:0/274558408 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc414007250 con 0x7fc42c0bd1c0 2023-10-18T17:28:20.133 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.125+0000 7fc430a1a700 1 -- 172.21.15.158:0/274558408 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc42c0c05c0 con 0x7fc42c0bd1c0 2023-10-18T17:28:20.134 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.125+0000 7fc430a1a700 1 -- 172.21.15.158:0/274558408 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc42c046f00 con 0x7fc42c0bd1c0 2023-10-18T17:28:20.134 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.129+0000 7fc422ffd700 1 -- 172.21.15.158:0/274558408 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc4140066a0 con 0x7fc42c0bd1c0 2023-10-18T17:28:20.134 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.129+0000 7fc422ffd700 1 --2- 172.21.15.158:0/274558408 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc40c05a510 0x7fc40c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:20.135 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.129+0000 7fc422ffd700 1 -- 172.21.15.158:0/274558408 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fc414074950 con 0x7fc42c0bd1c0 2023-10-18T17:28:20.135 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.129+0000 7fc42ad9d700 1 --2- 172.21.15.158:0/274558408 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc40c05a510 0x7fc40c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:20.135 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.129+0000 7fc42ad9d700 1 --2- 172.21.15.158:0/274558408 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc40c05a510 0x7fc40c05c9d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fc41c00b340 tx=0x7fc41c017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:20.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.137+0000 7fc422ffd700 1 -- 172.21.15.158:0/274558408 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fc414047f10 con 0x7fc42c0bd1c0 2023-10-18T17:28:20.350 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.345+0000 7fc430a1a700 1 -- 172.21.15.158:0/274558408 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc42c0b9360 con 0x7fc42c0bd1c0 2023-10-18T17:28:20.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.345+0000 7fc422ffd700 1 -- 172.21.15.158:0/274558408 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fc41404b530 con 0x7fc42c0bd1c0 2023-10-18T17:28:20.352 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:28:20.354 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.349+0000 7fc430a1a700 1 -- 172.21.15.158:0/274558408 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc40c05a510 msgr2=0x7fc40c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:20.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.349+0000 7fc430a1a700 1 --2- 172.21.15.158:0/274558408 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc40c05a510 0x7fc40c05c9d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fc41c00b340 tx=0x7fc41c017000).stop 2023-10-18T17:28:20.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.349+0000 7fc430a1a700 1 -- 172.21.15.158:0/274558408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc42c0bd1c0 msgr2=0x7fc42c0c0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:20.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.349+0000 7fc430a1a700 1 --2- 172.21.15.158:0/274558408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc42c0bd1c0 0x7fc42c0c0da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fc41400c4c0 tx=0x7fc414007e00).stop 2023-10-18T17:28:20.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.349+0000 7fc430a1a700 1 -- 172.21.15.158:0/274558408 shutdown_connections 2023-10-18T17:28:20.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.349+0000 7fc430a1a700 1 --2- 172.21.15.158:0/274558408 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fc40c05a510 0x7fc40c05c9d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:20.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.349+0000 7fc430a1a700 1 --2- 172.21.15.158:0/274558408 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc42c0c2bf0 0x7fc42c0c1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:20.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.349+0000 7fc430a1a700 1 --2- 172.21.15.158:0/274558408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc42c0bd1c0 0x7fc42c0c0da0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:20.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.349+0000 7fc430a1a700 1 --2- 172.21.15.158:0/274558408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc42c0658a0 0x7fc42c152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:20.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.349+0000 7fc430a1a700 1 -- 172.21.15.158:0/274558408 >> 172.21.15.158:0/274558408 conn(0x7fc42c062ba0 msgr2=0x7fc42c14e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:20.357 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.349+0000 7fc430a1a700 1 -- 172.21.15.158:0/274558408 shutdown_connections 2023-10-18T17:28:20.357 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:20.349+0000 7fc430a1a700 1 -- 172.21.15.158:0/274558408 wait complete. 2023-10-18T17:28:20.374 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:28:23.376 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:28:23.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.532+0000 7f77e605b700 1 Processor -- start 2023-10-18T17:28:23.536 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.532+0000 7f77e605b700 1 -- start start 2023-10-18T17:28:23.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.532+0000 7f77e605b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77e00beea0 0x7f77e0150b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:23.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.532+0000 7f77e605b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f77e0067e50 0x7f77e0068290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:23.538 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.532+0000 7f77e605b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e00bd9e0 con 0x7f77e00beac0 2023-10-18T17:28:23.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.532+0000 7f77e605b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e0151080 con 0x7f77e0067e50 2023-10-18T17:28:23.539 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.532+0000 7f77e605b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e0068780 con 0x7f77e00beea0 2023-10-18T17:28:23.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.532+0000 7f77dffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f77e0067e50 0x7f77e0068290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:23.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.532+0000 7f77d6ffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77e00beea0 0x7f77e0150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:23.540 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.532+0000 7f77df7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f77e00beac0 0x7f77e0066150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:58642/0 (socket says 172.21.15.158:58642) 2023-10-18T17:28:23.541 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.532+0000 7f77d6ffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77e00beea0 0x7f77e0150b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:34630/0 (socket says 172.21.15.158:34630) 2023-10-18T17:28:23.541 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.532+0000 7f77df7fe700 1 -- 172.21.15.158:0/126642791 learned_addr learned my addr 172.21.15.158:0/126642791 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:28:23.541 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.532+0000 7f77dffff700 1 -- 172.21.15.158:0/126642791 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77e00beea0 msgr2=0x7f77e0150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:28:23.541 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.532+0000 7f77dffff700 1 --2- 172.21.15.158:0/126642791 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77e00beea0 0x7f77e0150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:23.542 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.536+0000 7f77dffff700 1 -- 172.21.15.158:0/126642791 >> v1:172.21.15.158:6789/0 conn(0x7f77e00beac0 legacy=0x7f77e0066150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:23.543 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.536+0000 7f77dffff700 1 -- 172.21.15.158:0/126642791 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e00bcaf0 con 0x7f77e0067e50 2023-10-18T17:28:23.543 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.536+0000 7f77dffff700 1 --2- 172.21.15.158:0/126642791 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f77e0067e50 0x7f77e0068290 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f77d8009e60 tx=0x7f77d8009780).ready entity=mon.0 client_cookie=7f9402109dd91706 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:23.545 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.536+0000 7f77deffd700 1 -- 172.21.15.158:0/126642791 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d800e070 con 0x7f77e0067e50 2023-10-18T17:28:23.545 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.536+0000 7f77deffd700 1 -- 172.21.15.158:0/126642791 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d800bbf0 con 0x7f77e0067e50 2023-10-18T17:28:23.545 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.536+0000 7f77deffd700 1 -- 172.21.15.158:0/126642791 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d8012410 con 0x7f77e0067e50 2023-10-18T17:28:23.545 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.536+0000 7f77e605b700 1 -- 172.21.15.158:0/126642791 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f77e0067e50 msgr2=0x7f77e0068290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:23.546 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.536+0000 7f77e605b700 1 --2- 172.21.15.158:0/126642791 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f77e0067e50 0x7f77e0068290 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f77d8009e60 tx=0x7f77d8009780).stop 2023-10-18T17:28:23.546 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.536+0000 7f77e605b700 1 -- 172.21.15.158:0/126642791 shutdown_connections 2023-10-18T17:28:23.546 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.536+0000 7f77e605b700 1 --2- 172.21.15.158:0/126642791 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f77e0067e50 0x7f77e0068290 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:23.546 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.536+0000 7f77e605b700 1 --2- 172.21.15.158:0/126642791 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77e00beea0 0x7f77e0150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:23.546 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.536+0000 7f77e605b700 1 -- 172.21.15.158:0/126642791 >> 172.21.15.158:0/126642791 conn(0x7f77e00620d0 msgr2=0x7f77e00624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:23.547 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.536+0000 7f77e605b700 1 -- 172.21.15.158:0/126642791 shutdown_connections 2023-10-18T17:28:23.547 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.536+0000 7f77e605b700 1 -- 172.21.15.158:0/126642791 wait complete. 2023-10-18T17:28:23.547 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77e605b700 1 Processor -- start 2023-10-18T17:28:23.547 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77e605b700 1 -- start start 2023-10-18T17:28:23.549 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77e605b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f77e0067e50 0x7f77e014d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:23.550 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77e605b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77e00beac0 0x7f77e0153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:23.550 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77e605b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77e00beea0 0x7f77e01515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:23.550 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77e605b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e01543d0 con 0x7f77e0067e50 2023-10-18T17:28:23.550 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77e605b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e015d840 con 0x7f77e00beea0 2023-10-18T17:28:23.550 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77e605b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e015e620 con 0x7f77e00beac0 2023-10-18T17:28:23.551 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77df7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f77e0067e50 0x7f77e014d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:23.551 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77dffff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77e00beea0 0x7f77e01515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:23.551 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77d6ffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77e00beac0 0x7f77e0153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:23.551 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77df7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f77e0067e50 0x7f77e014d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:35602/0 (socket says 172.21.15.158:35602) 2023-10-18T17:28:23.551 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77dffff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77e00beea0 0x7f77e01515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:51006/0 (socket says 172.21.15.158:51006) 2023-10-18T17:28:23.552 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77df7fe700 1 -- 172.21.15.158:0/2090065620 learned_addr learned my addr 172.21.15.158:0/2090065620 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:23.552 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77df7fe700 1 -- 172.21.15.158:0/2090065620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77e00beac0 msgr2=0x7f77e0153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:23.552 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77df7fe700 1 --2- 172.21.15.158:0/2090065620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77e00beac0 0x7f77e0153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:23.552 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77df7fe700 1 -- 172.21.15.158:0/2090065620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77e00beea0 msgr2=0x7f77e01515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:23.552 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77df7fe700 1 --2- 172.21.15.158:0/2090065620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77e00beea0 0x7f77e01515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:23.553 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77df7fe700 1 -- 172.21.15.158:0/2090065620 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d8009a20 con 0x7f77e0067e50 2023-10-18T17:28:23.553 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.540+0000 7f77dffff700 1 --2- 172.21.15.158:0/2090065620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77e00beea0 0x7f77e01515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:28:23.553 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.544+0000 7f77df7fe700 1 --2- 172.21.15.158:0/2090065620 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f77e0067e50 0x7f77e014d6f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f77d000c4f0 tx=0x7f77d0007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:23.553 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.544+0000 7f77d7fff700 1 -- 172.21.15.158:0/2090065620 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d000ce00 con 0x7f77e0067e50 2023-10-18T17:28:23.553 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.544+0000 7f77d7fff700 1 -- 172.21.15.158:0/2090065620 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d00072e0 con 0x7f77e0067e50 2023-10-18T17:28:23.554 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.544+0000 7f77e605b700 1 -- 172.21.15.158:0/2090065620 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e015da50 con 0x7f77e0067e50 2023-10-18T17:28:23.554 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.544+0000 7f77d7fff700 1 -- 172.21.15.158:0/2090065620 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0007660 con 0x7f77e0067e50 2023-10-18T17:28:23.554 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.544+0000 7f77e605b700 1 -- 172.21.15.158:0/2090065620 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e015dfd0 con 0x7f77e0067e50 2023-10-18T17:28:23.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.544+0000 7f77e605b700 1 -- 172.21.15.158:0/2090065620 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e006c190 con 0x7f77e0067e50 2023-10-18T17:28:23.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.548+0000 7f77d7fff700 1 -- 172.21.15.158:0/2090065620 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f77d00059b0 con 0x7f77e0067e50 2023-10-18T17:28:23.556 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.548+0000 7f77d7fff700 1 --2- 172.21.15.158:0/2090065620 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f77c005a510 0x7f77c005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:23.556 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.548+0000 7f77d7fff700 1 -- 172.21.15.158:0/2090065620 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f77d0073fe0 con 0x7f77e0067e50 2023-10-18T17:28:23.556 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.548+0000 7f77d6ffd700 1 --2- 172.21.15.158:0/2090065620 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f77c005a510 0x7f77c005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:23.556 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.548+0000 7f77d6ffd700 1 --2- 172.21.15.158:0/2090065620 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f77c005a510 0x7f77c005c9d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f77e014dce0 tx=0x7f77c8009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:23.557 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.552+0000 7f77d7fff700 1 -- 172.21.15.158:0/2090065620 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f77d00474c0 con 0x7f77e0067e50 2023-10-18T17:28:23.746 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~197s 2023-10-18T17:28:23.746 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~251s 2023-10-18T17:28:23.746 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~177s 2023-10-18T17:28:23.747 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~164s 2023-10-18T17:28:23.747 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~211s 2023-10-18T17:28:23.747 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~151s 2023-10-18T17:28:23.754 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.748+0000 7f77e605b700 1 -- 172.21.15.158:0/2090065620 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f77e00bcdd0 con 0x7f77e0067e50 2023-10-18T17:28:23.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.748+0000 7f77d7fff700 1 -- 172.21.15.158:0/2090065620 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f77d004aae0 con 0x7f77e0067e50 2023-10-18T17:28:23.755 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:28:23.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.752+0000 7f77e605b700 1 -- 172.21.15.158:0/2090065620 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f77c005a510 msgr2=0x7f77c005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:23.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.752+0000 7f77e605b700 1 --2- 172.21.15.158:0/2090065620 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f77c005a510 0x7f77c005c9d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f77e014dce0 tx=0x7f77c8009060).stop 2023-10-18T17:28:23.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.752+0000 7f77e605b700 1 -- 172.21.15.158:0/2090065620 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f77e0067e50 msgr2=0x7f77e014d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:23.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.752+0000 7f77e605b700 1 --2- 172.21.15.158:0/2090065620 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f77e0067e50 0x7f77e014d6f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f77d000c4f0 tx=0x7f77d0007db0).stop 2023-10-18T17:28:23.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.752+0000 7f77e605b700 1 -- 172.21.15.158:0/2090065620 shutdown_connections 2023-10-18T17:28:23.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.752+0000 7f77e605b700 1 --2- 172.21.15.158:0/2090065620 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f77c005a510 0x7f77c005c9d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:23.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.752+0000 7f77e605b700 1 --2- 172.21.15.158:0/2090065620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77e00beea0 0x7f77e01515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:23.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.752+0000 7f77e605b700 1 --2- 172.21.15.158:0/2090065620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77e00beac0 0x7f77e0153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:23.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.752+0000 7f77e605b700 1 --2- 172.21.15.158:0/2090065620 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f77e0067e50 0x7f77e014d6f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:23.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.752+0000 7f77e605b700 1 -- 172.21.15.158:0/2090065620 >> 172.21.15.158:0/2090065620 conn(0x7f77e00620d0 msgr2=0x7f77e0146bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:23.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.756+0000 7f77e605b700 1 -- 172.21.15.158:0/2090065620 shutdown_connections 2023-10-18T17:28:23.762 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:23.756+0000 7f77e605b700 1 -- 172.21.15.158:0/2090065620 wait complete. 2023-10-18T17:28:23.780 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:28:26.782 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:28:26.948 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.944+0000 7ff7e5707700 1 Processor -- start 2023-10-18T17:28:26.949 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.944+0000 7ff7e5707700 1 -- start start 2023-10-18T17:28:26.950 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.944+0000 7ff7e5707700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff7e00c2bf0 0x7ff7e0065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:26.950 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.944+0000 7ff7e5707700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff7e00bd1c0 0x7ff7e014ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:26.951 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.944+0000 7ff7e5707700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e00be2e0 con 0x7ff7e00658a0 2023-10-18T17:28:26.951 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.944+0000 7ff7e5707700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e00bda80 con 0x7ff7e00bd1c0 2023-10-18T17:28:26.951 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.944+0000 7ff7e5707700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e006a7c0 con 0x7ff7e00c2bf0 2023-10-18T17:28:26.952 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.944+0000 7ff7dffff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7ff7e00658a0 0x7ff7e00630e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:58646/0 (socket says 172.21.15.158:58646) 2023-10-18T17:28:26.953 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.944+0000 7ff7dffff700 1 -- 172.21.15.158:0/72479820 learned_addr learned my addr 172.21.15.158:0/72479820 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:28:26.953 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.944+0000 7ff7d77fe700 1 --2- 172.21.15.158:0/72479820 >> v2:172.21.15.183:3300/0 conn(0x7ff7e00c2bf0 0x7ff7e0065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:26.953 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.944+0000 7ff7e4f06700 1 --2- 172.21.15.158:0/72479820 >> v2:172.21.15.158:3300/0 conn(0x7ff7e00bd1c0 0x7ff7e014ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:26.953 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.944+0000 7ff7df7fe700 1 -- 172.21.15.158:0/72479820 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819641787 0 0) 0x7ff7e00be2e0 con 0x7ff7e00658a0 2023-10-18T17:28:26.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.948+0000 7ff7df7fe700 1 -- 172.21.15.158:0/72479820 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7cc0033f0 con 0x7ff7e00658a0 2023-10-18T17:28:26.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.948+0000 7ff7d77fe700 1 -- 172.21.15.158:0/72479820 >> v2:172.21.15.158:3300/0 conn(0x7ff7e00bd1c0 msgr2=0x7ff7e014ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:28:26.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.948+0000 7ff7d77fe700 1 --2- 172.21.15.158:0/72479820 >> v2:172.21.15.158:3300/0 conn(0x7ff7e00bd1c0 0x7ff7e014ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:26.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.948+0000 7ff7d77fe700 1 -- 172.21.15.158:0/72479820 >> v1:172.21.15.158:6789/0 conn(0x7ff7e00658a0 legacy=0x7ff7e00630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:26.954 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.948+0000 7ff7d77fe700 1 -- 172.21.15.158:0/72479820 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e00be770 con 0x7ff7e00c2bf0 2023-10-18T17:28:26.955 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.948+0000 7ff7d77fe700 1 --2- 172.21.15.158:0/72479820 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7e00c2bf0 0x7ff7e0065c80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7ff7e00baa00 tx=0x7ff7c8009060).ready entity=mon.1 client_cookie=42c8bc81867e0d09 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:26.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.948+0000 7ff7df7fe700 1 -- 172.21.15.158:0/72479820 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c800d4a0 con 0x7ff7e00c2bf0 2023-10-18T17:28:26.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.948+0000 7ff7df7fe700 1 -- 172.21.15.158:0/72479820 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c800d600 con 0x7ff7e00c2bf0 2023-10-18T17:28:26.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.948+0000 7ff7df7fe700 1 -- 172.21.15.158:0/72479820 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c800d980 con 0x7ff7e00c2bf0 2023-10-18T17:28:26.956 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.948+0000 7ff7e5707700 1 -- 172.21.15.158:0/72479820 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7e00c2bf0 msgr2=0x7ff7e0065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:26.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.948+0000 7ff7e5707700 1 --2- 172.21.15.158:0/72479820 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7e00c2bf0 0x7ff7e0065c80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7ff7e00baa00 tx=0x7ff7c8009060).stop 2023-10-18T17:28:26.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.948+0000 7ff7e5707700 1 -- 172.21.15.158:0/72479820 shutdown_connections 2023-10-18T17:28:26.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.948+0000 7ff7e5707700 1 --2- 172.21.15.158:0/72479820 >> v2:172.21.15.158:3300/0 conn(0x7ff7e00bd1c0 0x7ff7e014ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:26.957 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.948+0000 7ff7e5707700 1 --2- 172.21.15.158:0/72479820 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7e00c2bf0 0x7ff7e0065c80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:26.958 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.948+0000 7ff7e5707700 1 -- 172.21.15.158:0/72479820 >> 172.21.15.158:0/72479820 conn(0x7ff7e0062ba0 msgr2=0x7ff7e00c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:26.958 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.948+0000 7ff7e5707700 1 -- 172.21.15.158:0/72479820 shutdown_connections 2023-10-18T17:28:26.958 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.948+0000 7ff7e5707700 1 -- 172.21.15.158:0/72479820 wait complete. 2023-10-18T17:28:26.959 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.952+0000 7ff7e5707700 1 Processor -- start 2023-10-18T17:28:26.959 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.952+0000 7ff7e5707700 1 -- start start 2023-10-18T17:28:26.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.952+0000 7ff7e5707700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff7e00658a0 0x7ff7e00b7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:26.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.952+0000 7ff7e5707700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7e00bd1c0 0x7ff7e014d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:26.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.952+0000 7ff7e5707700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7e00c2bf0 0x7ff7e014b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:26.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.952+0000 7ff7e5707700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e0152590 con 0x7ff7e00c2bf0 2023-10-18T17:28:26.960 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.952+0000 7ff7e5707700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e00a3200 con 0x7ff7e00bd1c0 2023-10-18T17:28:26.961 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.952+0000 7ff7e5707700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e015e810 con 0x7ff7e00658a0 2023-10-18T17:28:26.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.956+0000 7ff7d77fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7e00bd1c0 0x7ff7e014d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:26.962 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.956+0000 7ff7dffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff7e00658a0 0x7ff7e00b7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:26.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.956+0000 7ff7d77fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7e00bd1c0 0x7ff7e014d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:51034/0 (socket says 172.21.15.158:51034) 2023-10-18T17:28:26.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.956+0000 7ff7d77fe700 1 -- 172.21.15.158:0/2121998810 learned_addr learned my addr 172.21.15.158:0/2121998810 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:26.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.956+0000 7ff7e4f06700 1 --2- 172.21.15.158:0/2121998810 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7e00c2bf0 0x7ff7e014b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:26.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.956+0000 7ff7d77fe700 1 -- 172.21.15.158:0/2121998810 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff7e00658a0 msgr2=0x7ff7e00b7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:26.963 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.956+0000 7ff7d77fe700 1 --2- 172.21.15.158:0/2121998810 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff7e00658a0 0x7ff7e00b7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:26.964 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.956+0000 7ff7d77fe700 1 -- 172.21.15.158:0/2121998810 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7e00c2bf0 msgr2=0x7ff7e014b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:26.964 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.956+0000 7ff7d77fe700 1 --2- 172.21.15.158:0/2121998810 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7e00c2bf0 0x7ff7e014b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:26.964 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.956+0000 7ff7d77fe700 1 -- 172.21.15.158:0/2121998810 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c80092a0 con 0x7ff7e00bd1c0 2023-10-18T17:28:26.964 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.956+0000 7ff7d77fe700 1 --2- 172.21.15.158:0/2121998810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7e00bd1c0 0x7ff7e014d7f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7ff7c8011fb0 tx=0x7ff7c8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:26.965 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.956+0000 7ff7dcff9700 1 -- 172.21.15.158:0/2121998810 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c800dd30 con 0x7ff7e00bd1c0 2023-10-18T17:28:26.965 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.956+0000 7ff7dcff9700 1 -- 172.21.15.158:0/2121998810 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c800de90 con 0x7ff7e00bd1c0 2023-10-18T17:28:26.965 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.956+0000 7ff7e5707700 1 -- 172.21.15.158:0/2121998810 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e0151440 con 0x7ff7e00bd1c0 2023-10-18T17:28:26.965 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.956+0000 7ff7dcff9700 1 -- 172.21.15.158:0/2121998810 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c800d980 con 0x7ff7e00bd1c0 2023-10-18T17:28:26.965 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.956+0000 7ff7e5707700 1 -- 172.21.15.158:0/2121998810 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e015e530 con 0x7ff7e00bd1c0 2023-10-18T17:28:26.966 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.956+0000 7ff7e5707700 1 -- 172.21.15.158:0/2121998810 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e0067010 con 0x7ff7e00bd1c0 2023-10-18T17:28:26.966 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.960+0000 7ff7dcff9700 1 -- 172.21.15.158:0/2121998810 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff7c801d640 con 0x7ff7e00bd1c0 2023-10-18T17:28:26.967 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.960+0000 7ff7dcff9700 1 --2- 172.21.15.158:0/2121998810 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff7c005a510 0x7ff7c005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:26.967 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.960+0000 7ff7dcff9700 1 -- 172.21.15.158:0/2121998810 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7ff7c8076190 con 0x7ff7e00bd1c0 2023-10-18T17:28:26.968 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.960+0000 7ff7dffff700 1 --2- 172.21.15.158:0/2121998810 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff7c005a510 0x7ff7c005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:26.968 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.964+0000 7ff7dffff700 1 --2- 172.21.15.158:0/2121998810 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff7c005a510 0x7ff7c005c9d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7ff7d0005750 tx=0x7ff7d0009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:26.975 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:26.968+0000 7ff7dcff9700 1 -- 172.21.15.158:0/2121998810 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7ff7e0067010 con 0x7ff7e00bd1c0 2023-10-18T17:28:27.171 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:27.164+0000 7ff7e5707700 1 -- 172.21.15.158:0/2121998810 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff7e0067010 con 0x7ff7e00bd1c0 2023-10-18T17:28:27.172 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:27.168+0000 7ff7dcff9700 1 -- 172.21.15.158:0/2121998810 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7ff7e0067010 con 0x7ff7e00bd1c0 2023-10-18T17:28:27.173 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:28:27.175 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:27.168+0000 7ff7e5707700 1 -- 172.21.15.158:0/2121998810 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff7c005a510 msgr2=0x7ff7c005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:27.175 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:27.168+0000 7ff7e5707700 1 --2- 172.21.15.158:0/2121998810 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff7c005a510 0x7ff7c005c9d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7ff7d0005750 tx=0x7ff7d0009040).stop 2023-10-18T17:28:27.175 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:27.168+0000 7ff7e5707700 1 -- 172.21.15.158:0/2121998810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7e00bd1c0 msgr2=0x7ff7e014d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:27.175 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:27.168+0000 7ff7e5707700 1 --2- 172.21.15.158:0/2121998810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7e00bd1c0 0x7ff7e014d7f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7ff7c8011fb0 tx=0x7ff7c8016000).stop 2023-10-18T17:28:27.175 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:27.168+0000 7ff7e5707700 1 -- 172.21.15.158:0/2121998810 shutdown_connections 2023-10-18T17:28:27.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:27.168+0000 7ff7e5707700 1 --2- 172.21.15.158:0/2121998810 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff7c005a510 0x7ff7c005c9d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:27.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:27.168+0000 7ff7e5707700 1 --2- 172.21.15.158:0/2121998810 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff7e00c2bf0 0x7ff7e014b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:27.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:27.168+0000 7ff7e5707700 1 --2- 172.21.15.158:0/2121998810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7e00bd1c0 0x7ff7e014d7f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:27.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:27.168+0000 7ff7e5707700 1 --2- 172.21.15.158:0/2121998810 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff7e00658a0 0x7ff7e00b7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:27.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:27.168+0000 7ff7e5707700 1 -- 172.21.15.158:0/2121998810 >> 172.21.15.158:0/2121998810 conn(0x7ff7e0062ba0 msgr2=0x7ff7e014e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:27.177 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:27.168+0000 7ff7e5707700 1 -- 172.21.15.158:0/2121998810 shutdown_connections 2023-10-18T17:28:27.177 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:27.168+0000 7ff7e5707700 1 -- 172.21.15.158:0/2121998810 wait complete. 2023-10-18T17:28:27.198 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:28:30.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~204s 2023-10-18T17:28:30.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~258s 2023-10-18T17:28:30.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~184s 2023-10-18T17:28:30.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~171s 2023-10-18T17:28:30.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~217s 2023-10-18T17:28:30.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~158s 2023-10-18T17:28:30.198 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:28:30.358 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.352+0000 7f6ccf507700 1 Processor -- start 2023-10-18T17:28:30.358 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.352+0000 7f6ccf507700 1 -- start start 2023-10-18T17:28:30.361 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccf507700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6cc80bd1c0 0x7f6cc8065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:30.361 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccf507700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc80be2e0 con 0x7f6cc80c2bf0 2023-10-18T17:28:30.361 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccf507700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc80be770 con 0x7f6cc80658a0 2023-10-18T17:28:30.362 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccf507700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc80bda80 con 0x7f6cc80bd1c0 2023-10-18T17:28:30.364 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccdd04700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f6cc80c2bf0 0x7f6cc814ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:40564/0 (socket says 172.21.15.158:40564) 2023-10-18T17:28:30.364 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccdd04700 1 -- 172.21.15.158:0/2664618408 learned_addr learned my addr 172.21.15.158:0/2664618408 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:28:30.364 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6cce505700 1 --1- 172.21.15.158:0/2664618408 >> v1:172.21.15.183:6789/0 conn(0x7f6cc80658a0 0x7f6cc80630e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:36966/0 (socket says 172.21.15.158:36966) 2023-10-18T17:28:30.365 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6cced06700 1 --2- 172.21.15.158:0/2664618408 >> v2:172.21.15.183:3300/0 conn(0x7f6cc80bd1c0 0x7f6cc8065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:30.365 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccd503700 1 -- 172.21.15.158:0/2664618408 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 214320482 0 0) 0x7f6cc80be770 con 0x7f6cc80658a0 2023-10-18T17:28:30.365 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccd503700 1 -- 172.21.15.158:0/2664618408 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cb40033f0 con 0x7f6cc80658a0 2023-10-18T17:28:30.365 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccd503700 1 -- 172.21.15.158:0/2664618408 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206170049 0 0) 0x7f6cc80be2e0 con 0x7f6cc80c2bf0 2023-10-18T17:28:30.365 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccd503700 1 -- 172.21.15.158:0/2664618408 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cc80be770 con 0x7f6cc80c2bf0 2023-10-18T17:28:30.366 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccd503700 1 -- 172.21.15.158:0/2664618408 <== mon.0 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 567945811 0 0) 0x7f6cc80be770 con 0x7f6cc80c2bf0 2023-10-18T17:28:30.366 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccd503700 1 -- 172.21.15.158:0/2664618408 >> v2:172.21.15.183:3300/0 conn(0x7f6cc80bd1c0 msgr2=0x7f6cc8065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:28:30.366 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccd503700 1 --2- 172.21.15.158:0/2664618408 >> v2:172.21.15.183:3300/0 conn(0x7f6cc80bd1c0 0x7f6cc8065c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:30.366 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccd503700 1 -- 172.21.15.158:0/2664618408 >> v1:172.21.15.183:6789/0 conn(0x7f6cc80658a0 legacy=0x7f6cc80630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:30.367 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccd503700 1 -- 172.21.15.158:0/2664618408 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc80b9580 con 0x7f6cc80c2bf0 2023-10-18T17:28:30.367 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccd503700 1 -- 172.21.15.158:0/2664618408 <== mon.0 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2074596555 0 0) 0x7f6cb8001470 con 0x7f6cc80c2bf0 2023-10-18T17:28:30.367 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccd503700 1 -- 172.21.15.158:0/2664618408 >> v1:172.21.15.158:6789/0 conn(0x7f6cc80c2bf0 legacy=0x7f6cc814ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:30.367 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccd503700 1 --2- 172.21.15.158:0/2664618408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cb4004b00 0x7f6cb4004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:30.367 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccd503700 1 --2- 172.21.15.158:0/2664618408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cb4003630 0x7f6cb4003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:30.368 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccd503700 1 --2- 172.21.15.158:0/2664618408 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6cb4003fa0 0x7f6cb400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:30.368 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccd503700 1 -- 172.21.15.158:0/2664618408 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc4001160 con 0x7f6cb4003fa0 2023-10-18T17:28:30.368 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccd503700 1 -- 172.21.15.158:0/2664618408 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc80bda80 con 0x7f6cb4004b00 2023-10-18T17:28:30.368 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.356+0000 7f6ccd503700 1 -- 172.21.15.158:0/2664618408 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb400bf00 con 0x7f6cb4003630 2023-10-18T17:28:30.368 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6ccdd04700 1 --2- 172.21.15.158:0/2664618408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cb4003630 0x7f6cb4003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:30.369 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6cced06700 1 --2- 172.21.15.158:0/2664618408 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6cb4003fa0 0x7f6cb400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:30.369 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6cce505700 1 --2- 172.21.15.158:0/2664618408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cb4004b00 0x7f6cb4004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:30.369 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6ccdd04700 1 -- 172.21.15.158:0/2664618408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cb4004b00 msgr2=0x7f6cb4004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:28:30.369 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6ccdd04700 1 --2- 172.21.15.158:0/2664618408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cb4004b00 0x7f6cb4004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:30.369 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6ccdd04700 1 -- 172.21.15.158:0/2664618408 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6cb4003fa0 msgr2=0x7f6cb400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:28:30.369 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6ccdd04700 1 --2- 172.21.15.158:0/2664618408 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6cb4003fa0 0x7f6cb400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:30.370 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6ccdd04700 1 -- 172.21.15.158:0/2664618408 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc80be770 con 0x7f6cb4003630 2023-10-18T17:28:30.370 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6cced06700 1 -- 172.21.15.158:0/2664618408 reap_dead start 2023-10-18T17:28:30.373 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6ccdd04700 1 --2- 172.21.15.158:0/2664618408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cb4003630 0x7f6cb4003ab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f6cb8007f70 tx=0x7f6cc80ba290).ready entity=mon.2 client_cookie=d00a9edd126068c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:30.373 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6ccd503700 1 -- 172.21.15.158:0/2664618408 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb80078b0 con 0x7f6cb4003630 2023-10-18T17:28:30.373 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6ccd503700 1 -- 172.21.15.158:0/2664618408 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb80070d0 con 0x7f6cb4003630 2023-10-18T17:28:30.373 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6ccd503700 1 -- 172.21.15.158:0/2664618408 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8007490 con 0x7f6cb4003630 2023-10-18T17:28:30.373 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6ccf507700 1 -- 172.21.15.158:0/2664618408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cb4003630 msgr2=0x7f6cb4003ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:30.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6ccf507700 1 --2- 172.21.15.158:0/2664618408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cb4003630 0x7f6cb4003ab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f6cb8007f70 tx=0x7f6cc80ba290).stop 2023-10-18T17:28:30.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6ccf507700 1 -- 172.21.15.158:0/2664618408 shutdown_connections 2023-10-18T17:28:30.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6ccf507700 1 --2- 172.21.15.158:0/2664618408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cb4003630 0x7f6cb4003ab0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:30.374 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6ccf507700 1 -- 172.21.15.158:0/2664618408 >> 172.21.15.158:0/2664618408 conn(0x7f6cc8062ba0 msgr2=0x7f6cc80c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:30.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6ccf507700 1 -- 172.21.15.158:0/2664618408 shutdown_connections 2023-10-18T17:28:30.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.360+0000 7f6ccf507700 1 -- 172.21.15.158:0/2664618408 wait complete. 2023-10-18T17:28:30.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.364+0000 7f6ccf507700 1 Processor -- start 2023-10-18T17:28:30.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.364+0000 7f6ccf507700 1 -- start start 2023-10-18T17:28:30.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.364+0000 7f6ccf507700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6cb4003630 0x7f6cc81490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:30.375 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.364+0000 7f6ccf507700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cc815d860 0x7f6cc8148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:30.376 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.364+0000 7f6ccf507700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cc815dca0 0x7f6cc8148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:30.376 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.364+0000 7f6ccf507700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc8148f30 con 0x7f6cb4003630 2023-10-18T17:28:30.376 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.364+0000 7f6ccf507700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc8150bb0 con 0x7f6cc815dca0 2023-10-18T17:28:30.376 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.364+0000 7f6ccf507700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc81507e0 con 0x7f6cc815d860 2023-10-18T17:28:30.376 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.364+0000 7f6cce505700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6cb4003630 0x7f6cc81490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:30.377 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.364+0000 7f6cced06700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cc815dca0 0x7f6cc8148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:30.377 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.364+0000 7f6cce505700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6cb4003630 0x7f6cc81490c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:39442/0 (socket says 172.21.15.158:39442) 2023-10-18T17:28:30.377 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.364+0000 7f6cce505700 1 -- 172.21.15.158:0/2702397136 learned_addr learned my addr 172.21.15.158:0/2702397136 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:30.377 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.364+0000 7f6ccdd04700 1 --2- 172.21.15.158:0/2702397136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cc815d860 0x7f6cc8148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:30.377 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.364+0000 7f6cce505700 1 -- 172.21.15.158:0/2702397136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cc815d860 msgr2=0x7f6cc8148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:30.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.364+0000 7f6cce505700 1 --2- 172.21.15.158:0/2702397136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cc815d860 0x7f6cc8148550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:30.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.364+0000 7f6cce505700 1 -- 172.21.15.158:0/2702397136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cc815dca0 msgr2=0x7f6cc8148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:30.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.364+0000 7f6cce505700 1 --2- 172.21.15.158:0/2702397136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cc815dca0 0x7f6cc8148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:30.378 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.364+0000 7f6cce505700 1 -- 172.21.15.158:0/2702397136 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc815e200 con 0x7f6cb4003630 2023-10-18T17:28:30.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.368+0000 7f6cce505700 1 --2- 172.21.15.158:0/2702397136 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6cb4003630 0x7f6cc81490c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f6cc400e9f0 tx=0x7f6cc4001c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:30.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.368+0000 7f6cbe7fc700 1 -- 172.21.15.158:0/2702397136 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc400c5b0 con 0x7f6cb4003630 2023-10-18T17:28:30.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.368+0000 7f6cbe7fc700 1 -- 172.21.15.158:0/2702397136 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc400c710 con 0x7f6cb4003630 2023-10-18T17:28:30.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.368+0000 7f6cbe7fc700 1 -- 172.21.15.158:0/2702397136 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc400ca90 con 0x7f6cb4003630 2023-10-18T17:28:30.379 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.368+0000 7f6ccf507700 1 -- 172.21.15.158:0/2702397136 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc815e4a0 con 0x7f6cb4003630 2023-10-18T17:28:30.380 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.368+0000 7f6ccf507700 1 -- 172.21.15.158:0/2702397136 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc8150130 con 0x7f6cb4003630 2023-10-18T17:28:30.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.368+0000 7f6ccf507700 1 -- 172.21.15.158:0/2702397136 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc8046f00 con 0x7f6cb4003630 2023-10-18T17:28:30.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.368+0000 7f6cbe7fc700 1 -- 172.21.15.158:0/2702397136 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6cc4014430 con 0x7f6cb4003630 2023-10-18T17:28:30.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.372+0000 7f6cbe7fc700 1 --2- 172.21.15.158:0/2702397136 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6cac05a510 0x7f6cac05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:30.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.372+0000 7f6cbe7fc700 1 -- 172.21.15.158:0/2702397136 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f6cc40749b0 con 0x7f6cb4003630 2023-10-18T17:28:30.381 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.372+0000 7f6ccdd04700 1 --2- 172.21.15.158:0/2702397136 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6cac05a510 0x7f6cac05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:30.382 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.372+0000 7f6ccdd04700 1 --2- 172.21.15.158:0/2702397136 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6cac05a510 0x7f6cac05c9d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f6cb800c8a0 tx=0x7f6cb8015000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:30.383 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.376+0000 7f6cbe7fc700 1 -- 172.21.15.158:0/2702397136 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f6cc4047e10 con 0x7f6cb4003630 2023-10-18T17:28:30.574 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.568+0000 7f6ccf507700 1 -- 172.21.15.158:0/2702397136 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6cc80b9360 con 0x7f6cb4003630 2023-10-18T17:28:30.575 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.568+0000 7f6cbe7fc700 1 -- 172.21.15.158:0/2702397136 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f6cc404b430 con 0x7f6cb4003630 2023-10-18T17:28:30.575 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:28:30.578 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.572+0000 7f6ccf507700 1 -- 172.21.15.158:0/2702397136 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6cac05a510 msgr2=0x7f6cac05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:30.578 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.572+0000 7f6ccf507700 1 --2- 172.21.15.158:0/2702397136 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6cac05a510 0x7f6cac05c9d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f6cb800c8a0 tx=0x7f6cb8015000).stop 2023-10-18T17:28:30.578 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.572+0000 7f6ccf507700 1 -- 172.21.15.158:0/2702397136 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6cb4003630 msgr2=0x7f6cc81490c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:30.578 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.572+0000 7f6ccf507700 1 --2- 172.21.15.158:0/2702397136 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6cb4003630 0x7f6cc81490c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f6cc400e9f0 tx=0x7f6cc4001c20).stop 2023-10-18T17:28:30.579 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.572+0000 7f6ccf507700 1 -- 172.21.15.158:0/2702397136 shutdown_connections 2023-10-18T17:28:30.579 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.572+0000 7f6ccf507700 1 --2- 172.21.15.158:0/2702397136 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6cac05a510 0x7f6cac05c9d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:30.579 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.572+0000 7f6ccf507700 1 --2- 172.21.15.158:0/2702397136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cc815dca0 0x7f6cc8148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:30.579 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.572+0000 7f6ccf507700 1 --2- 172.21.15.158:0/2702397136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cc815d860 0x7f6cc8148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:30.579 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.572+0000 7f6ccf507700 1 --2- 172.21.15.158:0/2702397136 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6cb4003630 0x7f6cc81490c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:30.580 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.572+0000 7f6ccf507700 1 -- 172.21.15.158:0/2702397136 >> 172.21.15.158:0/2702397136 conn(0x7f6cc8062ba0 msgr2=0x7f6cc814e630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:30.580 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.572+0000 7f6ccf507700 1 -- 172.21.15.158:0/2702397136 shutdown_connections 2023-10-18T17:28:30.580 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:30.572+0000 7f6ccf507700 1 -- 172.21.15.158:0/2702397136 wait complete. 2023-10-18T17:28:30.596 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:28:33.597 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:28:33.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.756+0000 7f4e0791b700 1 Processor -- start 2023-10-18T17:28:33.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.756+0000 7f4e0791b700 1 -- start start 2023-10-18T17:28:33.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.756+0000 7f4e0791b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4e000b9690 0x7f4e000b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:33.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.756+0000 7f4e0791b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e000bca50 0x7f4e0014dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:33.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.756+0000 7f4e0791b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4e00065620 0x7f4e00065a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:33.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.756+0000 7f4e0791b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e000bc480 con 0x7f4e000b9690 2023-10-18T17:28:33.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.756+0000 7f4e0791b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e00065190 con 0x7f4e00065620 2023-10-18T17:28:33.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.756+0000 7f4e0791b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e000bb920 con 0x7f4e000bca50 2023-10-18T17:28:33.766 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e05eb8700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4e00065620 0x7f4e00065a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:33.766 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e05eb8700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4e00065620 0x7f4e00065a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:54612/0 (socket says 172.21.15.158:54612) 2023-10-18T17:28:33.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e05eb8700 1 -- 172.21.15.158:0/356185470 learned_addr learned my addr 172.21.15.158:0/356185470 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:33.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e04eb6700 1 --2- 172.21.15.158:0/356185470 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e000bca50 0x7f4e0014dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:33.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e056b7700 1 --2- 172.21.15.158:0/356185470 >> v2:172.21.15.158:3300/0 conn(0x7f4e000b9690 0x7f4e000b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:33.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e05eb8700 1 -- 172.21.15.158:0/356185470 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e000bca50 msgr2=0x7f4e0014dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:28:33.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e05eb8700 1 --2- 172.21.15.158:0/356185470 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e000bca50 0x7f4e0014dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:33.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e05eb8700 1 -- 172.21.15.158:0/356185470 >> v2:172.21.15.158:3300/0 conn(0x7f4e000b9690 msgr2=0x7f4e000b9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:28:33.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e05eb8700 1 --2- 172.21.15.158:0/356185470 >> v2:172.21.15.158:3300/0 conn(0x7f4e000b9690 0x7f4e000b9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:33.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e05eb8700 1 -- 172.21.15.158:0/356185470 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e000bbbe0 con 0x7f4e00065620 2023-10-18T17:28:33.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e05eb8700 1 --2- 172.21.15.158:0/356185470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e00065620 0x7f4e00065a70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f4e000b90e0 tx=0x7f4df8009840).ready entity=mon.1 client_cookie=26ab6e4666fc9ed8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:33.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4df7fff700 1 -- 172.21.15.158:0/356185470 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800e070 con 0x7f4e00065620 2023-10-18T17:28:33.769 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4df7fff700 1 -- 172.21.15.158:0/356185470 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df800ba20 con 0x7f4e00065620 2023-10-18T17:28:33.769 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4df7fff700 1 -- 172.21.15.158:0/356185470 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800bda0 con 0x7f4e00065620 2023-10-18T17:28:33.770 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e0791b700 1 -- 172.21.15.158:0/356185470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e00065620 msgr2=0x7f4e00065a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:33.770 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e0791b700 1 --2- 172.21.15.158:0/356185470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e00065620 0x7f4e00065a70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f4e000b90e0 tx=0x7f4df8009840).stop 2023-10-18T17:28:33.770 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e0791b700 1 -- 172.21.15.158:0/356185470 shutdown_connections 2023-10-18T17:28:33.771 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e0791b700 1 --2- 172.21.15.158:0/356185470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e00065620 0x7f4e00065a70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:33.771 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e0791b700 1 --2- 172.21.15.158:0/356185470 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e000bca50 0x7f4e0014dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:33.771 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e0791b700 1 --2- 172.21.15.158:0/356185470 >> v2:172.21.15.158:3300/0 conn(0x7f4e000b9690 0x7f4e000b9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:33.771 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e0791b700 1 -- 172.21.15.158:0/356185470 >> 172.21.15.158:0/356185470 conn(0x7f4e000620d0 msgr2=0x7f4e000624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:33.771 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e0791b700 1 -- 172.21.15.158:0/356185470 shutdown_connections 2023-10-18T17:28:33.772 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.760+0000 7f4e0791b700 1 -- 172.21.15.158:0/356185470 wait complete. 2023-10-18T17:28:33.772 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.764+0000 7f4e0791b700 1 Processor -- start 2023-10-18T17:28:33.773 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.764+0000 7f4e0791b700 1 -- start start 2023-10-18T17:28:33.773 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4e0791b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e00065620 0x7f4e0014cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:33.774 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4e0791b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e000b9690 0x7f4e000bd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:33.774 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4e0791b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e0014d280 0x7f4e000bdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:33.774 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4e0791b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e00068710 con 0x7f4e0014d280 2023-10-18T17:28:33.774 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4e0791b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0014c250 con 0x7f4e00065620 2023-10-18T17:28:33.774 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4e0791b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e00069c20 con 0x7f4e000b9690 2023-10-18T17:28:33.776 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4e056b7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e00065620 0x7f4e0014cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:33.776 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4e056b7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e00065620 0x7f4e0014cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:54620/0 (socket says 172.21.15.158:54620) 2023-10-18T17:28:33.776 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4e056b7700 1 -- 172.21.15.158:0/2286928395 learned_addr learned my addr 172.21.15.158:0/2286928395 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:33.777 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4e04eb6700 1 --2- 172.21.15.158:0/2286928395 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e000b9690 0x7f4e000bd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:33.777 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4e05eb8700 1 --2- 172.21.15.158:0/2286928395 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e0014d280 0x7f4e000bdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:33.777 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4e056b7700 1 -- 172.21.15.158:0/2286928395 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e000b9690 msgr2=0x7f4e000bd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:33.777 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4e056b7700 1 --2- 172.21.15.158:0/2286928395 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e000b9690 0x7f4e000bd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:33.777 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4e056b7700 1 -- 172.21.15.158:0/2286928395 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e0014d280 msgr2=0x7f4e000bdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:33.778 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4e056b7700 1 --2- 172.21.15.158:0/2286928395 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e0014d280 0x7f4e000bdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:33.778 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4e056b7700 1 -- 172.21.15.158:0/2286928395 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df8009ae0 con 0x7f4e00065620 2023-10-18T17:28:33.778 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4e056b7700 1 --2- 172.21.15.158:0/2286928395 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e00065620 0x7f4e0014cd90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f4dfc00d890 tx=0x7f4dfc008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:33.778 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4df57fa700 1 -- 172.21.15.158:0/2286928395 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0125f0 con 0x7f4e00065620 2023-10-18T17:28:33.779 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4df57fa700 1 -- 172.21.15.158:0/2286928395 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc012750 con 0x7f4e00065620 2023-10-18T17:28:33.779 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4e0791b700 1 -- 172.21.15.158:0/2286928395 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e000be000 con 0x7f4e00065620 2023-10-18T17:28:33.779 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.768+0000 7f4df57fa700 1 -- 172.21.15.158:0/2286928395 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc012ad0 con 0x7f4e00065620 2023-10-18T17:28:33.779 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.772+0000 7f4e0791b700 1 -- 172.21.15.158:0/2286928395 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0014c480 con 0x7f4e00065620 2023-10-18T17:28:33.780 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.772+0000 7f4e0791b700 1 -- 172.21.15.158:0/2286928395 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0006c190 con 0x7f4e00065620 2023-10-18T17:28:33.780 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.772+0000 7f4df57fa700 1 -- 172.21.15.158:0/2286928395 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4dfc013480 con 0x7f4e00065620 2023-10-18T17:28:33.780 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.776+0000 7f4df57fa700 1 --2- 172.21.15.158:0/2286928395 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f4de405a510 0x7f4de405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:33.781 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.776+0000 7f4df57fa700 1 -- 172.21.15.158:0/2286928395 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f4dfc074c10 con 0x7f4e00065620 2023-10-18T17:28:33.781 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.776+0000 7f4e04eb6700 1 --2- 172.21.15.158:0/2286928395 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f4de405a510 0x7f4de405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:33.782 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.776+0000 7f4e04eb6700 1 --2- 172.21.15.158:0/2286928395 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f4de405a510 0x7f4de405c9d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f4e00154390 tx=0x7f4df0009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:33.791 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.784+0000 7f4df57fa700 1 -- 172.21.15.158:0/2286928395 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f4dfc048070 con 0x7f4e00065620 2023-10-18T17:28:33.990 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.984+0000 7f4e0791b700 1 -- 172.21.15.158:0/2286928395 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4e000bbec0 con 0x7f4e00065620 2023-10-18T17:28:33.990 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.984+0000 7f4df57fa700 1 -- 172.21.15.158:0/2286928395 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f4dfc04b690 con 0x7f4e00065620 2023-10-18T17:28:33.991 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:28:33.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.988+0000 7f4e0791b700 1 -- 172.21.15.158:0/2286928395 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f4de405a510 msgr2=0x7f4de405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:33.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.988+0000 7f4e0791b700 1 --2- 172.21.15.158:0/2286928395 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f4de405a510 0x7f4de405c9d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f4e00154390 tx=0x7f4df0009060).stop 2023-10-18T17:28:33.993 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.988+0000 7f4e0791b700 1 -- 172.21.15.158:0/2286928395 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e00065620 msgr2=0x7f4e0014cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:33.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.988+0000 7f4e0791b700 1 --2- 172.21.15.158:0/2286928395 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e00065620 0x7f4e0014cd90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f4dfc00d890 tx=0x7f4dfc008040).stop 2023-10-18T17:28:33.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.988+0000 7f4e0791b700 1 -- 172.21.15.158:0/2286928395 shutdown_connections 2023-10-18T17:28:33.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.988+0000 7f4e0791b700 1 --2- 172.21.15.158:0/2286928395 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f4de405a510 0x7f4de405c9d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:33.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.988+0000 7f4e0791b700 1 --2- 172.21.15.158:0/2286928395 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4e0014d280 0x7f4e000bdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:33.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.988+0000 7f4e0791b700 1 --2- 172.21.15.158:0/2286928395 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e000b9690 0x7f4e000bd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:33.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.988+0000 7f4e0791b700 1 --2- 172.21.15.158:0/2286928395 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e00065620 0x7f4e0014cd90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:33.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.988+0000 7f4e0791b700 1 -- 172.21.15.158:0/2286928395 >> 172.21.15.158:0/2286928395 conn(0x7f4e000620d0 msgr2=0x7f4e00146050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:33.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.988+0000 7f4e0791b700 1 -- 172.21.15.158:0/2286928395 shutdown_connections 2023-10-18T17:28:33.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:33.988+0000 7f4e0791b700 1 -- 172.21.15.158:0/2286928395 wait complete. 2023-10-18T17:28:34.014 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:28:34.449 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:28:34.457 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:28:36.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~210s 2023-10-18T17:28:36.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~264s 2023-10-18T17:28:36.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~190s 2023-10-18T17:28:36.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~177s 2023-10-18T17:28:36.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~223s 2023-10-18T17:28:36.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~164s 2023-10-18T17:28:37.016 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:28:37.174 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.168+0000 7fb0e759e700 1 Processor -- start 2023-10-18T17:28:37.175 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.168+0000 7fb0e759e700 1 -- start start 2023-10-18T17:28:37.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.172+0000 7fb0e759e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80bd1c0 0x7fb0e8065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:37.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.172+0000 7fb0e759e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e80be2e0 con 0x7fb0e80c2bf0 2023-10-18T17:28:37.176 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.172+0000 7fb0e759e700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e80be770 con 0x7fb0e80658a0 2023-10-18T17:28:37.177 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.172+0000 7fb0e759e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e80bda80 con 0x7fb0e80bd1c0 2023-10-18T17:28:37.177 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.172+0000 7fb0e6d9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80bd1c0 0x7fb0e8065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:37.178 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.172+0000 7fb0e6d9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80bd1c0 0x7fb0e8065c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:35542/0 (socket says 172.21.15.158:35542) 2023-10-18T17:28:37.178 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.172+0000 7fb0e6d9d700 1 -- 172.21.15.158:0/3815236428 learned_addr learned my addr 172.21.15.158:0/3815236428 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:37.178 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.172+0000 7fb0e659c700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fb0e80658a0 0x7fb0e80630e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:36972/0 (socket says 172.21.15.158:36972) 2023-10-18T17:28:37.179 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.172+0000 7fb0e6d9d700 1 -- 172.21.15.158:0/3815236428 >> v1:172.21.15.183:6789/0 conn(0x7fb0e80658a0 legacy=0x7fb0e80630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:37.179 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.172+0000 7fb0e6d9d700 1 -- 172.21.15.158:0/3815236428 >> v1:172.21.15.158:6789/0 conn(0x7fb0e80c2bf0 legacy=0x7fb0e814ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:37.179 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.172+0000 7fb0e6d9d700 1 -- 172.21.15.158:0/3815236428 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e80b9580 con 0x7fb0e80bd1c0 2023-10-18T17:28:37.179 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.172+0000 7fb0e6d9d700 1 --2- 172.21.15.158:0/3815236428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80bd1c0 0x7fb0e8065c80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fb0e0009860 tx=0x7fb0e00090f0).ready entity=mon.2 client_cookie=fbf5dde9a5a4b83a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:37.181 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.172+0000 7fb0e5d9b700 1 -- 172.21.15.158:0/3815236428 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e000b640 con 0x7fb0e80bd1c0 2023-10-18T17:28:37.181 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.172+0000 7fb0e5d9b700 1 -- 172.21.15.158:0/3815236428 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e000b7a0 con 0x7fb0e80bd1c0 2023-10-18T17:28:37.181 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.172+0000 7fb0e5d9b700 1 -- 172.21.15.158:0/3815236428 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e000bb20 con 0x7fb0e80bd1c0 2023-10-18T17:28:37.182 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.172+0000 7fb0e759e700 1 -- 172.21.15.158:0/3815236428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80bd1c0 msgr2=0x7fb0e8065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:37.182 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.172+0000 7fb0e759e700 1 --2- 172.21.15.158:0/3815236428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80bd1c0 0x7fb0e8065c80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fb0e0009860 tx=0x7fb0e00090f0).stop 2023-10-18T17:28:37.182 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.176+0000 7fb0e759e700 1 -- 172.21.15.158:0/3815236428 shutdown_connections 2023-10-18T17:28:37.183 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.176+0000 7fb0e759e700 1 --2- 172.21.15.158:0/3815236428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80bd1c0 0x7fb0e8065c80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:37.183 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.176+0000 7fb0e759e700 1 -- 172.21.15.158:0/3815236428 >> 172.21.15.158:0/3815236428 conn(0x7fb0e8062ba0 msgr2=0x7fb0e80c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:37.183 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.176+0000 7fb0e759e700 1 -- 172.21.15.158:0/3815236428 shutdown_connections 2023-10-18T17:28:37.183 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.176+0000 7fb0e759e700 1 -- 172.21.15.158:0/3815236428 wait complete. 2023-10-18T17:28:37.185 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.176+0000 7fb0e759e700 1 Processor -- start 2023-10-18T17:28:37.185 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.176+0000 7fb0e759e700 1 -- start start 2023-10-18T17:28:37.185 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0e759e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80658a0 0x7fb0e80a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:37.186 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0e759e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0e80bd1c0 0x7fb0e80a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:37.186 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0e759e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0e80c2bf0 0x7fb0e814b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:37.186 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0e759e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e80a6120 con 0x7fb0e80c2bf0 2023-10-18T17:28:37.186 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0e759e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e80a5f10 con 0x7fb0e80bd1c0 2023-10-18T17:28:37.187 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0e759e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e80b6540 con 0x7fb0e80658a0 2023-10-18T17:28:37.187 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0e6d9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0e80c2bf0 0x7fb0e814b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:37.187 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0e659c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80658a0 0x7fb0e80a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:37.187 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0ddd9b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0e80bd1c0 0x7fb0e80a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:37.187 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0e6d9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0e80c2bf0 0x7fb0e814b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:39466/0 (socket says 172.21.15.158:39466) 2023-10-18T17:28:37.188 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0e6d9d700 1 -- 172.21.15.158:0/3020964898 learned_addr learned my addr 172.21.15.158:0/3020964898 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:37.189 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0e6d9d700 1 -- 172.21.15.158:0/3020964898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80658a0 msgr2=0x7fb0e80a70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:37.189 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0e6d9d700 1 --2- 172.21.15.158:0/3020964898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80658a0 0x7fb0e80a70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:37.189 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0e6d9d700 1 -- 172.21.15.158:0/3020964898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0e80bd1c0 msgr2=0x7fb0e80a5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:37.190 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0e6d9d700 1 --2- 172.21.15.158:0/3020964898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0e80bd1c0 0x7fb0e80a5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:37.190 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0e6d9d700 1 -- 172.21.15.158:0/3020964898 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e0009370 con 0x7fb0e80c2bf0 2023-10-18T17:28:37.190 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0e6d9d700 1 --2- 172.21.15.158:0/3020964898 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0e80c2bf0 0x7fb0e814b1f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fb0e0011000 tx=0x7fb0e0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:37.190 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0deffd700 1 -- 172.21.15.158:0/3020964898 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e000bee0 con 0x7fb0e80c2bf0 2023-10-18T17:28:37.190 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0deffd700 1 -- 172.21.15.158:0/3020964898 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e0024470 con 0x7fb0e80c2bf0 2023-10-18T17:28:37.191 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0e759e700 1 -- 172.21.15.158:0/3020964898 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e80b6240 con 0x7fb0e80c2bf0 2023-10-18T17:28:37.191 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0deffd700 1 -- 172.21.15.158:0/3020964898 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e000bb20 con 0x7fb0e80c2bf0 2023-10-18T17:28:37.191 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.180+0000 7fb0e759e700 1 -- 172.21.15.158:0/3020964898 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e80a6610 con 0x7fb0e80c2bf0 2023-10-18T17:28:37.191 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.184+0000 7fb0e759e700 1 -- 172.21.15.158:0/3020964898 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e8046f00 con 0x7fb0e80c2bf0 2023-10-18T17:28:37.191 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.184+0000 7fb0deffd700 1 -- 172.21.15.158:0/3020964898 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb0e0021070 con 0x7fb0e80c2bf0 2023-10-18T17:28:37.192 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.184+0000 7fb0deffd700 1 --2- 172.21.15.158:0/3020964898 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb0c805a4e0 0x7fb0c805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:37.192 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.184+0000 7fb0deffd700 1 -- 172.21.15.158:0/3020964898 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fb0e00761e0 con 0x7fb0e80c2bf0 2023-10-18T17:28:37.192 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.184+0000 7fb0e659c700 1 --2- 172.21.15.158:0/3020964898 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb0c805a4e0 0x7fb0c805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:37.193 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.184+0000 7fb0e659c700 1 --2- 172.21.15.158:0/3020964898 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb0c805a4e0 0x7fb0c805c9a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fb0d8001a10 tx=0x7fb0d8001560).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:37.197 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.192+0000 7fb0deffd700 1 -- 172.21.15.158:0/3020964898 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fb0e0049760 con 0x7fb0e80c2bf0 2023-10-18T17:28:37.389 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.384+0000 7fb0e759e700 1 -- 172.21.15.158:0/3020964898 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb0e8065c80 con 0x7fb0e80c2bf0 2023-10-18T17:28:37.390 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.384+0000 7fb0deffd700 1 -- 172.21.15.158:0/3020964898 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fb0e004cd80 con 0x7fb0e80c2bf0 2023-10-18T17:28:37.390 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:28:37.392 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.388+0000 7fb0e759e700 1 -- 172.21.15.158:0/3020964898 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb0c805a4e0 msgr2=0x7fb0c805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:37.392 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.388+0000 7fb0e759e700 1 --2- 172.21.15.158:0/3020964898 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb0c805a4e0 0x7fb0c805c9a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fb0d8001a10 tx=0x7fb0d8001560).stop 2023-10-18T17:28:37.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.388+0000 7fb0e759e700 1 -- 172.21.15.158:0/3020964898 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0e80c2bf0 msgr2=0x7fb0e814b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:37.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.388+0000 7fb0e759e700 1 --2- 172.21.15.158:0/3020964898 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0e80c2bf0 0x7fb0e814b1f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fb0e0011000 tx=0x7fb0e0017000).stop 2023-10-18T17:28:37.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.388+0000 7fb0e759e700 1 -- 172.21.15.158:0/3020964898 shutdown_connections 2023-10-18T17:28:37.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.388+0000 7fb0e759e700 1 --2- 172.21.15.158:0/3020964898 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb0c805a4e0 0x7fb0c805c9a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:37.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.388+0000 7fb0e759e700 1 --2- 172.21.15.158:0/3020964898 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0e80c2bf0 0x7fb0e814b1f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:37.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.388+0000 7fb0e759e700 1 --2- 172.21.15.158:0/3020964898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0e80bd1c0 0x7fb0e80a5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:37.394 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.388+0000 7fb0e759e700 1 --2- 172.21.15.158:0/3020964898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80658a0 0x7fb0e80a70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:37.394 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.388+0000 7fb0e759e700 1 -- 172.21.15.158:0/3020964898 >> 172.21.15.158:0/3020964898 conn(0x7fb0e8062ba0 msgr2=0x7fb0e80c1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:37.394 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.388+0000 7fb0e759e700 1 -- 172.21.15.158:0/3020964898 shutdown_connections 2023-10-18T17:28:37.395 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:37.388+0000 7fb0e759e700 1 -- 172.21.15.158:0/3020964898 wait complete. 2023-10-18T17:28:37.416 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:28:40.417 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:28:40.575 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.568+0000 7f0d7359e700 1 Processor -- start 2023-10-18T17:28:40.575 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.568+0000 7f0d7359e700 1 -- start start 2023-10-18T17:28:40.576 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d7359e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d741517c0 0x7f0d7406a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:40.577 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d7359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0d740630e0 0x7f0d74065700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:40.577 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d7359e700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d74154b00 con 0x7f0d741513e0 2023-10-18T17:28:40.577 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d7359e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d74069380 con 0x7f0d740630e0 2023-10-18T17:28:40.577 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d7359e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d74154f90 con 0x7f0d741517c0 2023-10-18T17:28:40.579 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d6bfff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d741517c0 0x7f0d7406a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:40.579 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d72d9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0d740630e0 0x7f0d74065700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:40.579 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d6bfff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d741517c0 0x7f0d7406a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:55206/0 (socket says 172.21.15.158:55206) 2023-10-18T17:28:40.579 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d6bfff700 1 -- 172.21.15.158:0/1545171921 learned_addr learned my addr 172.21.15.158:0/1545171921 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:40.579 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d6bfff700 1 -- 172.21.15.158:0/1545171921 >> v2:172.21.15.158:3300/0 conn(0x7f0d740630e0 msgr2=0x7f0d74065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:28:40.580 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d6bfff700 1 --2- 172.21.15.158:0/1545171921 >> v2:172.21.15.158:3300/0 conn(0x7f0d740630e0 0x7f0d74065700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:40.580 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d6bfff700 1 -- 172.21.15.158:0/1545171921 >> v1:172.21.15.183:6789/0 conn(0x7f0d741513e0 legacy=0x7f0d74067d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:40.580 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d6bfff700 1 -- 172.21.15.158:0/1545171921 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d74068570 con 0x7f0d741517c0 2023-10-18T17:28:40.580 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d6bfff700 1 --2- 172.21.15.158:0/1545171921 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d741517c0 0x7f0d7406a040 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f0d5c006fd0 tx=0x7f0d5c0090f0).ready entity=mon.2 client_cookie=a83fc9d9c6bd5f24 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:40.580 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d71d9b700 1 -- 172.21.15.158:0/1545171921 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c00b580 con 0x7f0d741517c0 2023-10-18T17:28:40.581 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d71d9b700 1 -- 172.21.15.158:0/1545171921 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5c00b6e0 con 0x7f0d741517c0 2023-10-18T17:28:40.581 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d71d9b700 1 -- 172.21.15.158:0/1545171921 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c00ba60 con 0x7f0d741517c0 2023-10-18T17:28:40.582 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d7359e700 1 -- 172.21.15.158:0/1545171921 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d741517c0 msgr2=0x7f0d7406a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:40.582 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d7359e700 1 --2- 172.21.15.158:0/1545171921 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d741517c0 0x7f0d7406a040 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f0d5c006fd0 tx=0x7f0d5c0090f0).stop 2023-10-18T17:28:40.582 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d7359e700 1 -- 172.21.15.158:0/1545171921 shutdown_connections 2023-10-18T17:28:40.583 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d7359e700 1 --2- 172.21.15.158:0/1545171921 >> v2:172.21.15.158:3300/0 conn(0x7f0d740630e0 0x7f0d74065700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:40.583 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d7359e700 1 --2- 172.21.15.158:0/1545171921 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d741517c0 0x7f0d7406a040 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:40.583 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d7359e700 1 -- 172.21.15.158:0/1545171921 >> 172.21.15.158:0/1545171921 conn(0x7f0d74062ba0 msgr2=0x7f0d740c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:40.583 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d7359e700 1 -- 172.21.15.158:0/1545171921 shutdown_connections 2023-10-18T17:28:40.584 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.572+0000 7f0d7359e700 1 -- 172.21.15.158:0/1545171921 wait complete. 2023-10-18T17:28:40.584 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.576+0000 7f0d7359e700 1 Processor -- start 2023-10-18T17:28:40.584 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.576+0000 7f0d7359e700 1 -- start start 2023-10-18T17:28:40.586 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.576+0000 7f0d7359e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d740630e0 0x7f0d74168720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:40.586 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d7359e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d741513e0 0x7f0d741561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:40.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d7359e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d741517c0 0x7f0d7414c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:40.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d7359e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7415b350 con 0x7f0d740630e0 2023-10-18T17:28:40.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d7359e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d741566c0 con 0x7f0d741513e0 2023-10-18T17:28:40.587 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d7359e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d74168290 con 0x7f0d741517c0 2023-10-18T17:28:40.588 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d7259c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d740630e0 0x7f0d74168720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:40.588 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d7259c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d740630e0 0x7f0d74168720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:50486/0 (socket says 172.21.15.158:50486) 2023-10-18T17:28:40.588 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d7259c700 1 -- 172.21.15.158:0/2459421429 learned_addr learned my addr 172.21.15.158:0/2459421429 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:40.588 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d72d9d700 1 --2- 172.21.15.158:0/2459421429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d741517c0 0x7f0d7414c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:40.589 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d6bfff700 1 --2- 172.21.15.158:0/2459421429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d741513e0 0x7f0d741561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:40.589 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d7259c700 1 -- 172.21.15.158:0/2459421429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d741517c0 msgr2=0x7f0d7414c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:40.589 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d7259c700 1 --2- 172.21.15.158:0/2459421429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d741517c0 0x7f0d7414c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:40.589 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d7259c700 1 -- 172.21.15.158:0/2459421429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d741513e0 msgr2=0x7f0d741561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:40.589 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d7259c700 1 --2- 172.21.15.158:0/2459421429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d741513e0 0x7f0d741561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:40.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d7259c700 1 -- 172.21.15.158:0/2459421429 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c009370 con 0x7f0d740630e0 2023-10-18T17:28:40.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d6bfff700 1 --2- 172.21.15.158:0/2459421429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d741513e0 0x7f0d741561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:28:40.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d7259c700 1 --2- 172.21.15.158:0/2459421429 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d740630e0 0x7f0d74168720 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f0d6400c4c0 tx=0x7f0d64007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:40.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d6a7fc700 1 -- 172.21.15.158:0/2459421429 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64007020 con 0x7f0d740630e0 2023-10-18T17:28:40.590 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d6a7fc700 1 -- 172.21.15.158:0/2459421429 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d64001e90 con 0x7f0d740630e0 2023-10-18T17:28:40.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d6a7fc700 1 -- 172.21.15.158:0/2459421429 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d640073b0 con 0x7f0d740630e0 2023-10-18T17:28:40.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d7359e700 1 -- 172.21.15.158:0/2459421429 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7414c650 con 0x7f0d740630e0 2023-10-18T17:28:40.591 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d7359e700 1 -- 172.21.15.158:0/2459421429 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d74155900 con 0x7f0d740630e0 2023-10-18T17:28:40.592 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d7359e700 1 -- 172.21.15.158:0/2459421429 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d74063980 con 0x7f0d740630e0 2023-10-18T17:28:40.592 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.580+0000 7f0d6a7fc700 1 -- 172.21.15.158:0/2459421429 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0d640068b0 con 0x7f0d740630e0 2023-10-18T17:28:40.593 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.584+0000 7f0d6a7fc700 1 --2- 172.21.15.158:0/2459421429 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f0d5805a510 0x7f0d5805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:40.593 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.584+0000 7f0d6a7fc700 1 -- 172.21.15.158:0/2459421429 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f0d640743b0 con 0x7f0d740630e0 2023-10-18T17:28:40.593 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.584+0000 7f0d6bfff700 1 --2- 172.21.15.158:0/2459421429 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f0d5805a510 0x7f0d5805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:40.593 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.584+0000 7f0d6bfff700 1 --2- 172.21.15.158:0/2459421429 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f0d5805a510 0x7f0d5805c9d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f0d5c009130 tx=0x7f0d5c017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:40.594 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.588+0000 7f0d6a7fc700 1 -- 172.21.15.158:0/2459421429 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f0d74063980 con 0x7f0d740630e0 2023-10-18T17:28:40.789 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.784+0000 7f0d7359e700 1 -- 172.21.15.158:0/2459421429 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0d74063980 con 0x7f0d740630e0 2023-10-18T17:28:40.790 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.784+0000 7f0d6a7fc700 1 -- 172.21.15.158:0/2459421429 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f0d74063980 con 0x7f0d740630e0 2023-10-18T17:28:40.790 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:28:40.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.788+0000 7f0d7359e700 1 -- 172.21.15.158:0/2459421429 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f0d5805a510 msgr2=0x7f0d5805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:40.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.788+0000 7f0d7359e700 1 --2- 172.21.15.158:0/2459421429 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f0d5805a510 0x7f0d5805c9d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f0d5c009130 tx=0x7f0d5c017000).stop 2023-10-18T17:28:40.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.788+0000 7f0d7359e700 1 -- 172.21.15.158:0/2459421429 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d740630e0 msgr2=0x7f0d74168720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:40.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.788+0000 7f0d7359e700 1 --2- 172.21.15.158:0/2459421429 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d740630e0 0x7f0d74168720 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f0d6400c4c0 tx=0x7f0d64007e00).stop 2023-10-18T17:28:40.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.788+0000 7f0d7359e700 1 -- 172.21.15.158:0/2459421429 shutdown_connections 2023-10-18T17:28:40.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.788+0000 7f0d7359e700 1 --2- 172.21.15.158:0/2459421429 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f0d5805a510 0x7f0d5805c9d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:40.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.788+0000 7f0d7359e700 1 --2- 172.21.15.158:0/2459421429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d741517c0 0x7f0d7414c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:40.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.788+0000 7f0d7359e700 1 --2- 172.21.15.158:0/2459421429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d741513e0 0x7f0d741561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:40.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.788+0000 7f0d7359e700 1 --2- 172.21.15.158:0/2459421429 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d740630e0 0x7f0d74168720 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:40.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.788+0000 7f0d7359e700 1 -- 172.21.15.158:0/2459421429 >> 172.21.15.158:0/2459421429 conn(0x7f0d74062ba0 msgr2=0x7f0d74069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:40.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.788+0000 7f0d7359e700 1 -- 172.21.15.158:0/2459421429 shutdown_connections 2023-10-18T17:28:40.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:40.788+0000 7f0d7359e700 1 -- 172.21.15.158:0/2459421429 wait complete. 2023-10-18T17:28:40.810 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:28:42.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~216s 2023-10-18T17:28:42.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~270s 2023-10-18T17:28:42.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~196s 2023-10-18T17:28:42.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~183s 2023-10-18T17:28:42.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~230s 2023-10-18T17:28:42.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~170s 2023-10-18T17:28:43.811 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:28:43.981 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.976+0000 7f198e81b700 1 Processor -- start 2023-10-18T17:28:43.981 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.976+0000 7f198e81b700 1 -- start start 2023-10-18T17:28:43.984 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f198e81b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f19880beac0 0x7f19880beea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:43.985 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f198e81b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1988150b90 0x7f1988066150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:43.985 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f198e81b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1988066640 0x7f1988067e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:43.985 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f198e81b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19880bd9e0 con 0x7f1988066640 2023-10-18T17:28:43.985 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f198e81b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1988150fb0 con 0x7f19880beac0 2023-10-18T17:28:43.985 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f198e81b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19880bcaf0 con 0x7f1988150b90 2023-10-18T17:28:43.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f19877fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1988150b90 0x7f1988066150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:43.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f1987fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f19880beac0 0x7f19880beea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:43.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f1987fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f19880beac0 0x7f19880beea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:46428/0 (socket says 172.21.15.158:46428) 2023-10-18T17:28:43.987 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f1987fff700 1 -- 172.21.15.158:0/3744244030 learned_addr learned my addr 172.21.15.158:0/3744244030 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:43.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f198cdb8700 1 --2- 172.21.15.158:0/3744244030 >> v2:172.21.15.158:3300/0 conn(0x7f1988066640 0x7f1988067e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:43.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f1987fff700 1 -- 172.21.15.158:0/3744244030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1988150b90 msgr2=0x7f1988066150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:28:43.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f1987fff700 1 --2- 172.21.15.158:0/3744244030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1988150b90 0x7f1988066150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:43.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f1987fff700 1 -- 172.21.15.158:0/3744244030 >> v2:172.21.15.158:3300/0 conn(0x7f1988066640 msgr2=0x7f1988067e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:28:43.988 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f1987fff700 1 --2- 172.21.15.158:0/3744244030 >> v2:172.21.15.158:3300/0 conn(0x7f1988066640 0x7f1988067e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:43.989 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f1987fff700 1 -- 172.21.15.158:0/3744244030 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19880bcdd0 con 0x7f19880beac0 2023-10-18T17:28:43.989 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f1987fff700 1 --2- 172.21.15.158:0/3744244030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19880beac0 0x7f19880beea0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f1988064ac0 tx=0x7f1980009840).ready entity=mon.1 client_cookie=1fbf58a697ad777e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:43.989 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f1986ffd700 1 -- 172.21.15.158:0/3744244030 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198000e070 con 0x7f19880beac0 2023-10-18T17:28:43.989 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f1986ffd700 1 -- 172.21.15.158:0/3744244030 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198000bab0 con 0x7f19880beac0 2023-10-18T17:28:43.989 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f1986ffd700 1 -- 172.21.15.158:0/3744244030 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198000be30 con 0x7f19880beac0 2023-10-18T17:28:43.990 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f198e81b700 1 -- 172.21.15.158:0/3744244030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19880beac0 msgr2=0x7f19880beea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:43.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.980+0000 7f198e81b700 1 --2- 172.21.15.158:0/3744244030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19880beac0 0x7f19880beea0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f1988064ac0 tx=0x7f1980009840).stop 2023-10-18T17:28:43.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.984+0000 7f198e81b700 1 -- 172.21.15.158:0/3744244030 shutdown_connections 2023-10-18T17:28:43.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.984+0000 7f198e81b700 1 --2- 172.21.15.158:0/3744244030 >> v2:172.21.15.158:3300/0 conn(0x7f1988066640 0x7f1988067e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:43.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.984+0000 7f198e81b700 1 --2- 172.21.15.158:0/3744244030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1988150b90 0x7f1988066150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:43.991 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.984+0000 7f198e81b700 1 --2- 172.21.15.158:0/3744244030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19880beac0 0x7f19880beea0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:43.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.984+0000 7f198e81b700 1 -- 172.21.15.158:0/3744244030 >> 172.21.15.158:0/3744244030 conn(0x7f19880620d0 msgr2=0x7f19880624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:43.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.984+0000 7f198e81b700 1 -- 172.21.15.158:0/3744244030 shutdown_connections 2023-10-18T17:28:43.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.984+0000 7f198e81b700 1 -- 172.21.15.158:0/3744244030 wait complete. 2023-10-18T17:28:43.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.984+0000 7f198e81b700 1 Processor -- start 2023-10-18T17:28:43.992 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.984+0000 7f198e81b700 1 -- start start 2023-10-18T17:28:43.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.984+0000 7f198e81b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1988066640 0x7f198814d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:43.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.984+0000 7f198e81b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19880beac0 0x7f1988145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:43.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.984+0000 7f198e81b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1988150b90 0x7f19881461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:43.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.984+0000 7f198e81b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1988165850 con 0x7f1988066640 2023-10-18T17:28:43.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.984+0000 7f198e81b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1988168010 con 0x7f1988150b90 2023-10-18T17:28:43.995 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.984+0000 7f198e81b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19881682f0 con 0x7f19880beac0 2023-10-18T17:28:43.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.988+0000 7f1987fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1988066640 0x7f198814d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:43.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.988+0000 7f19877fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19880beac0 0x7f1988145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:43.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.988+0000 7f1987fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1988066640 0x7f198814d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:50496/0 (socket says 172.21.15.158:50496) 2023-10-18T17:28:43.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.988+0000 7f1987fff700 1 -- 172.21.15.158:0/710601961 learned_addr learned my addr 172.21.15.158:0/710601961 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:43.996 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.988+0000 7f198cdb8700 1 --2- 172.21.15.158:0/710601961 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1988150b90 0x7f19881461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:43.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.988+0000 7f1987fff700 1 -- 172.21.15.158:0/710601961 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19880beac0 msgr2=0x7f1988145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:43.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.988+0000 7f1987fff700 1 --2- 172.21.15.158:0/710601961 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19880beac0 0x7f1988145cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:43.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.988+0000 7f1987fff700 1 -- 172.21.15.158:0/710601961 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1988150b90 msgr2=0x7f19881461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:43.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.988+0000 7f1987fff700 1 --2- 172.21.15.158:0/710601961 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1988150b90 0x7f19881461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:43.997 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.988+0000 7f1987fff700 1 -- 172.21.15.158:0/710601961 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1980009ae0 con 0x7f1988066640 2023-10-18T17:28:43.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.988+0000 7f1987fff700 1 --2- 172.21.15.158:0/710601961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1988066640 0x7f198814d6c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f198000b6c0 tx=0x7f1980009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:43.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.988+0000 7f197ffff700 1 -- 172.21.15.158:0/710601961 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198000b6f0 con 0x7f1988066640 2023-10-18T17:28:43.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.988+0000 7f197ffff700 1 -- 172.21.15.158:0/710601961 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198000bc20 con 0x7f1988066640 2023-10-18T17:28:43.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.988+0000 7f198e81b700 1 -- 172.21.15.158:0/710601961 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19881685d0 con 0x7f1988066640 2023-10-18T17:28:43.998 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.988+0000 7f197ffff700 1 -- 172.21.15.158:0/710601961 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198001e6a0 con 0x7f1988066640 2023-10-18T17:28:43.999 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.988+0000 7f198e81b700 1 -- 172.21.15.158:0/710601961 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1988168b90 con 0x7f1988066640 2023-10-18T17:28:43.999 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.988+0000 7f198e81b700 1 -- 172.21.15.158:0/710601961 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198806c190 con 0x7f1988066640 2023-10-18T17:28:44.000 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.992+0000 7f197ffff700 1 -- 172.21.15.158:0/710601961 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1980003040 con 0x7f1988066640 2023-10-18T17:28:44.000 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.992+0000 7f197ffff700 1 --2- 172.21.15.158:0/710601961 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f196805a510 0x7f196805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:44.000 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.992+0000 7f197ffff700 1 -- 172.21.15.158:0/710601961 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f1980075de0 con 0x7f1988066640 2023-10-18T17:28:44.000 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.992+0000 7f19877fe700 1 --2- 172.21.15.158:0/710601961 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f196805a510 0x7f196805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:44.001 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:43.992+0000 7f19877fe700 1 --2- 172.21.15.158:0/710601961 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f196805a510 0x7f196805c9d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f198814fb40 tx=0x7f1978009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:44.005 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:44.000+0000 7f197ffff700 1 -- 172.21.15.158:0/710601961 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f1980049350 con 0x7f1988066640 2023-10-18T17:28:44.204 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:44.196+0000 7f198e81b700 1 -- 172.21.15.158:0/710601961 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f19880bd0b0 con 0x7f1988066640 2023-10-18T17:28:44.204 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:44.200+0000 7f197ffff700 1 -- 172.21.15.158:0/710601961 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f1980023070 con 0x7f1988066640 2023-10-18T17:28:44.205 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:28:44.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:44.204+0000 7f198e81b700 1 -- 172.21.15.158:0/710601961 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f196805a510 msgr2=0x7f196805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:44.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:44.204+0000 7f198e81b700 1 --2- 172.21.15.158:0/710601961 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f196805a510 0x7f196805c9d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f198814fb40 tx=0x7f1978009060).stop 2023-10-18T17:28:44.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:44.204+0000 7f198e81b700 1 -- 172.21.15.158:0/710601961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1988066640 msgr2=0x7f198814d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:44.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:44.204+0000 7f198e81b700 1 --2- 172.21.15.158:0/710601961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1988066640 0x7f198814d6c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f198000b6c0 tx=0x7f1980009840).stop 2023-10-18T17:28:44.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:44.204+0000 7f198e81b700 1 -- 172.21.15.158:0/710601961 shutdown_connections 2023-10-18T17:28:44.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:44.204+0000 7f198e81b700 1 --2- 172.21.15.158:0/710601961 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f196805a510 0x7f196805c9d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:44.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:44.204+0000 7f198e81b700 1 --2- 172.21.15.158:0/710601961 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1988150b90 0x7f19881461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:44.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:44.204+0000 7f198e81b700 1 --2- 172.21.15.158:0/710601961 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19880beac0 0x7f1988145cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:44.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:44.204+0000 7f198e81b700 1 --2- 172.21.15.158:0/710601961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1988066640 0x7f198814d6c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:44.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:44.204+0000 7f198e81b700 1 -- 172.21.15.158:0/710601961 >> 172.21.15.158:0/710601961 conn(0x7f19880620d0 msgr2=0x7f1988147fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:44.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:44.204+0000 7f198e81b700 1 -- 172.21.15.158:0/710601961 shutdown_connections 2023-10-18T17:28:44.211 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:44.204+0000 7f198e81b700 1 -- 172.21.15.158:0/710601961 wait complete. 2023-10-18T17:28:44.229 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:28:47.230 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:28:47.388 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.384+0000 7ffb4ace4700 1 Processor -- start 2023-10-18T17:28:47.389 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.384+0000 7ffb4ace4700 1 -- start start 2023-10-18T17:28:47.390 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.384+0000 7ffb4ace4700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ffb441513e0 0x7ffb44067d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:47.390 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.384+0000 7ffb4ace4700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb44154b00 con 0x7ffb440630e0 2023-10-18T17:28:47.390 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.384+0000 7ffb4ace4700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb4406a750 con 0x7ffb441517c0 2023-10-18T17:28:47.390 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.384+0000 7ffb4ace4700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb44069380 con 0x7ffb441513e0 2023-10-18T17:28:47.392 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.384+0000 7ffb4a4e3700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7ffb440630e0 0x7ffb44065700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:45588/0 (socket says 172.21.15.158:45588) 2023-10-18T17:28:47.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.384+0000 7ffb4a4e3700 1 -- 172.21.15.158:0/1950269687 learned_addr learned my addr 172.21.15.158:0/1950269687 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:28:47.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.384+0000 7ffb49ce2700 1 --2- 172.21.15.158:0/1950269687 >> v2:172.21.15.183:3300/0 conn(0x7ffb441513e0 0x7ffb44067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:47.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.384+0000 7ffb48ce0700 1 -- 172.21.15.158:0/1950269687 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720784585 0 0) 0x7ffb44154b00 con 0x7ffb440630e0 2023-10-18T17:28:47.393 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.384+0000 7ffb48ce0700 1 -- 172.21.15.158:0/1950269687 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb300033f0 con 0x7ffb440630e0 2023-10-18T17:28:47.394 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.384+0000 7ffb49ce2700 1 -- 172.21.15.158:0/1950269687 >> v1:172.21.15.183:6789/0 conn(0x7ffb441517c0 legacy=0x7ffb4406a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:47.394 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.384+0000 7ffb48ce0700 1 -- 172.21.15.158:0/1950269687 <== mon.0 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 727154293 0 0) 0x7ffb300033f0 con 0x7ffb440630e0 2023-10-18T17:28:47.394 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.384+0000 7ffb49ce2700 1 -- 172.21.15.158:0/1950269687 >> v1:172.21.15.158:6789/0 conn(0x7ffb440630e0 legacy=0x7ffb44065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:47.394 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.384+0000 7ffb49ce2700 1 -- 172.21.15.158:0/1950269687 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb44154f90 con 0x7ffb441513e0 2023-10-18T17:28:47.395 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.388+0000 7ffb49ce2700 1 --2- 172.21.15.158:0/1950269687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb441513e0 0x7ffb44067d30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7ffb40009760 tx=0x7ffb40009060).ready entity=mon.1 client_cookie=c19992c88c845e88 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:47.395 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.388+0000 7ffb48ce0700 1 -- 172.21.15.158:0/1950269687 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c0017f0 con 0x7ffb441513e0 2023-10-18T17:28:47.395 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.388+0000 7ffb48ce0700 1 -- 172.21.15.158:0/1950269687 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb40012410 con 0x7ffb441513e0 2023-10-18T17:28:47.395 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.388+0000 7ffb48ce0700 1 -- 172.21.15.158:0/1950269687 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40012790 con 0x7ffb441513e0 2023-10-18T17:28:47.396 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.388+0000 7ffb4ace4700 1 -- 172.21.15.158:0/1950269687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb441513e0 msgr2=0x7ffb44067d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:47.396 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.388+0000 7ffb4ace4700 1 --2- 172.21.15.158:0/1950269687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb441513e0 0x7ffb44067d30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7ffb40009760 tx=0x7ffb40009060).stop 2023-10-18T17:28:47.397 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.388+0000 7ffb4ace4700 1 -- 172.21.15.158:0/1950269687 shutdown_connections 2023-10-18T17:28:47.397 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.388+0000 7ffb4ace4700 1 --2- 172.21.15.158:0/1950269687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb441513e0 0x7ffb44067d30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:47.397 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.388+0000 7ffb4ace4700 1 -- 172.21.15.158:0/1950269687 >> 172.21.15.158:0/1950269687 conn(0x7ffb44062ba0 msgr2=0x7ffb440c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:47.397 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.388+0000 7ffb4ace4700 1 -- 172.21.15.158:0/1950269687 shutdown_connections 2023-10-18T17:28:47.398 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.388+0000 7ffb4ace4700 1 -- 172.21.15.158:0/1950269687 wait complete. 2023-10-18T17:28:47.398 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb4ace4700 1 Processor -- start 2023-10-18T17:28:47.399 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb4ace4700 1 -- start start 2023-10-18T17:28:47.400 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb4ace4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb440630e0 0x7ffb4414e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:47.400 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb4ace4700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb441513e0 0x7ffb4414c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:47.400 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb4ace4700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb441517c0 0x7ffb44157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:47.400 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb4ace4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4414de90 con 0x7ffb440630e0 2023-10-18T17:28:47.401 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb4ace4700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb440c17b0 con 0x7ffb441513e0 2023-10-18T17:28:47.401 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb4ace4700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4414d2a0 con 0x7ffb441517c0 2023-10-18T17:28:47.401 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb49ce2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb440630e0 0x7ffb4414e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:47.401 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb49ce2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb440630e0 0x7ffb4414e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:50512/0 (socket says 172.21.15.158:50512) 2023-10-18T17:28:47.401 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb49ce2700 1 -- 172.21.15.158:0/3509776620 learned_addr learned my addr 172.21.15.158:0/3509776620 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:47.402 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb4a4e3700 1 --2- 172.21.15.158:0/3509776620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb441517c0 0x7ffb44157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:47.402 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb494e1700 1 --2- 172.21.15.158:0/3509776620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb441513e0 0x7ffb4414c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:47.402 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb49ce2700 1 -- 172.21.15.158:0/3509776620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb441517c0 msgr2=0x7ffb44157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:47.402 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb49ce2700 1 --2- 172.21.15.158:0/3509776620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb441517c0 0x7ffb44157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:47.402 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb49ce2700 1 -- 172.21.15.158:0/3509776620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb441513e0 msgr2=0x7ffb4414c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:47.403 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb49ce2700 1 --2- 172.21.15.158:0/3509776620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb441513e0 0x7ffb4414c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:47.403 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb49ce2700 1 -- 172.21.15.158:0/3509776620 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb400092a0 con 0x7ffb440630e0 2023-10-18T17:28:47.403 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb494e1700 1 --2- 172.21.15.158:0/3509776620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb441513e0 0x7ffb4414c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:28:47.403 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.392+0000 7ffb49ce2700 1 --2- 172.21.15.158:0/3509776620 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb440630e0 0x7ffb4414e2b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7ffb40009e00 tx=0x7ffb40015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:47.404 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.396+0000 7ffb39ffb700 1 -- 172.21.15.158:0/3509776620 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40011b70 con 0x7ffb440630e0 2023-10-18T17:28:47.405 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.396+0000 7ffb39ffb700 1 -- 172.21.15.158:0/3509776620 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb40011cd0 con 0x7ffb440630e0 2023-10-18T17:28:47.405 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.396+0000 7ffb39ffb700 1 -- 172.21.15.158:0/3509776620 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4001d620 con 0x7ffb440630e0 2023-10-18T17:28:47.405 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.396+0000 7ffb4ace4700 1 -- 172.21.15.158:0/3509776620 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4414cce0 con 0x7ffb440630e0 2023-10-18T17:28:47.405 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.396+0000 7ffb4ace4700 1 -- 172.21.15.158:0/3509776620 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4414d7d0 con 0x7ffb440630e0 2023-10-18T17:28:47.406 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.396+0000 7ffb4ace4700 1 -- 172.21.15.158:0/3509776620 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb4414e100 con 0x7ffb440630e0 2023-10-18T17:28:47.406 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.396+0000 7ffb39ffb700 1 -- 172.21.15.158:0/3509776620 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ffb4001da10 con 0x7ffb440630e0 2023-10-18T17:28:47.406 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.400+0000 7ffb39ffb700 1 --2- 172.21.15.158:0/3509776620 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ffb2805a4e0 0x7ffb2805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:47.406 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.400+0000 7ffb39ffb700 1 -- 172.21.15.158:0/3509776620 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7ffb40076470 con 0x7ffb440630e0 2023-10-18T17:28:47.406 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.400+0000 7ffb494e1700 1 --2- 172.21.15.158:0/3509776620 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ffb2805a4e0 0x7ffb2805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:47.407 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.400+0000 7ffb494e1700 1 --2- 172.21.15.158:0/3509776620 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ffb2805a4e0 0x7ffb2805c9a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7ffb44159e90 tx=0x7ffb34009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:47.411 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.404+0000 7ffb39ffb700 1 -- 172.21.15.158:0/3509776620 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7ffb400499f0 con 0x7ffb440630e0 2023-10-18T17:28:47.603 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.596+0000 7ffb4ace4700 1 -- 172.21.15.158:0/3509776620 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ffb4414e100 con 0x7ffb440630e0 2023-10-18T17:28:47.604 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.600+0000 7ffb39ffb700 1 -- 172.21.15.158:0/3509776620 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7ffb4004d010 con 0x7ffb440630e0 2023-10-18T17:28:47.605 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:28:47.607 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.600+0000 7ffb4ace4700 1 -- 172.21.15.158:0/3509776620 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ffb2805a4e0 msgr2=0x7ffb2805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:47.608 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.600+0000 7ffb4ace4700 1 --2- 172.21.15.158:0/3509776620 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ffb2805a4e0 0x7ffb2805c9a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7ffb44159e90 tx=0x7ffb34009040).stop 2023-10-18T17:28:47.608 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.600+0000 7ffb4ace4700 1 -- 172.21.15.158:0/3509776620 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb440630e0 msgr2=0x7ffb4414e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:47.608 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.600+0000 7ffb4ace4700 1 --2- 172.21.15.158:0/3509776620 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb440630e0 0x7ffb4414e2b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7ffb40009e00 tx=0x7ffb40015000).stop 2023-10-18T17:28:47.608 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.600+0000 7ffb4ace4700 1 -- 172.21.15.158:0/3509776620 shutdown_connections 2023-10-18T17:28:47.608 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.600+0000 7ffb4ace4700 1 --2- 172.21.15.158:0/3509776620 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ffb2805a4e0 0x7ffb2805c9a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:47.609 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.600+0000 7ffb4ace4700 1 --2- 172.21.15.158:0/3509776620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb441517c0 0x7ffb44157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:47.609 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.600+0000 7ffb4ace4700 1 --2- 172.21.15.158:0/3509776620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb441513e0 0x7ffb4414c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:47.609 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.600+0000 7ffb4ace4700 1 --2- 172.21.15.158:0/3509776620 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffb440630e0 0x7ffb4414e2b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:47.609 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.600+0000 7ffb4ace4700 1 -- 172.21.15.158:0/3509776620 >> 172.21.15.158:0/3509776620 conn(0x7ffb44062ba0 msgr2=0x7ffb44069f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:47.609 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.600+0000 7ffb4ace4700 1 -- 172.21.15.158:0/3509776620 shutdown_connections 2023-10-18T17:28:47.610 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:47.600+0000 7ffb4ace4700 1 -- 172.21.15.158:0/3509776620 wait complete. 2023-10-18T17:28:47.626 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:28:48.993 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~222s 2023-10-18T17:28:48.993 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~277s 2023-10-18T17:28:48.993 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~203s 2023-10-18T17:28:48.993 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~190s 2023-10-18T17:28:48.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~236s 2023-10-18T17:28:48.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~177s 2023-10-18T17:28:50.627 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:28:50.787 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.780+0000 7f34ae61b700 1 Processor -- start 2023-10-18T17:28:50.788 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.780+0000 7f34ae61b700 1 -- start start 2023-10-18T17:28:50.791 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.784+0000 7f34ae61b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34a80beea0 0x7f34a8150b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:50.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.784+0000 7f34ae61b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f34a8067e50 0x7f34a8068290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:50.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.784+0000 7f34ae61b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a80bd9e0 con 0x7f34a80beac0 2023-10-18T17:28:50.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.784+0000 7f34ae61b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a8151080 con 0x7f34a8067e50 2023-10-18T17:28:50.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.784+0000 7f34ae61b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8068780 con 0x7f34a80beea0 2023-10-18T17:28:50.792 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.784+0000 7f34a7fff700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f34a80beac0 0x7f34a8066150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:45132/0 (socket says 172.21.15.158:45132) 2023-10-18T17:28:50.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.784+0000 7f34a7fff700 1 -- 172.21.15.158:0/2558328407 learned_addr learned my addr 172.21.15.158:0/2558328407 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:28:50.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.784+0000 7f34acbb8700 1 --2- 172.21.15.158:0/2558328407 >> v2:172.21.15.183:3300/0 conn(0x7f34a8067e50 0x7f34a8068290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:50.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.784+0000 7f34a77fe700 1 --2- 172.21.15.158:0/2558328407 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34a80beea0 0x7f34a8150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:50.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.788+0000 7f34acbb8700 1 -- 172.21.15.158:0/2558328407 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34a80beea0 msgr2=0x7f34a8150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:28:50.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.788+0000 7f34acbb8700 1 --2- 172.21.15.158:0/2558328407 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34a80beea0 0x7f34a8150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:50.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.788+0000 7f34acbb8700 1 -- 172.21.15.158:0/2558328407 >> v1:172.21.15.183:6789/0 conn(0x7f34a80beac0 legacy=0x7f34a8066150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:50.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.788+0000 7f34acbb8700 1 -- 172.21.15.158:0/2558328407 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a80bcaf0 con 0x7f34a8067e50 2023-10-18T17:28:50.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.788+0000 7f34a6ffd700 1 -- 172.21.15.158:0/2558328407 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911430808 0 0) 0x7f34a80bd9e0 con 0x7f34a80beac0 2023-10-18T17:28:50.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.788+0000 7f34acbb8700 1 --2- 172.21.15.158:0/2558328407 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34a8067e50 0x7f34a8068290 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f34a0009e60 tx=0x7f34a0009780).ready entity=mon.1 client_cookie=c1ec8dfc1b0bd30 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:50.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.788+0000 7f34a6ffd700 1 -- 172.21.15.158:0/2558328407 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a000e070 con 0x7f34a8067e50 2023-10-18T17:28:50.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.788+0000 7f34a6ffd700 1 -- 172.21.15.158:0/2558328407 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a000bcc0 con 0x7f34a8067e50 2023-10-18T17:28:50.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.788+0000 7f34a6ffd700 1 -- 172.21.15.158:0/2558328407 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0012620 con 0x7f34a8067e50 2023-10-18T17:28:50.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.788+0000 7f34ae61b700 1 -- 172.21.15.158:0/2558328407 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34a8067e50 msgr2=0x7f34a8068290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:50.797 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.788+0000 7f34ae61b700 1 --2- 172.21.15.158:0/2558328407 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34a8067e50 0x7f34a8068290 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f34a0009e60 tx=0x7f34a0009780).stop 2023-10-18T17:28:50.797 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.788+0000 7f34ae61b700 1 -- 172.21.15.158:0/2558328407 shutdown_connections 2023-10-18T17:28:50.797 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.788+0000 7f34ae61b700 1 --2- 172.21.15.158:0/2558328407 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34a8067e50 0x7f34a8068290 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:50.797 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.788+0000 7f34ae61b700 1 --2- 172.21.15.158:0/2558328407 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34a80beea0 0x7f34a8150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:50.797 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.788+0000 7f34ae61b700 1 -- 172.21.15.158:0/2558328407 >> 172.21.15.158:0/2558328407 conn(0x7f34a80620d0 msgr2=0x7f34a80624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:50.798 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.788+0000 7f34ae61b700 1 -- 172.21.15.158:0/2558328407 shutdown_connections 2023-10-18T17:28:50.798 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.788+0000 7f34ae61b700 1 -- 172.21.15.158:0/2558328407 wait complete. 2023-10-18T17:28:50.799 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.792+0000 7f34ae61b700 1 Processor -- start 2023-10-18T17:28:50.799 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.792+0000 7f34ae61b700 1 -- start start 2023-10-18T17:28:50.801 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.792+0000 7f34ae61b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34a8067e50 0x7f34a814eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:50.801 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.792+0000 7f34ae61b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34a80beac0 0x7f34a80c10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:50.801 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.792+0000 7f34ae61b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34a80beea0 0x7f34a8151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:50.801 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.792+0000 7f34ae61b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80c07f0 con 0x7f34a80beac0 2023-10-18T17:28:50.802 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.792+0000 7f34ae61b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a814e630 con 0x7f34a80beea0 2023-10-18T17:28:50.802 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.792+0000 7f34ae61b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8152250 con 0x7f34a8067e50 2023-10-18T17:28:50.802 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.796+0000 7f34a77fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34a80beac0 0x7f34a80c10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:50.802 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.796+0000 7f34a7fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34a8067e50 0x7f34a814eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:50.803 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.796+0000 7f34a77fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34a80beac0 0x7f34a80c10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:45608/0 (socket says 172.21.15.158:45608) 2023-10-18T17:28:50.803 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.796+0000 7f34a77fe700 1 -- 172.21.15.158:0/1542557190 learned_addr learned my addr 172.21.15.158:0/1542557190 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:50.803 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.796+0000 7f34acbb8700 1 --2- 172.21.15.158:0/1542557190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34a80beea0 0x7f34a8151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:50.803 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.796+0000 7f34a77fe700 1 -- 172.21.15.158:0/1542557190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34a8067e50 msgr2=0x7f34a814eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:50.803 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.796+0000 7f34a77fe700 1 --2- 172.21.15.158:0/1542557190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34a8067e50 0x7f34a814eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:50.804 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.796+0000 7f34a77fe700 1 -- 172.21.15.158:0/1542557190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34a80beea0 msgr2=0x7f34a8151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:50.804 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.796+0000 7f34a77fe700 1 --2- 172.21.15.158:0/1542557190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34a80beea0 0x7f34a8151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:50.804 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.796+0000 7f34a77fe700 1 -- 172.21.15.158:0/1542557190 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0009a20 con 0x7f34a80beac0 2023-10-18T17:28:50.804 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.796+0000 7f34a77fe700 1 --2- 172.21.15.158:0/1542557190 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34a80beac0 0x7f34a80c10a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f349c00d890 tx=0x7f349c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:50.805 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.796+0000 7f348ffff700 1 -- 172.21.15.158:0/1542557190 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c011590 con 0x7f34a80beac0 2023-10-18T17:28:50.805 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.796+0000 7f348ffff700 1 -- 172.21.15.158:0/1542557190 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c0116f0 con 0x7f34a80beac0 2023-10-18T17:28:50.805 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.796+0000 7f348ffff700 1 -- 172.21.15.158:0/1542557190 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c011a70 con 0x7f34a80beac0 2023-10-18T17:28:50.805 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.796+0000 7f34ae61b700 1 -- 172.21.15.158:0/1542557190 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a814f910 con 0x7f34a80beac0 2023-10-18T17:28:50.806 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.796+0000 7f34ae61b700 1 -- 172.21.15.158:0/1542557190 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a814fed0 con 0x7f34a80beac0 2023-10-18T17:28:50.806 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.796+0000 7f34ae61b700 1 -- 172.21.15.158:0/1542557190 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a814e7e0 con 0x7f34a80beac0 2023-10-18T17:28:50.807 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.800+0000 7f348ffff700 1 -- 172.21.15.158:0/1542557190 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f349c012420 con 0x7f34a80beac0 2023-10-18T17:28:50.807 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.800+0000 7f348ffff700 1 --2- 172.21.15.158:0/1542557190 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f349405a560 0x7f349405ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:50.808 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.800+0000 7f348ffff700 1 -- 172.21.15.158:0/1542557190 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f349c074310 con 0x7f34a80beac0 2023-10-18T17:28:50.808 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.800+0000 7f34a7fff700 1 --2- 172.21.15.158:0/1542557190 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f349405a560 0x7f349405ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:50.809 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.800+0000 7f34a7fff700 1 --2- 172.21.15.158:0/1542557190 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f349405a560 0x7f349405ca20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f34980011e0 tx=0x7f3498007b90).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:50.815 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:50.808+0000 7f348ffff700 1 -- 172.21.15.158:0/1542557190 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f34a814e7e0 con 0x7f34a80beac0 2023-10-18T17:28:51.018 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:51.012+0000 7f34ae61b700 1 -- 172.21.15.158:0/1542557190 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f34a814e7e0 con 0x7f34a80beac0 2023-10-18T17:28:51.019 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:51.012+0000 7f348ffff700 1 -- 172.21.15.158:0/1542557190 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f34a814e7e0 con 0x7f34a80beac0 2023-10-18T17:28:51.020 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:28:51.022 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:51.016+0000 7f34ae61b700 1 -- 172.21.15.158:0/1542557190 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f349405a560 msgr2=0x7f349405ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:51.022 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:51.016+0000 7f34ae61b700 1 --2- 172.21.15.158:0/1542557190 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f349405a560 0x7f349405ca20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f34980011e0 tx=0x7f3498007b90).stop 2023-10-18T17:28:51.022 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:51.016+0000 7f34ae61b700 1 -- 172.21.15.158:0/1542557190 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34a80beac0 msgr2=0x7f34a80c10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:51.023 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:51.016+0000 7f34ae61b700 1 --2- 172.21.15.158:0/1542557190 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34a80beac0 0x7f34a80c10a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f349c00d890 tx=0x7f349c008040).stop 2023-10-18T17:28:51.023 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:51.016+0000 7f34ae61b700 1 -- 172.21.15.158:0/1542557190 shutdown_connections 2023-10-18T17:28:51.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:51.016+0000 7f34ae61b700 1 --2- 172.21.15.158:0/1542557190 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f349405a560 0x7f349405ca20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:51.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:51.016+0000 7f34ae61b700 1 --2- 172.21.15.158:0/1542557190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34a80beea0 0x7f34a8151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:51.024 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:51.016+0000 7f34ae61b700 1 --2- 172.21.15.158:0/1542557190 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f34a80beac0 0x7f34a80c10a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:51.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:51.016+0000 7f34ae61b700 1 --2- 172.21.15.158:0/1542557190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34a8067e50 0x7f34a814eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:51.025 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:51.016+0000 7f34ae61b700 1 -- 172.21.15.158:0/1542557190 >> 172.21.15.158:0/1542557190 conn(0x7f34a80620d0 msgr2=0x7f34a81487c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:51.026 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:51.016+0000 7f34ae61b700 1 -- 172.21.15.158:0/1542557190 shutdown_connections 2023-10-18T17:28:51.026 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:51.016+0000 7f34ae61b700 1 -- 172.21.15.158:0/1542557190 wait complete. 2023-10-18T17:28:51.042 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:28:54.044 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:28:54.206 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.200+0000 7f1e4665b700 1 Processor -- start 2023-10-18T17:28:54.206 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.200+0000 7f1e4665b700 1 -- start start 2023-10-18T17:28:54.209 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.204+0000 7f1e4665b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e400b9690 0x7f1e400b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:54.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.204+0000 7f1e4665b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1e40065d30 0x7f1e4014dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:54.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.204+0000 7f1e4665b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e400bc480 con 0x7f1e400bca50 2023-10-18T17:28:54.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.204+0000 7f1e4665b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e40065190 con 0x7f1e40065d30 2023-10-18T17:28:54.210 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.204+0000 7f1e4665b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400bb920 con 0x7f1e400b9690 2023-10-18T17:28:54.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.204+0000 7f1e377fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f1e400bca50 0x7f1e40065620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:55208/0 (socket says 172.21.15.158:55208) 2023-10-18T17:28:54.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.204+0000 7f1e377fe700 1 -- 172.21.15.158:0/4244964865 learned_addr learned my addr 172.21.15.158:0/4244964865 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:28:54.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.204+0000 7f1e3ffff700 1 --2- 172.21.15.158:0/4244964865 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e400b9690 0x7f1e400b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:54.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.204+0000 7f1e44bf8700 1 --2- 172.21.15.158:0/4244964865 >> v2:172.21.15.183:3300/0 conn(0x7f1e40065d30 0x7f1e4014dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:54.212 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.204+0000 7f1e3f7fe700 1 -- 172.21.15.158:0/4244964865 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812960623 0 0) 0x7f1e400bc480 con 0x7f1e400bca50 2023-10-18T17:28:54.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.204+0000 7f1e3f7fe700 1 -- 172.21.15.158:0/4244964865 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e2c0033f0 con 0x7f1e400bca50 2023-10-18T17:28:54.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.204+0000 7f1e44bf8700 1 -- 172.21.15.158:0/4244964865 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e400b9690 msgr2=0x7f1e400b9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:28:54.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.204+0000 7f1e44bf8700 1 --2- 172.21.15.158:0/4244964865 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e400b9690 0x7f1e400b9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:54.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.204+0000 7f1e44bf8700 1 -- 172.21.15.158:0/4244964865 >> v1:172.21.15.158:6789/0 conn(0x7f1e400bca50 legacy=0x7f1e40065620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:54.213 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.204+0000 7f1e44bf8700 1 -- 172.21.15.158:0/4244964865 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e400bbbe0 con 0x7f1e40065d30 2023-10-18T17:28:54.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.204+0000 7f1e44bf8700 1 --2- 172.21.15.158:0/4244964865 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e40065d30 0x7f1e4014dd50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f1e38009e60 tx=0x7f1e38009780).ready entity=mon.1 client_cookie=a5cd0d8d5b37c904 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:54.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.204+0000 7f1e3f7fe700 1 -- 172.21.15.158:0/4244964865 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3800e070 con 0x7f1e40065d30 2023-10-18T17:28:54.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.204+0000 7f1e3f7fe700 1 -- 172.21.15.158:0/4244964865 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3800bab0 con 0x7f1e40065d30 2023-10-18T17:28:54.214 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.204+0000 7f1e3f7fe700 1 -- 172.21.15.158:0/4244964865 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3800be30 con 0x7f1e40065d30 2023-10-18T17:28:54.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.208+0000 7f1e4665b700 1 -- 172.21.15.158:0/4244964865 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e40065d30 msgr2=0x7f1e4014dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:54.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.208+0000 7f1e4665b700 1 --2- 172.21.15.158:0/4244964865 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e40065d30 0x7f1e4014dd50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f1e38009e60 tx=0x7f1e38009780).stop 2023-10-18T17:28:54.215 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.208+0000 7f1e4665b700 1 -- 172.21.15.158:0/4244964865 shutdown_connections 2023-10-18T17:28:54.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.208+0000 7f1e4665b700 1 --2- 172.21.15.158:0/4244964865 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e40065d30 0x7f1e4014dd50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:54.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.208+0000 7f1e4665b700 1 --2- 172.21.15.158:0/4244964865 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e400b9690 0x7f1e400b9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:54.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.208+0000 7f1e4665b700 1 -- 172.21.15.158:0/4244964865 >> 172.21.15.158:0/4244964865 conn(0x7f1e400620d0 msgr2=0x7f1e400624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:54.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.208+0000 7f1e4665b700 1 -- 172.21.15.158:0/4244964865 shutdown_connections 2023-10-18T17:28:54.216 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.208+0000 7f1e4665b700 1 -- 172.21.15.158:0/4244964865 wait complete. 2023-10-18T17:28:54.217 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.208+0000 7f1e4665b700 1 Processor -- start 2023-10-18T17:28:54.218 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.208+0000 7f1e4665b700 1 -- start start 2023-10-18T17:28:54.218 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e4665b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e40065d30 0x7f1e401513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:54.218 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e4665b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e400b9690 0x7f1e401611a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:54.218 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e4665b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e40161690 0x7f1e40145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:54.218 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e4665b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400bfec0 con 0x7f1e40161690 2023-10-18T17:28:54.219 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e4665b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400c0a40 con 0x7f1e40065d30 2023-10-18T17:28:54.219 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e4665b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400c2070 con 0x7f1e400b9690 2023-10-18T17:28:54.219 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e44bf8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e40161690 0x7f1e40145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:54.219 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e44bf8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e40161690 0x7f1e40145a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:45616/0 (socket says 172.21.15.158:45616) 2023-10-18T17:28:54.219 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e44bf8700 1 -- 172.21.15.158:0/3178443632 learned_addr learned my addr 172.21.15.158:0/3178443632 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:54.220 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e377fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e400b9690 0x7f1e401611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:54.220 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e3ffff700 1 --2- 172.21.15.158:0/3178443632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e40065d30 0x7f1e401513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:54.221 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e44bf8700 1 -- 172.21.15.158:0/3178443632 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e400b9690 msgr2=0x7f1e401611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:54.221 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e44bf8700 1 --2- 172.21.15.158:0/3178443632 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e400b9690 0x7f1e401611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:54.221 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e44bf8700 1 -- 172.21.15.158:0/3178443632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e40065d30 msgr2=0x7f1e401513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:54.222 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e44bf8700 1 --2- 172.21.15.158:0/3178443632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e40065d30 0x7f1e401513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:54.222 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e44bf8700 1 -- 172.21.15.158:0/3178443632 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e38009a20 con 0x7f1e40161690 2023-10-18T17:28:54.222 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e377fe700 1 --2- 172.21.15.158:0/3178443632 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e400b9690 0x7f1e401611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:28:54.222 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e44bf8700 1 --2- 172.21.15.158:0/3178443632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e40161690 0x7f1e40145a70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f1e3800b610 tx=0x7f1e4014b970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:54.222 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e3cff9700 1 -- 172.21.15.158:0/3178443632 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38013e70 con 0x7f1e40161690 2023-10-18T17:28:54.223 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e3cff9700 1 -- 172.21.15.158:0/3178443632 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3801d630 con 0x7f1e40161690 2023-10-18T17:28:54.223 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e4665b700 1 -- 172.21.15.158:0/3178443632 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e400c0110 con 0x7f1e40161690 2023-10-18T17:28:54.223 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e3cff9700 1 -- 172.21.15.158:0/3178443632 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3801d9f0 con 0x7f1e40161690 2023-10-18T17:28:54.223 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.212+0000 7f1e4665b700 1 -- 172.21.15.158:0/3178443632 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e400c06d0 con 0x7f1e40161690 2023-10-18T17:28:54.223 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.216+0000 7f1e4665b700 1 -- 172.21.15.158:0/3178443632 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e400c0bf0 con 0x7f1e40161690 2023-10-18T17:28:54.224 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.216+0000 7f1e3cff9700 1 -- 172.21.15.158:0/3178443632 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1e38003040 con 0x7f1e40161690 2023-10-18T17:28:54.224 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.216+0000 7f1e3cff9700 1 --2- 172.21.15.158:0/3178443632 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f1e2005a540 0x7f1e2005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:54.225 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.216+0000 7f1e3cff9700 1 -- 172.21.15.158:0/3178443632 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f1e38076630 con 0x7f1e40161690 2023-10-18T17:28:54.225 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.216+0000 7f1e3ffff700 1 --2- 172.21.15.158:0/3178443632 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f1e2005a540 0x7f1e2005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:54.225 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.220+0000 7f1e3ffff700 1 --2- 172.21.15.158:0/3178443632 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f1e2005a540 0x7f1e2005ca00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f1e30009c30 tx=0x7f1e30009060).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:54.230 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.224+0000 7f1e3cff9700 1 -- 172.21.15.158:0/3178443632 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f1e400c0bf0 con 0x7f1e40161690 2023-10-18T17:28:54.425 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.420+0000 7f1e4665b700 1 -- 172.21.15.158:0/3178443632 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1e400c0bf0 con 0x7f1e40161690 2023-10-18T17:28:54.426 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.420+0000 7f1e3cff9700 1 -- 172.21.15.158:0/3178443632 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f1e400c0bf0 con 0x7f1e40161690 2023-10-18T17:28:54.427 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:28:54.429 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.424+0000 7f1e4665b700 1 -- 172.21.15.158:0/3178443632 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f1e2005a540 msgr2=0x7f1e2005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:54.429 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.424+0000 7f1e4665b700 1 --2- 172.21.15.158:0/3178443632 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f1e2005a540 0x7f1e2005ca00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f1e30009c30 tx=0x7f1e30009060).stop 2023-10-18T17:28:54.429 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.424+0000 7f1e4665b700 1 -- 172.21.15.158:0/3178443632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e40161690 msgr2=0x7f1e40145a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:54.429 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.424+0000 7f1e4665b700 1 --2- 172.21.15.158:0/3178443632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e40161690 0x7f1e40145a70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f1e3800b610 tx=0x7f1e4014b970).stop 2023-10-18T17:28:54.429 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.424+0000 7f1e4665b700 1 -- 172.21.15.158:0/3178443632 shutdown_connections 2023-10-18T17:28:54.430 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.424+0000 7f1e4665b700 1 --2- 172.21.15.158:0/3178443632 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f1e2005a540 0x7f1e2005ca00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:54.430 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.424+0000 7f1e4665b700 1 --2- 172.21.15.158:0/3178443632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e40161690 0x7f1e40145a70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:54.430 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.424+0000 7f1e4665b700 1 --2- 172.21.15.158:0/3178443632 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e400b9690 0x7f1e401611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:54.430 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.424+0000 7f1e4665b700 1 --2- 172.21.15.158:0/3178443632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e40065d30 0x7f1e401513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:54.431 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.424+0000 7f1e4665b700 1 -- 172.21.15.158:0/3178443632 >> 172.21.15.158:0/3178443632 conn(0x7f1e400620d0 msgr2=0x7f1e400696e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:54.431 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.424+0000 7f1e4665b700 1 -- 172.21.15.158:0/3178443632 shutdown_connections 2023-10-18T17:28:54.432 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:54.424+0000 7f1e4665b700 1 -- 172.21.15.158:0/3178443632 wait complete. 2023-10-18T17:28:54.452 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:28:55.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~229s 2023-10-18T17:28:55.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~283s 2023-10-18T17:28:55.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~209s 2023-10-18T17:28:55.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~196s 2023-10-18T17:28:55.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~242s 2023-10-18T17:28:55.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~183s 2023-10-18T17:28:57.453 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:28:57.614 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.608+0000 7f949121b700 1 Processor -- start 2023-10-18T17:28:57.615 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.608+0000 7f949121b700 1 -- start start 2023-10-18T17:28:57.617 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.612+0000 7f949121b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f948c067ff0 0x7f948c0683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:57.618 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.612+0000 7f949121b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c065cf0 con 0x7f948c14cfa0 2023-10-18T17:28:57.618 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.612+0000 7f949121b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c150350 con 0x7f948c0666b0 2023-10-18T17:28:57.618 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.612+0000 7f949121b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0650e0 con 0x7f948c067ff0 2023-10-18T17:28:57.618 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.612+0000 7f948ad9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f948c067ff0 0x7f948c0683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:57.618 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.612+0000 7f948259c700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f948c0666b0 0x7f948c0c1d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:45138/0 (socket says 172.21.15.158:45138) 2023-10-18T17:28:57.619 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.612+0000 7f948ad9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f948c067ff0 0x7f948c0683d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.158:38064/0 (socket says 172.21.15.158:38064) 2023-10-18T17:28:57.619 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.612+0000 7f948259c700 1 -- 172.21.15.158:0/481991488 learned_addr learned my addr 172.21.15.158:0/481991488 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:28:57.620 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.612+0000 7f948ad9d700 1 -- 172.21.15.158:0/481991488 >> v1:172.21.15.183:6789/0 conn(0x7f948c0666b0 legacy=0x7f948c0c1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:57.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.612+0000 7f948ad9d700 1 -- 172.21.15.158:0/481991488 >> v1:172.21.15.158:6789/0 conn(0x7f948c14cfa0 legacy=0x7f948c14d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:57.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.612+0000 7f948ad9d700 1 -- 172.21.15.158:0/481991488 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c0653c0 con 0x7f948c067ff0 2023-10-18T17:28:57.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.612+0000 7f948ad9d700 1 --2- 172.21.15.158:0/481991488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f948c067ff0 0x7f948c0683d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f947c009790 tx=0x7f947c009060).ready entity=mon.2 client_cookie=ed36d2861f973231 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:57.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.612+0000 7f948a59c700 1 -- 172.21.15.158:0/481991488 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c00b630 con 0x7f948c067ff0 2023-10-18T17:28:57.621 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.612+0000 7f948a59c700 1 -- 172.21.15.158:0/481991488 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c00b790 con 0x7f948c067ff0 2023-10-18T17:28:57.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.612+0000 7f948a59c700 1 -- 172.21.15.158:0/481991488 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c00bb10 con 0x7f948c067ff0 2023-10-18T17:28:57.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.616+0000 7f949121b700 1 -- 172.21.15.158:0/481991488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f948c067ff0 msgr2=0x7f948c0683d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:57.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.616+0000 7f949121b700 1 --2- 172.21.15.158:0/481991488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f948c067ff0 0x7f948c0683d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f947c009790 tx=0x7f947c009060).stop 2023-10-18T17:28:57.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.616+0000 7f949121b700 1 -- 172.21.15.158:0/481991488 shutdown_connections 2023-10-18T17:28:57.622 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.616+0000 7f949121b700 1 --2- 172.21.15.158:0/481991488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f948c067ff0 0x7f948c0683d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:57.623 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.616+0000 7f949121b700 1 -- 172.21.15.158:0/481991488 >> 172.21.15.158:0/481991488 conn(0x7f948c0620d0 msgr2=0x7f948c0624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:57.623 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.616+0000 7f949121b700 1 -- 172.21.15.158:0/481991488 shutdown_connections 2023-10-18T17:28:57.623 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.616+0000 7f949121b700 1 -- 172.21.15.158:0/481991488 wait complete. 2023-10-18T17:28:57.624 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.616+0000 7f949121b700 1 Processor -- start 2023-10-18T17:28:57.624 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.616+0000 7f949121b700 1 -- start start 2023-10-18T17:28:57.625 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f949121b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f948c0666b0 0x7f948c0c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:57.625 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f949121b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f948c067ff0 0x7f948c0b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:57.626 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f949121b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f948c14cfa0 0x7f948c14ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:57.626 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f949121b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0b4990 con 0x7f948c0666b0 2023-10-18T17:28:57.626 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f949121b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0c50e0 con 0x7f948c067ff0 2023-10-18T17:28:57.626 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f949121b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c15fa10 con 0x7f948c14cfa0 2023-10-18T17:28:57.628 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f948259c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f948c067ff0 0x7f948c0b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:57.628 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f948259c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f948c067ff0 0x7f948c0b8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:51244/0 (socket says 172.21.15.158:51244) 2023-10-18T17:28:57.628 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f948259c700 1 -- 172.21.15.158:0/1637744704 learned_addr learned my addr 172.21.15.158:0/1637744704 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:28:57.629 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f948ad9d700 1 --2- 172.21.15.158:0/1637744704 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f948c0666b0 0x7f948c0c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:57.629 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f948b59e700 1 --2- 172.21.15.158:0/1637744704 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f948c14cfa0 0x7f948c14ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:57.629 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f948259c700 1 -- 172.21.15.158:0/1637744704 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f948c14cfa0 msgr2=0x7f948c14ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:57.629 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f948259c700 1 --2- 172.21.15.158:0/1637744704 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f948c14cfa0 0x7f948c14ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:57.629 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f948259c700 1 -- 172.21.15.158:0/1637744704 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f948c0666b0 msgr2=0x7f948c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:57.630 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f948259c700 1 --2- 172.21.15.158:0/1637744704 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f948c0666b0 0x7f948c0c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:57.630 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f948259c700 1 -- 172.21.15.158:0/1637744704 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c0092a0 con 0x7f948c067ff0 2023-10-18T17:28:57.630 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f948259c700 1 --2- 172.21.15.158:0/1637744704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f948c067ff0 0x7f948c0b8c80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f947400c440 tx=0x7f9474007df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:57.631 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f94837fe700 1 -- 172.21.15.158:0/1637744704 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94740070d0 con 0x7f948c067ff0 2023-10-18T17:28:57.631 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f949121b700 1 -- 172.21.15.158:0/1637744704 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948c160830 con 0x7f948c067ff0 2023-10-18T17:28:57.634 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f94837fe700 1 -- 172.21.15.158:0/1637744704 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9474007230 con 0x7f948c067ff0 2023-10-18T17:28:57.635 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f94837fe700 1 -- 172.21.15.158:0/1637744704 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94740075b0 con 0x7f948c067ff0 2023-10-18T17:28:57.635 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.620+0000 7f949121b700 1 -- 172.21.15.158:0/1637744704 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948c15fc20 con 0x7f948c067ff0 2023-10-18T17:28:57.636 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.624+0000 7f949121b700 1 -- 172.21.15.158:0/1637744704 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948c06c190 con 0x7f948c067ff0 2023-10-18T17:28:57.636 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.628+0000 7f94837fe700 1 -- 172.21.15.158:0/1637744704 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f94740059b0 con 0x7f948c067ff0 2023-10-18T17:28:57.636 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.628+0000 7f94837fe700 1 --2- 172.21.15.158:0/1637744704 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f947005a510 0x7f947005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:28:57.637 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.628+0000 7f94837fe700 1 -- 172.21.15.158:0/1637744704 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f947404b290 con 0x7f948c067ff0 2023-10-18T17:28:57.640 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.628+0000 7f948ad9d700 1 --2- 172.21.15.158:0/1637744704 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f947005a510 0x7f947005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:28:57.640 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.628+0000 7f948ad9d700 1 --2- 172.21.15.158:0/1637744704 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f947005a510 0x7f947005c9d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f947c0096e0 tx=0x7f947c015000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:28:57.642 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.636+0000 7f94837fe700 1 -- 172.21.15.158:0/1637744704 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f9474047630 con 0x7f948c067ff0 2023-10-18T17:28:57.841 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.836+0000 7f949121b700 1 -- 172.21.15.158:0/1637744704 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f948c0656a0 con 0x7f948c067ff0 2023-10-18T17:28:57.842 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.836+0000 7f94837fe700 1 -- 172.21.15.158:0/1637744704 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f947404ac50 con 0x7f948c067ff0 2023-10-18T17:28:57.842 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:28:57.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.840+0000 7f949121b700 1 -- 172.21.15.158:0/1637744704 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f947005a510 msgr2=0x7f947005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:57.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.840+0000 7f949121b700 1 --2- 172.21.15.158:0/1637744704 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f947005a510 0x7f947005c9d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f947c0096e0 tx=0x7f947c015000).stop 2023-10-18T17:28:57.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.840+0000 7f949121b700 1 -- 172.21.15.158:0/1637744704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f948c067ff0 msgr2=0x7f948c0b8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:28:57.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.840+0000 7f949121b700 1 --2- 172.21.15.158:0/1637744704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f948c067ff0 0x7f948c0b8c80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f947400c440 tx=0x7f9474007df0).stop 2023-10-18T17:28:57.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.840+0000 7f949121b700 1 -- 172.21.15.158:0/1637744704 shutdown_connections 2023-10-18T17:28:57.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.840+0000 7f949121b700 1 --2- 172.21.15.158:0/1637744704 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f947005a510 0x7f947005c9d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:57.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.840+0000 7f949121b700 1 --2- 172.21.15.158:0/1637744704 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f948c14cfa0 0x7f948c14ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:57.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.840+0000 7f949121b700 1 --2- 172.21.15.158:0/1637744704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f948c067ff0 0x7f948c0b8c80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:57.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.840+0000 7f949121b700 1 --2- 172.21.15.158:0/1637744704 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f948c0666b0 0x7f948c0c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:28:57.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.840+0000 7f949121b700 1 -- 172.21.15.158:0/1637744704 >> 172.21.15.158:0/1637744704 conn(0x7f948c0620d0 msgr2=0x7f948c0c29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:28:57.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.840+0000 7f949121b700 1 -- 172.21.15.158:0/1637744704 shutdown_connections 2023-10-18T17:28:57.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:28:57.840+0000 7f949121b700 1 -- 172.21.15.158:0/1637744704 wait complete. 2023-10-18T17:28:57.863 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:29:00.865 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:29:01.028 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.020+0000 7f6b6005b700 1 Processor -- start 2023-10-18T17:29:01.028 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b6005b700 1 -- start start 2023-10-18T17:29:01.029 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b6005b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6b580b9690 0x7f6b580b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:01.030 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b6005b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6b580bca50 0x7f6b5814dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:01.030 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b6005b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b580bc480 con 0x7f6b58065620 2023-10-18T17:29:01.030 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b6005b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b58065190 con 0x7f6b580bca50 2023-10-18T17:29:01.030 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b6005b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b580bb920 con 0x7f6b580b9690 2023-10-18T17:29:01.032 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b5ddf7700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6b580b9690 0x7f6b580b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:01.032 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b5d5f6700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6b580bca50 0x7f6b5814dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:01.032 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b5ddf7700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6b580b9690 0x7f6b580b9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:56208/0 (socket says 172.21.15.158:56208) 2023-10-18T17:29:01.032 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b5ddf7700 1 -- 172.21.15.158:0/3888264059 learned_addr learned my addr 172.21.15.158:0/3888264059 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:29:01.033 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b5e5f8700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f6b58065620 0x7f6b58065a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:51686/0 (socket says 172.21.15.158:51686) 2023-10-18T17:29:01.033 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b5d5f6700 1 -- 172.21.15.158:0/3888264059 >> v2:172.21.15.183:3300/0 conn(0x7f6b580b9690 msgr2=0x7f6b580b9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:29:01.033 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b5d5f6700 1 --2- 172.21.15.158:0/3888264059 >> v2:172.21.15.183:3300/0 conn(0x7f6b580b9690 0x7f6b580b9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:01.033 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b5d5f6700 1 -- 172.21.15.158:0/3888264059 >> v1:172.21.15.158:6789/0 conn(0x7f6b58065620 legacy=0x7f6b58065a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:01.033 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b5d5f6700 1 -- 172.21.15.158:0/3888264059 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b580bbbe0 con 0x7f6b580bca50 2023-10-18T17:29:01.034 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b5cdf5700 1 -- 172.21.15.158:0/3888264059 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078170192 0 0) 0x7f6b580bc480 con 0x7f6b58065620 2023-10-18T17:29:01.034 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b5d5f6700 1 --2- 172.21.15.158:0/3888264059 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b580bca50 0x7f6b5814dd50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f6b58064ac0 tx=0x7f6b48009060).ready entity=mon.0 client_cookie=b9756fa9b4191091 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:29:01.034 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b5cdf5700 1 -- 172.21.15.158:0/3888264059 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4800f510 con 0x7f6b580bca50 2023-10-18T17:29:01.034 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b5cdf5700 1 -- 172.21.15.158:0/3888264059 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4800f670 con 0x7f6b580bca50 2023-10-18T17:29:01.034 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.024+0000 7f6b5cdf5700 1 -- 172.21.15.158:0/3888264059 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4800f9f0 con 0x7f6b580bca50 2023-10-18T17:29:01.035 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.028+0000 7f6b6005b700 1 -- 172.21.15.158:0/3888264059 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b580bca50 msgr2=0x7f6b5814dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:01.036 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.028+0000 7f6b6005b700 1 --2- 172.21.15.158:0/3888264059 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b580bca50 0x7f6b5814dd50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f6b58064ac0 tx=0x7f6b48009060).stop 2023-10-18T17:29:01.036 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.028+0000 7f6b6005b700 1 -- 172.21.15.158:0/3888264059 shutdown_connections 2023-10-18T17:29:01.036 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.028+0000 7f6b6005b700 1 --2- 172.21.15.158:0/3888264059 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b580bca50 0x7f6b5814dd50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:01.036 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.028+0000 7f6b6005b700 1 --2- 172.21.15.158:0/3888264059 >> v2:172.21.15.183:3300/0 conn(0x7f6b580b9690 0x7f6b580b9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:01.037 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.028+0000 7f6b6005b700 1 -- 172.21.15.158:0/3888264059 >> 172.21.15.158:0/3888264059 conn(0x7f6b580620d0 msgr2=0x7f6b580624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:29:01.037 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.028+0000 7f6b6005b700 1 -- 172.21.15.158:0/3888264059 shutdown_connections 2023-10-18T17:29:01.037 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.028+0000 7f6b6005b700 1 -- 172.21.15.158:0/3888264059 wait complete. 2023-10-18T17:29:01.037 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.028+0000 7f6b6005b700 1 Processor -- start 2023-10-18T17:29:01.037 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.028+0000 7f6b6005b700 1 -- start start 2023-10-18T17:29:01.039 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b6005b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b58065620 0x7f6b58161470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:01.040 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b6005b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b580b9690 0x7f6b5815e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:01.040 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b6005b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b580aeef0 0x7f6b580b80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:01.040 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b6005b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b58146ac0 con 0x7f6b58065620 2023-10-18T17:29:01.040 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b6005b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5815e320 con 0x7f6b580aeef0 2023-10-18T17:29:01.040 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b6005b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b58161a20 con 0x7f6b580b9690 2023-10-18T17:29:01.041 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b5ddf7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b58065620 0x7f6b58161470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:01.041 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b5ddf7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b58065620 0x7f6b58161470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:46888/0 (socket says 172.21.15.158:46888) 2023-10-18T17:29:01.041 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b5ddf7700 1 -- 172.21.15.158:0/3893917692 learned_addr learned my addr 172.21.15.158:0/3893917692 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:29:01.041 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b5d5f6700 1 --2- 172.21.15.158:0/3893917692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b580b9690 0x7f6b5815e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:01.041 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b5e5f8700 1 --2- 172.21.15.158:0/3893917692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b580aeef0 0x7f6b580b80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:01.042 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b5ddf7700 1 -- 172.21.15.158:0/3893917692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b580b9690 msgr2=0x7f6b5815e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:01.042 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b5ddf7700 1 --2- 172.21.15.158:0/3893917692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b580b9690 0x7f6b5815e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:01.042 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b5ddf7700 1 -- 172.21.15.158:0/3893917692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b580aeef0 msgr2=0x7f6b580b80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:01.042 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b5ddf7700 1 --2- 172.21.15.158:0/3893917692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b580aeef0 0x7f6b580b80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:01.042 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b5ddf7700 1 -- 172.21.15.158:0/3893917692 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b480092a0 con 0x7f6b58065620 2023-10-18T17:29:01.043 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b5ddf7700 1 --2- 172.21.15.158:0/3893917692 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b58065620 0x7f6b58161470 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f6b5400e930 tx=0x7f6b540090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:29:01.043 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b4dffb700 1 -- 172.21.15.158:0/3893917692 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b54012600 con 0x7f6b58065620 2023-10-18T17:29:01.043 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b4dffb700 1 -- 172.21.15.158:0/3893917692 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b54012760 con 0x7f6b58065620 2023-10-18T17:29:01.043 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b4dffb700 1 -- 172.21.15.158:0/3893917692 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b54012ae0 con 0x7f6b58065620 2023-10-18T17:29:01.043 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b6005b700 1 -- 172.21.15.158:0/3893917692 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b58161ce0 con 0x7f6b58065620 2023-10-18T17:29:01.044 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.032+0000 7f6b6005b700 1 -- 172.21.15.158:0/3893917692 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b5815dfb0 con 0x7f6b58065620 2023-10-18T17:29:01.045 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.036+0000 7f6b6005b700 1 -- 172.21.15.158:0/3893917692 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b5806c190 con 0x7f6b58065620 2023-10-18T17:29:01.046 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.036+0000 7f6b4dffb700 1 -- 172.21.15.158:0/3893917692 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6b5401b400 con 0x7f6b58065620 2023-10-18T17:29:01.046 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.036+0000 7f6b4dffb700 1 --2- 172.21.15.158:0/3893917692 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6b3c05a510 0x7f6b3c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:01.046 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.036+0000 7f6b4dffb700 1 -- 172.21.15.158:0/3893917692 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f6b54074e10 con 0x7f6b58065620 2023-10-18T17:29:01.046 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.036+0000 7f6b5d5f6700 1 --2- 172.21.15.158:0/3893917692 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6b3c05a510 0x7f6b3c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:01.047 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.040+0000 7f6b5d5f6700 1 --2- 172.21.15.158:0/3893917692 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6b3c05a510 0x7f6b3c05c9d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f6b580bec20 tx=0x7f6b48017000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:29:01.050 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.044+0000 7f6b4dffb700 1 -- 172.21.15.158:0/3893917692 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f6b54048330 con 0x7f6b58065620 2023-10-18T17:29:01.243 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.236+0000 7f6b6005b700 1 -- 172.21.15.158:0/3893917692 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6b580bbec0 con 0x7f6b58065620 2023-10-18T17:29:01.244 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.240+0000 7f6b4dffb700 1 -- 172.21.15.158:0/3893917692 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f6b5404b950 con 0x7f6b58065620 2023-10-18T17:29:01.244 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:29:01.249 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.244+0000 7f6b6005b700 1 -- 172.21.15.158:0/3893917692 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6b3c05a510 msgr2=0x7f6b3c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:01.249 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.244+0000 7f6b6005b700 1 --2- 172.21.15.158:0/3893917692 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6b3c05a510 0x7f6b3c05c9d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f6b580bec20 tx=0x7f6b48017000).stop 2023-10-18T17:29:01.249 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.244+0000 7f6b6005b700 1 -- 172.21.15.158:0/3893917692 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b58065620 msgr2=0x7f6b58161470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:01.250 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.244+0000 7f6b6005b700 1 --2- 172.21.15.158:0/3893917692 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b58065620 0x7f6b58161470 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f6b5400e930 tx=0x7f6b540090f0).stop 2023-10-18T17:29:01.250 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.244+0000 7f6b6005b700 1 -- 172.21.15.158:0/3893917692 shutdown_connections 2023-10-18T17:29:01.250 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.244+0000 7f6b6005b700 1 --2- 172.21.15.158:0/3893917692 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f6b3c05a510 0x7f6b3c05c9d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:01.250 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.244+0000 7f6b6005b700 1 --2- 172.21.15.158:0/3893917692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b580aeef0 0x7f6b580b80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:01.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.244+0000 7f6b6005b700 1 --2- 172.21.15.158:0/3893917692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b580b9690 0x7f6b5815e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:01.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.244+0000 7f6b6005b700 1 --2- 172.21.15.158:0/3893917692 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b58065620 0x7f6b58161470 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:01.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.244+0000 7f6b6005b700 1 -- 172.21.15.158:0/3893917692 >> 172.21.15.158:0/3893917692 conn(0x7f6b580620d0 msgr2=0x7f6b5814f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:29:01.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.244+0000 7f6b6005b700 1 -- 172.21.15.158:0/3893917692 shutdown_connections 2023-10-18T17:29:01.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:01.244+0000 7f6b6005b700 1 -- 172.21.15.158:0/3893917692 wait complete. 2023-10-18T17:29:01.270 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:29:01.615 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~235s 2023-10-18T17:29:01.615 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~289s 2023-10-18T17:29:01.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~215s 2023-10-18T17:29:01.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~202s 2023-10-18T17:29:01.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~248s 2023-10-18T17:29:01.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~189s 2023-10-18T17:29:04.272 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:29:04.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.432+0000 7fb10359e700 1 Processor -- start 2023-10-18T17:29:04.438 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.432+0000 7fb10359e700 1 -- start start 2023-10-18T17:29:04.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.432+0000 7fb10359e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb10414d170 0x7fb10406a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:04.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.432+0000 7fb10359e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb104067d30 0x7fb1040630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:04.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.432+0000 7fb10359e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb104068910 con 0x7fb104068150 2023-10-18T17:29:04.439 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.432+0000 7fb10359e700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb104150c10 con 0x7fb104067d30 2023-10-18T17:29:04.440 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.432+0000 7fb10359e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb104150780 con 0x7fb10414d170 2023-10-18T17:29:04.441 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.432+0000 7fb0f9d9b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb104067d30 0x7fb1040630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:04.441 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.432+0000 7fb0f9d9b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb104067d30 0x7fb1040630e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:56218/0 (socket says 172.21.15.158:56218) 2023-10-18T17:29:04.441 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.432+0000 7fb10259c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb10414d170 0x7fb10406a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:04.441 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.432+0000 7fb0f9d9b700 1 -- 172.21.15.158:0/862030600 learned_addr learned my addr 172.21.15.158:0/862030600 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:29:04.442 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.436+0000 7fb0f9d9b700 1 -- 172.21.15.158:0/862030600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb10414d170 msgr2=0x7fb10406a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:29:04.442 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.436+0000 7fb0f9d9b700 1 --2- 172.21.15.158:0/862030600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb10414d170 0x7fb10406a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:04.442 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.436+0000 7fb0f9d9b700 1 -- 172.21.15.158:0/862030600 >> v1:172.21.15.158:6789/0 conn(0x7fb104068150 legacy=0x7fb104065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:04.442 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.436+0000 7fb0f9d9b700 1 -- 172.21.15.158:0/862030600 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb104068630 con 0x7fb104067d30 2023-10-18T17:29:04.443 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.436+0000 7fb0f9d9b700 1 --2- 172.21.15.158:0/862030600 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb104067d30 0x7fb1040630e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fb0ec006fd0 tx=0x7fb0ec0090f0).ready entity=mon.1 client_cookie=a676ecdff999d0b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:29:04.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.436+0000 7fb101d9b700 1 -- 172.21.15.158:0/862030600 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec00f510 con 0x7fb104067d30 2023-10-18T17:29:04.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.436+0000 7fb101d9b700 1 -- 172.21.15.158:0/862030600 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec00f670 con 0x7fb104067d30 2023-10-18T17:29:04.444 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.436+0000 7fb101d9b700 1 -- 172.21.15.158:0/862030600 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec00f9f0 con 0x7fb104067d30 2023-10-18T17:29:04.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.436+0000 7fb10359e700 1 -- 172.21.15.158:0/862030600 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb104067d30 msgr2=0x7fb1040630e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:04.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.436+0000 7fb10359e700 1 --2- 172.21.15.158:0/862030600 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb104067d30 0x7fb1040630e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fb0ec006fd0 tx=0x7fb0ec0090f0).stop 2023-10-18T17:29:04.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.436+0000 7fb10359e700 1 -- 172.21.15.158:0/862030600 shutdown_connections 2023-10-18T17:29:04.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.436+0000 7fb10359e700 1 --2- 172.21.15.158:0/862030600 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb104067d30 0x7fb1040630e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:04.445 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.436+0000 7fb10359e700 1 --2- 172.21.15.158:0/862030600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb10414d170 0x7fb10406a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:04.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.436+0000 7fb10359e700 1 -- 172.21.15.158:0/862030600 >> 172.21.15.158:0/862030600 conn(0x7fb104062ba0 msgr2=0x7fb1040c6330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:29:04.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.436+0000 7fb10359e700 1 -- 172.21.15.158:0/862030600 shutdown_connections 2023-10-18T17:29:04.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.436+0000 7fb10359e700 1 -- 172.21.15.158:0/862030600 wait complete. 2023-10-18T17:29:04.446 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.436+0000 7fb10359e700 1 Processor -- start 2023-10-18T17:29:04.447 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb10359e700 1 -- start start 2023-10-18T17:29:04.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb10359e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb104067d30 0x7fb1041510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:04.449 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb10359e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb104068150 0x7fb104157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:04.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb10359e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb10414d170 0x7fb1041527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:04.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb10359e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1041540b0 con 0x7fb104068150 2023-10-18T17:29:04.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb10359e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1040be850 con 0x7fb104067d30 2023-10-18T17:29:04.450 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb10359e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10414f200 con 0x7fb10414d170 2023-10-18T17:29:04.451 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb0f9d9b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb104068150 0x7fb104157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:04.451 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb0f9d9b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb104068150 0x7fb104157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:46890/0 (socket says 172.21.15.158:46890) 2023-10-18T17:29:04.451 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb0f9d9b700 1 -- 172.21.15.158:0/927946201 learned_addr learned my addr 172.21.15.158:0/927946201 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:29:04.451 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb10259c700 1 --2- 172.21.15.158:0/927946201 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb104067d30 0x7fb1041510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:04.451 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb102d9d700 1 --2- 172.21.15.158:0/927946201 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb10414d170 0x7fb1041527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:04.451 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb0f9d9b700 1 -- 172.21.15.158:0/927946201 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb10414d170 msgr2=0x7fb1041527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:04.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb0f9d9b700 1 --2- 172.21.15.158:0/927946201 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb10414d170 0x7fb1041527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:04.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb0f9d9b700 1 -- 172.21.15.158:0/927946201 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb104067d30 msgr2=0x7fb1041510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:04.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb0f9d9b700 1 --2- 172.21.15.158:0/927946201 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb104067d30 0x7fb1041510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:04.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb0f9d9b700 1 -- 172.21.15.158:0/927946201 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec009370 con 0x7fb104068150 2023-10-18T17:29:04.452 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb0f9d9b700 1 --2- 172.21.15.158:0/927946201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb104068150 0x7fb104157e20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fb0ec011000 tx=0x7fb0ec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:29:04.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb0faffd700 1 -- 172.21.15.158:0/927946201 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec00fe80 con 0x7fb104068150 2023-10-18T17:29:04.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb0faffd700 1 -- 172.21.15.158:0/927946201 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec00f7e0 con 0x7fb104068150 2023-10-18T17:29:04.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb10359e700 1 -- 172.21.15.158:0/927946201 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10414f730 con 0x7fb104068150 2023-10-18T17:29:04.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb0faffd700 1 -- 172.21.15.158:0/927946201 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec01d660 con 0x7fb104068150 2023-10-18T17:29:04.453 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.440+0000 7fb10359e700 1 -- 172.21.15.158:0/927946201 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1040bd0f0 con 0x7fb104068150 2023-10-18T17:29:04.454 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.444+0000 7fb10359e700 1 -- 172.21.15.158:0/927946201 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb104046f00 con 0x7fb104068150 2023-10-18T17:29:04.454 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.444+0000 7fb0faffd700 1 -- 172.21.15.158:0/927946201 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb0ec01d9d0 con 0x7fb104068150 2023-10-18T17:29:04.455 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.444+0000 7fb0faffd700 1 --2- 172.21.15.158:0/927946201 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb0e405a540 0x7fb0e405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:04.455 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.444+0000 7fb0faffd700 1 -- 172.21.15.158:0/927946201 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7fb0ec076820 con 0x7fb104068150 2023-10-18T17:29:04.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.444+0000 7fb10259c700 1 --2- 172.21.15.158:0/927946201 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb0e405a540 0x7fb0e405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:04.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.448+0000 7fb10259c700 1 --2- 172.21.15.158:0/927946201 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb0e405a540 0x7fb0e405ca00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fb0f4009fd0 tx=0x7fb0f400b040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:29:04.456 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.452+0000 7fb0faffd700 1 -- 172.21.15.158:0/927946201 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7fb0ec049ce0 con 0x7fb104068150 2023-10-18T17:29:04.546 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:29:04.554 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:29:04.653 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.648+0000 7fb10359e700 1 -- 172.21.15.158:0/927946201 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb1040ac460 con 0x7fb104068150 2023-10-18T17:29:04.653 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.648+0000 7fb0faffd700 1 -- 172.21.15.158:0/927946201 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7fb0ec021080 con 0x7fb104068150 2023-10-18T17:29:04.654 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:29:04.656 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.648+0000 7fb10359e700 1 -- 172.21.15.158:0/927946201 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb0e405a540 msgr2=0x7fb0e405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:04.656 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.648+0000 7fb10359e700 1 --2- 172.21.15.158:0/927946201 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb0e405a540 0x7fb0e405ca00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fb0f4009fd0 tx=0x7fb0f400b040).stop 2023-10-18T17:29:04.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.648+0000 7fb10359e700 1 -- 172.21.15.158:0/927946201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb104068150 msgr2=0x7fb104157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:04.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.648+0000 7fb10359e700 1 --2- 172.21.15.158:0/927946201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb104068150 0x7fb104157e20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fb0ec011000 tx=0x7fb0ec017000).stop 2023-10-18T17:29:04.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.652+0000 7fb10359e700 1 -- 172.21.15.158:0/927946201 shutdown_connections 2023-10-18T17:29:04.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.652+0000 7fb10359e700 1 --2- 172.21.15.158:0/927946201 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7fb0e405a540 0x7fb0e405ca00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:04.657 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.652+0000 7fb10359e700 1 --2- 172.21.15.158:0/927946201 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb10414d170 0x7fb1041527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:04.658 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.652+0000 7fb10359e700 1 --2- 172.21.15.158:0/927946201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb104068150 0x7fb104157e20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:04.658 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.652+0000 7fb10359e700 1 --2- 172.21.15.158:0/927946201 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb104067d30 0x7fb1041510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:04.658 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.652+0000 7fb10359e700 1 -- 172.21.15.158:0/927946201 >> 172.21.15.158:0/927946201 conn(0x7fb104062ba0 msgr2=0x7fb10414e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:29:04.658 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.652+0000 7fb10359e700 1 -- 172.21.15.158:0/927946201 shutdown_connections 2023-10-18T17:29:04.658 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:04.652+0000 7fb10359e700 1 -- 172.21.15.158:0/927946201 wait complete. 2023-10-18T17:29:04.678 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:29:07.680 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:29:07.840 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.835+0000 7ff348947700 1 Processor -- start 2023-10-18T17:29:07.841 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.835+0000 7ff348947700 1 -- start start 2023-10-18T17:29:07.842 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.835+0000 7ff348947700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff3440658a0 0x7ff344065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:07.842 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.835+0000 7ff348947700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3440c2bf0 0x7ff3440630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:07.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.835+0000 7ff348947700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3440be2e0 con 0x7ff3440635d0 2023-10-18T17:29:07.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.835+0000 7ff348947700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3440bda80 con 0x7ff3440658a0 2023-10-18T17:29:07.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.835+0000 7ff348947700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34406a7c0 con 0x7ff3440c2bf0 2023-10-18T17:29:07.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.835+0000 7ff33affd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3440c2bf0 0x7ff3440630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:07.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.835+0000 7ff343fff700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7ff3440635d0 0x7ff344151290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.158:33142/0 (socket says 172.21.15.158:33142) 2023-10-18T17:29:07.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.835+0000 7ff343fff700 1 -- 172.21.15.158:0/1088825060 learned_addr learned my addr 172.21.15.158:0/1088825060 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:29:07.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.835+0000 7ff3437fe700 1 --2- 172.21.15.158:0/1088825060 >> v2:172.21.15.183:3300/0 conn(0x7ff3440658a0 0x7ff344065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:07.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.835+0000 7ff342ffd700 1 -- 172.21.15.158:0/1088825060 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819596163 0 0) 0x7ff3440be2e0 con 0x7ff3440635d0 2023-10-18T17:29:07.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.835+0000 7ff342ffd700 1 -- 172.21.15.158:0/1088825060 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3300033f0 con 0x7ff3440635d0 2023-10-18T17:29:07.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.835+0000 7ff33affd700 1 -- 172.21.15.158:0/1088825060 >> v2:172.21.15.183:3300/0 conn(0x7ff3440658a0 msgr2=0x7ff344065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:29:07.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.835+0000 7ff33affd700 1 --2- 172.21.15.158:0/1088825060 >> v2:172.21.15.183:3300/0 conn(0x7ff3440658a0 0x7ff344065c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:07.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.835+0000 7ff33affd700 1 -- 172.21.15.158:0/1088825060 >> v1:172.21.15.183:6789/0 conn(0x7ff3440635d0 legacy=0x7ff344151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:07.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.835+0000 7ff33affd700 1 -- 172.21.15.158:0/1088825060 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3440be770 con 0x7ff3440c2bf0 2023-10-18T17:29:07.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.839+0000 7ff33affd700 1 --2- 172.21.15.158:0/1088825060 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3440c2bf0 0x7ff3440630e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ff32c009760 tx=0x7ff32c009060).ready entity=mon.2 client_cookie=3199e15f94cfba48 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:29:07.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.839+0000 7ff342ffd700 1 -- 172.21.15.158:0/1088825060 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00d4a0 con 0x7ff3440c2bf0 2023-10-18T17:29:07.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.839+0000 7ff342ffd700 1 -- 172.21.15.158:0/1088825060 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c00d600 con 0x7ff3440c2bf0 2023-10-18T17:29:07.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.839+0000 7ff342ffd700 1 -- 172.21.15.158:0/1088825060 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00d980 con 0x7ff3440c2bf0 2023-10-18T17:29:07.849 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.839+0000 7ff348947700 1 -- 172.21.15.158:0/1088825060 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3440c2bf0 msgr2=0x7ff3440630e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:07.849 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.839+0000 7ff348947700 1 --2- 172.21.15.158:0/1088825060 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3440c2bf0 0x7ff3440630e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ff32c009760 tx=0x7ff32c009060).stop 2023-10-18T17:29:07.849 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.839+0000 7ff348947700 1 -- 172.21.15.158:0/1088825060 shutdown_connections 2023-10-18T17:29:07.849 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.839+0000 7ff348947700 1 --2- 172.21.15.158:0/1088825060 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3440c2bf0 0x7ff3440630e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:07.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.839+0000 7ff348947700 1 --2- 172.21.15.158:0/1088825060 >> v2:172.21.15.183:3300/0 conn(0x7ff3440658a0 0x7ff344065c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:07.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.839+0000 7ff348947700 1 -- 172.21.15.158:0/1088825060 >> 172.21.15.158:0/1088825060 conn(0x7ff344062ba0 msgr2=0x7ff3440c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:29:07.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.839+0000 7ff348947700 1 -- 172.21.15.158:0/1088825060 shutdown_connections 2023-10-18T17:29:07.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.839+0000 7ff348947700 1 -- 172.21.15.158:0/1088825060 wait complete. 2023-10-18T17:29:07.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.843+0000 7ff348947700 1 Processor -- start 2023-10-18T17:29:07.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.843+0000 7ff348947700 1 -- start start 2023-10-18T17:29:07.853 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.843+0000 7ff348947700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3440635d0 0x7ff34414d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:07.853 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.843+0000 7ff348947700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3440658a0 0x7ff3440a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:07.854 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.843+0000 7ff348947700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3440c2bf0 0x7ff3440a5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:07.854 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.843+0000 7ff348947700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff344163900 con 0x7ff3440c2bf0 2023-10-18T17:29:07.854 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.843+0000 7ff348947700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff344160030 con 0x7ff3440658a0 2023-10-18T17:29:07.854 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.843+0000 7ff348947700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff344160b70 con 0x7ff3440635d0 2023-10-18T17:29:07.855 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.843+0000 7ff33affd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3440658a0 0x7ff3440a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:07.855 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.843+0000 7ff3437fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3440635d0 0x7ff34414d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:07.855 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.843+0000 7ff33affd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3440658a0 0x7ff3440a4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:56246/0 (socket says 172.21.15.158:56246) 2023-10-18T17:29:07.855 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.843+0000 7ff33affd700 1 -- 172.21.15.158:0/2165759643 learned_addr learned my addr 172.21.15.158:0/2165759643 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:29:07.856 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.843+0000 7ff343fff700 1 --2- 172.21.15.158:0/2165759643 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3440c2bf0 0x7ff3440a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:07.856 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.843+0000 7ff33affd700 1 -- 172.21.15.158:0/2165759643 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3440635d0 msgr2=0x7ff34414d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:07.856 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.843+0000 7ff33affd700 1 --2- 172.21.15.158:0/2165759643 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3440635d0 0x7ff34414d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:07.856 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.843+0000 7ff33affd700 1 -- 172.21.15.158:0/2165759643 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3440c2bf0 msgr2=0x7ff3440a5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:07.857 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.843+0000 7ff33affd700 1 --2- 172.21.15.158:0/2165759643 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3440c2bf0 0x7ff3440a5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:07.857 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.847+0000 7ff33affd700 1 -- 172.21.15.158:0/2165759643 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c0092a0 con 0x7ff3440658a0 2023-10-18T17:29:07.857 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.847+0000 7ff33affd700 1 --2- 172.21.15.158:0/2165759643 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3440658a0 0x7ff3440a4e80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7ff32c011fb0 tx=0x7ff32c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:29:07.857 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.847+0000 7ff33bfff700 1 -- 172.21.15.158:0/2165759643 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00dd30 con 0x7ff3440658a0 2023-10-18T17:29:07.857 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.847+0000 7ff33bfff700 1 -- 172.21.15.158:0/2165759643 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c00de90 con 0x7ff3440658a0 2023-10-18T17:29:07.858 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.847+0000 7ff348947700 1 -- 172.21.15.158:0/2165759643 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff344161000 con 0x7ff3440658a0 2023-10-18T17:29:07.858 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.847+0000 7ff33bfff700 1 -- 172.21.15.158:0/2165759643 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00d980 con 0x7ff3440658a0 2023-10-18T17:29:07.858 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.847+0000 7ff348947700 1 -- 172.21.15.158:0/2165759643 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff344163620 con 0x7ff3440658a0 2023-10-18T17:29:07.859 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.847+0000 7ff348947700 1 -- 172.21.15.158:0/2165759643 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff344046f00 con 0x7ff3440658a0 2023-10-18T17:29:07.859 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.851+0000 7ff33bfff700 1 -- 172.21.15.158:0/2165759643 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff32c01d640 con 0x7ff3440658a0 2023-10-18T17:29:07.859 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.851+0000 7ff33bfff700 1 --2- 172.21.15.158:0/2165759643 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff32405a4e0 0x7ff32405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:07.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.851+0000 7ff33bfff700 1 -- 172.21.15.158:0/2165759643 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7ff32c076550 con 0x7ff3440658a0 2023-10-18T17:29:07.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.851+0000 7ff3437fe700 1 --2- 172.21.15.158:0/2165759643 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff32405a4e0 0x7ff32405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:07.860 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.851+0000 7ff3437fe700 1 --2- 172.21.15.158:0/2165759643 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff32405a4e0 0x7ff32405c9a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7ff33400f570 tx=0x7ff33400b040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:29:07.865 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:07.859+0000 7ff33bfff700 1 -- 172.21.15.158:0/2165759643 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7ff32c049a90 con 0x7ff3440658a0 2023-10-18T17:29:07.927 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~241s 2023-10-18T17:29:07.927 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~296s 2023-10-18T17:29:07.927 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~222s 2023-10-18T17:29:07.927 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~208s 2023-10-18T17:29:07.928 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~255s 2023-10-18T17:29:07.928 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~196s 2023-10-18T17:29:08.060 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:08.051+0000 7ff348947700 1 -- 172.21.15.158:0/2165759643 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff344160fe0 con 0x7ff3440658a0 2023-10-18T17:29:08.060 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:08.055+0000 7ff33bfff700 1 -- 172.21.15.158:0/2165759643 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7ff32c04d0b0 con 0x7ff3440658a0 2023-10-18T17:29:08.061 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:29:08.064 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:08.059+0000 7ff348947700 1 -- 172.21.15.158:0/2165759643 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff32405a4e0 msgr2=0x7ff32405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:08.065 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:08.059+0000 7ff348947700 1 --2- 172.21.15.158:0/2165759643 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff32405a4e0 0x7ff32405c9a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7ff33400f570 tx=0x7ff33400b040).stop 2023-10-18T17:29:08.065 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:08.059+0000 7ff348947700 1 -- 172.21.15.158:0/2165759643 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3440658a0 msgr2=0x7ff3440a4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:08.065 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:08.059+0000 7ff348947700 1 --2- 172.21.15.158:0/2165759643 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3440658a0 0x7ff3440a4e80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7ff32c011fb0 tx=0x7ff32c016000).stop 2023-10-18T17:29:08.065 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:08.059+0000 7ff348947700 1 -- 172.21.15.158:0/2165759643 shutdown_connections 2023-10-18T17:29:08.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:08.059+0000 7ff348947700 1 --2- 172.21.15.158:0/2165759643 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7ff32405a4e0 0x7ff32405c9a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:08.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:08.059+0000 7ff348947700 1 --2- 172.21.15.158:0/2165759643 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3440c2bf0 0x7ff3440a5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:08.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:08.059+0000 7ff348947700 1 --2- 172.21.15.158:0/2165759643 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3440658a0 0x7ff3440a4e80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:08.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:08.059+0000 7ff348947700 1 --2- 172.21.15.158:0/2165759643 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3440635d0 0x7ff34414d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:08.066 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:08.059+0000 7ff348947700 1 -- 172.21.15.158:0/2165759643 >> 172.21.15.158:0/2165759643 conn(0x7ff344062ba0 msgr2=0x7ff3440c1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:29:08.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:08.059+0000 7ff348947700 1 -- 172.21.15.158:0/2165759643 shutdown_connections 2023-10-18T17:29:08.067 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:08.059+0000 7ff348947700 1 -- 172.21.15.158:0/2165759643 wait complete. 2023-10-18T17:29:08.087 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:29:11.088 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:29:11.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.243+0000 7f16c1bb9700 1 Processor -- start 2023-10-18T17:29:11.251 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.243+0000 7f16c1bb9700 1 -- start start 2023-10-18T17:29:11.253 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16c1bb9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16bc0c2bf0 0x7f16bc065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:11.253 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16c1bb9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16bc0be2e0 con 0x7f16bc0658a0 2023-10-18T17:29:11.253 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16c1bb9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16bc0be770 con 0x7f16bc0bd1c0 2023-10-18T17:29:11.254 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16c1bb9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc0bda80 con 0x7f16bc0c2bf0 2023-10-18T17:29:11.254 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16c0bb7700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f16bc0658a0 0x7f16bc0630e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:50734/0 (socket says 172.21.15.158:50734) 2023-10-18T17:29:11.254 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16c0bb7700 1 -- 172.21.15.158:0/2381559359 learned_addr learned my addr 172.21.15.158:0/2381559359 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:29:11.255 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16b3fff700 1 --2- 172.21.15.158:0/2381559359 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16bc0c2bf0 0x7f16bc065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:11.256 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16b37fe700 1 -- 172.21.15.158:0/2381559359 <== mon.0 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917182029 0 0) 0x7f16bc0be2e0 con 0x7f16bc0658a0 2023-10-18T17:29:11.256 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16b37fe700 1 -- 172.21.15.158:0/2381559359 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16a40033f0 con 0x7f16bc0658a0 2023-10-18T17:29:11.257 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16b37fe700 1 -- 172.21.15.158:0/2381559359 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302238523 0 0) 0x7f16bc0be770 con 0x7f16bc0bd1c0 2023-10-18T17:29:11.257 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16b3fff700 1 -- 172.21.15.158:0/2381559359 >> v1:172.21.15.183:6789/0 conn(0x7f16bc0bd1c0 legacy=0x7f16bc14ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:11.257 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16b3fff700 1 -- 172.21.15.158:0/2381559359 >> v1:172.21.15.158:6789/0 conn(0x7f16bc0658a0 legacy=0x7f16bc0630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:11.257 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16b3fff700 1 -- 172.21.15.158:0/2381559359 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc0b9580 con 0x7f16bc0c2bf0 2023-10-18T17:29:11.258 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16b3fff700 1 --2- 172.21.15.158:0/2381559359 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16bc0c2bf0 0x7f16bc065c80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f16ac009790 tx=0x7f16ac009060).ready entity=mon.2 client_cookie=5fa9bec383b0d962 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:29:11.258 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16b37fe700 1 -- 172.21.15.158:0/2381559359 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac00d4a0 con 0x7f16bc0c2bf0 2023-10-18T17:29:11.258 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16b37fe700 1 -- 172.21.15.158:0/2381559359 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ac00d600 con 0x7f16bc0c2bf0 2023-10-18T17:29:11.258 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16b37fe700 1 -- 172.21.15.158:0/2381559359 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac00d980 con 0x7f16bc0c2bf0 2023-10-18T17:29:11.259 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16c1bb9700 1 -- 172.21.15.158:0/2381559359 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16bc0c2bf0 msgr2=0x7f16bc065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:11.259 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16c1bb9700 1 --2- 172.21.15.158:0/2381559359 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16bc0c2bf0 0x7f16bc065c80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f16ac009790 tx=0x7f16ac009060).stop 2023-10-18T17:29:11.259 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16c1bb9700 1 -- 172.21.15.158:0/2381559359 shutdown_connections 2023-10-18T17:29:11.259 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16c1bb9700 1 --2- 172.21.15.158:0/2381559359 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16bc0c2bf0 0x7f16bc065c80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:11.259 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.247+0000 7f16c1bb9700 1 -- 172.21.15.158:0/2381559359 >> 172.21.15.158:0/2381559359 conn(0x7f16bc062ba0 msgr2=0x7f16bc0c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:29:11.260 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.251+0000 7f16c1bb9700 1 -- 172.21.15.158:0/2381559359 shutdown_connections 2023-10-18T17:29:11.260 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.251+0000 7f16c1bb9700 1 -- 172.21.15.158:0/2381559359 wait complete. 2023-10-18T17:29:11.261 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.251+0000 7f16c1bb9700 1 Processor -- start 2023-10-18T17:29:11.262 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.251+0000 7f16c1bb9700 1 -- start start 2023-10-18T17:29:11.262 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.251+0000 7f16c1bb9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16bc0658a0 0x7f16bc0b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:11.262 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.251+0000 7f16c1bb9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16bc0bd1c0 0x7f16bc14c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:11.262 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.251+0000 7f16c1bb9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16bc0c2bf0 0x7f16bc0b7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:11.263 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.251+0000 7f16c1bb9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc0b58c0 con 0x7f16bc0bd1c0 2023-10-18T17:29:11.263 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.251+0000 7f16c1bb9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc0b77c0 con 0x7f16bc0658a0 2023-10-18T17:29:11.263 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.251+0000 7f16c1bb9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc0b6860 con 0x7f16bc0c2bf0 2023-10-18T17:29:11.263 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.255+0000 7f16c0bb7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16bc0658a0 0x7f16bc0b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:11.264 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.255+0000 7f16c0bb7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16bc0658a0 0x7f16bc0b6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.158:48070/0 (socket says 172.21.15.158:48070) 2023-10-18T17:29:11.264 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.255+0000 7f16b3fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16bc0bd1c0 0x7f16bc14c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:11.264 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.255+0000 7f16c0bb7700 1 -- 172.21.15.158:0/2684697893 learned_addr learned my addr 172.21.15.158:0/2684697893 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:29:11.264 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.255+0000 7f16c13b8700 1 --2- 172.21.15.158:0/2684697893 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16bc0c2bf0 0x7f16bc0b7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:11.264 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.255+0000 7f16c0bb7700 1 -- 172.21.15.158:0/2684697893 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16bc0c2bf0 msgr2=0x7f16bc0b7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:11.265 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.255+0000 7f16c0bb7700 1 --2- 172.21.15.158:0/2684697893 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16bc0c2bf0 0x7f16bc0b7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:11.265 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.255+0000 7f16c0bb7700 1 -- 172.21.15.158:0/2684697893 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16bc0bd1c0 msgr2=0x7f16bc14c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:11.265 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.255+0000 7f16c0bb7700 1 --2- 172.21.15.158:0/2684697893 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16bc0bd1c0 0x7f16bc14c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:11.265 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.255+0000 7f16c0bb7700 1 -- 172.21.15.158:0/2684697893 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac0092a0 con 0x7f16bc0658a0 2023-10-18T17:29:11.265 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.255+0000 7f16b3fff700 1 --2- 172.21.15.158:0/2684697893 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16bc0bd1c0 0x7f16bc14c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T17:29:11.266 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.255+0000 7f16c0bb7700 1 --2- 172.21.15.158:0/2684697893 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16bc0658a0 0x7f16bc0b6240 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f16b800c840 tx=0x7f16b8007bf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:29:11.267 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.255+0000 7f16b0ff9700 1 -- 172.21.15.158:0/2684697893 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8007170 con 0x7f16bc0658a0 2023-10-18T17:29:11.267 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.255+0000 7f16b0ff9700 1 -- 172.21.15.158:0/2684697893 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b80072d0 con 0x7f16bc0658a0 2023-10-18T17:29:11.267 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.255+0000 7f16c1bb9700 1 -- 172.21.15.158:0/2684697893 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16bc0b6b40 con 0x7f16bc0658a0 2023-10-18T17:29:11.268 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.255+0000 7f16b0ff9700 1 -- 172.21.15.158:0/2684697893 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b80048c0 con 0x7f16bc0658a0 2023-10-18T17:29:11.268 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.255+0000 7f16c1bb9700 1 -- 172.21.15.158:0/2684697893 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16bc0b7450 con 0x7f16bc0658a0 2023-10-18T17:29:11.268 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.255+0000 7f16c1bb9700 1 -- 172.21.15.158:0/2684697893 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16bc046f00 con 0x7f16bc0658a0 2023-10-18T17:29:11.268 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.259+0000 7f16b0ff9700 1 -- 172.21.15.158:0/2684697893 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f16b8004c30 con 0x7f16bc0658a0 2023-10-18T17:29:11.269 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.259+0000 7f16b0ff9700 1 --2- 172.21.15.158:0/2684697893 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f16a805a510 0x7f16a805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:11.269 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.259+0000 7f16b0ff9700 1 -- 172.21.15.158:0/2684697893 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f16b8074220 con 0x7f16bc0658a0 2023-10-18T17:29:11.269 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.259+0000 7f16b3fff700 1 --2- 172.21.15.158:0/2684697893 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f16a805a510 0x7f16a805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:11.270 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.263+0000 7f16b3fff700 1 --2- 172.21.15.158:0/2684697893 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f16a805a510 0x7f16a805c9d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f16ac009790 tx=0x7f16ac016000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:29:11.277 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.271+0000 7f16b0ff9700 1 -- 172.21.15.158:0/2684697893 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f16b8047680 con 0x7f16bc0658a0 2023-10-18T17:29:11.474 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.467+0000 7f16c1bb9700 1 -- 172.21.15.158:0/2684697893 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f16bc0a8050 con 0x7f16bc0658a0 2023-10-18T17:29:11.475 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.467+0000 7f16b0ff9700 1 -- 172.21.15.158:0/2684697893 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f16b8019020 con 0x7f16bc0658a0 2023-10-18T17:29:11.475 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:29:11.477 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.471+0000 7f16c1bb9700 1 -- 172.21.15.158:0/2684697893 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f16a805a510 msgr2=0x7f16a805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:11.477 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.471+0000 7f16c1bb9700 1 --2- 172.21.15.158:0/2684697893 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f16a805a510 0x7f16a805c9d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f16ac009790 tx=0x7f16ac016000).stop 2023-10-18T17:29:11.478 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.471+0000 7f16c1bb9700 1 -- 172.21.15.158:0/2684697893 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16bc0658a0 msgr2=0x7f16bc0b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:11.478 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.471+0000 7f16c1bb9700 1 --2- 172.21.15.158:0/2684697893 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16bc0658a0 0x7f16bc0b6240 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f16b800c840 tx=0x7f16b8007bf0).stop 2023-10-18T17:29:11.478 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.471+0000 7f16c1bb9700 1 -- 172.21.15.158:0/2684697893 shutdown_connections 2023-10-18T17:29:11.478 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.471+0000 7f16c1bb9700 1 --2- 172.21.15.158:0/2684697893 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f16a805a510 0x7f16a805c9d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:11.479 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.471+0000 7f16c1bb9700 1 --2- 172.21.15.158:0/2684697893 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16bc0c2bf0 0x7f16bc0b7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:11.479 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.471+0000 7f16c1bb9700 1 --2- 172.21.15.158:0/2684697893 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f16bc0bd1c0 0x7f16bc14c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:11.480 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.471+0000 7f16c1bb9700 1 --2- 172.21.15.158:0/2684697893 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16bc0658a0 0x7f16bc0b6240 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:11.480 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.471+0000 7f16c1bb9700 1 -- 172.21.15.158:0/2684697893 >> 172.21.15.158:0/2684697893 conn(0x7f16bc062ba0 msgr2=0x7f16bc0baa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:29:11.481 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.471+0000 7f16c1bb9700 1 -- 172.21.15.158:0/2684697893 shutdown_connections 2023-10-18T17:29:11.482 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:11.471+0000 7f16c1bb9700 1 -- 172.21.15.158:0/2684697893 wait complete. 2023-10-18T17:29:11.499 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:29:14.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~248s 2023-10-18T17:29:14.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~302s 2023-10-18T17:29:14.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~228s 2023-10-18T17:29:14.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~215s 2023-10-18T17:29:14.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~261s 2023-10-18T17:29:14.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~202s 2023-10-18T17:29:14.240 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-10-18T17:29:14.500 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:29:14.668 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.659+0000 7f63e181b700 1 Processor -- start 2023-10-18T17:29:14.669 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.663+0000 7f63e181b700 1 -- start start 2023-10-18T17:29:14.670 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.663+0000 7f63e181b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63dc062d60 0x7f63dc153970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:14.670 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.663+0000 7f63e181b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f63dc153e60 0x7f63dc0c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:14.671 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.663+0000 7f63e181b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63dc0c1790 con 0x7f63dc062270 2023-10-18T17:29:14.671 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.663+0000 7f63e181b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63dc0634d0 con 0x7f63dc153e60 2023-10-18T17:29:14.671 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.663+0000 7f63e181b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc068ad0 con 0x7f63dc062d60 2023-10-18T17:29:14.672 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.663+0000 7f63daffd700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f63dc062270 0x7f63dc062650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:50746/0 (socket says 172.21.15.158:50746) 2023-10-18T17:29:14.672 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.663+0000 7f63da7fc700 1 --2- 172.21.15.158:0/4140105636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63dc062d60 0x7f63dc153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:14.673 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.663+0000 7f63daffd700 1 -- 172.21.15.158:0/4140105636 learned_addr learned my addr 172.21.15.158:0/4140105636 (peer_addr_for_me v1:172.21.15.158:0/0) 2023-10-18T17:29:14.673 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.663+0000 7f63db7fe700 1 --2- 172.21.15.158:0/4140105636 >> v2:172.21.15.158:3300/0 conn(0x7f63dc153e60 0x7f63dc0c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:14.673 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.663+0000 7f63da7fc700 1 -- 172.21.15.158:0/4140105636 >> v2:172.21.15.158:3300/0 conn(0x7f63dc153e60 msgr2=0x7f63dc0c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T17:29:14.673 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.663+0000 7f63da7fc700 1 --2- 172.21.15.158:0/4140105636 >> v2:172.21.15.158:3300/0 conn(0x7f63dc153e60 0x7f63dc0c1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:14.673 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.663+0000 7f63da7fc700 1 -- 172.21.15.158:0/4140105636 >> v1:172.21.15.158:6789/0 conn(0x7f63dc062270 legacy=0x7f63dc062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:14.674 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.663+0000 7f63da7fc700 1 -- 172.21.15.158:0/4140105636 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc068db0 con 0x7f63dc062d60 2023-10-18T17:29:14.674 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.663+0000 7f63da7fc700 1 --2- 172.21.15.158:0/4140105636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63dc062d60 0x7f63dc153970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f63d0009760 tx=0x7f63d0009060).ready entity=mon.2 client_cookie=8be2ee360f80d8a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:29:14.674 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.663+0000 7f63d9ffb700 1 -- 172.21.15.158:0/4140105636 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d000b580 con 0x7f63dc062d60 2023-10-18T17:29:14.674 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.667+0000 7f63d9ffb700 1 -- 172.21.15.158:0/4140105636 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d000b6e0 con 0x7f63dc062d60 2023-10-18T17:29:14.674 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.667+0000 7f63d9ffb700 1 -- 172.21.15.158:0/4140105636 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d000ba60 con 0x7f63dc062d60 2023-10-18T17:29:14.675 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.667+0000 7f63e181b700 1 -- 172.21.15.158:0/4140105636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63dc062d60 msgr2=0x7f63dc153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:14.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.667+0000 7f63e181b700 1 --2- 172.21.15.158:0/4140105636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63dc062d60 0x7f63dc153970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f63d0009760 tx=0x7f63d0009060).stop 2023-10-18T17:29:14.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.667+0000 7f63e181b700 1 -- 172.21.15.158:0/4140105636 shutdown_connections 2023-10-18T17:29:14.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.667+0000 7f63e181b700 1 --2- 172.21.15.158:0/4140105636 >> v2:172.21.15.158:3300/0 conn(0x7f63dc153e60 0x7f63dc0c1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:14.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.667+0000 7f63e181b700 1 --2- 172.21.15.158:0/4140105636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63dc062d60 0x7f63dc153970 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:14.676 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.667+0000 7f63e181b700 1 -- 172.21.15.158:0/4140105636 >> 172.21.15.158:0/4140105636 conn(0x7f63dc0658b0 msgr2=0x7f63dc065c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:29:14.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.667+0000 7f63e181b700 1 -- 172.21.15.158:0/4140105636 shutdown_connections 2023-10-18T17:29:14.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.667+0000 7f63e181b700 1 -- 172.21.15.158:0/4140105636 wait complete. 2023-10-18T17:29:14.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.667+0000 7f63e181b700 1 Processor -- start 2023-10-18T17:29:14.677 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.667+0000 7f63e181b700 1 -- start start 2023-10-18T17:29:14.679 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63e181b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63dc062270 0x7f63dc156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:14.679 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63e181b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f63dc153e60 0x7f63dc157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:14.679 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63e181b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63dc0a48a0 0x7f63dc0a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:14.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63e181b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc156af0 con 0x7f63dc153e60 2023-10-18T17:29:14.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63e181b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc157960 con 0x7f63dc0a48a0 2023-10-18T17:29:14.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63e181b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc14f8c0 con 0x7f63dc062270 2023-10-18T17:29:14.680 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63da7fc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f63dc153e60 0x7f63dc157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:14.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63da7fc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f63dc153e60 0x7f63dc157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:58674/0 (socket says 172.21.15.158:58674) 2023-10-18T17:29:14.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63da7fc700 1 -- 172.21.15.158:0/4222834132 learned_addr learned my addr 172.21.15.158:0/4222834132 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T17:29:14.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63daffd700 1 --2- 172.21.15.158:0/4222834132 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63dc062270 0x7f63dc156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:14.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63db7fe700 1 --2- 172.21.15.158:0/4222834132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63dc0a48a0 0x7f63dc0a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:14.681 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63da7fc700 1 -- 172.21.15.158:0/4222834132 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63dc062270 msgr2=0x7f63dc156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:14.682 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63da7fc700 1 --2- 172.21.15.158:0/4222834132 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63dc062270 0x7f63dc156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:14.682 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63da7fc700 1 -- 172.21.15.158:0/4222834132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63dc0a48a0 msgr2=0x7f63dc0a54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:14.682 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63da7fc700 1 --2- 172.21.15.158:0/4222834132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63dc0a48a0 0x7f63dc0a54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:14.682 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63da7fc700 1 -- 172.21.15.158:0/4222834132 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d00092a0 con 0x7f63dc153e60 2023-10-18T17:29:14.682 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63daffd700 1 --2- 172.21.15.158:0/4222834132 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63dc062270 0x7f63dc156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:29:14.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63db7fe700 1 --2- 172.21.15.158:0/4222834132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63dc0a48a0 0x7f63dc0a54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T17:29:14.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63da7fc700 1 --2- 172.21.15.158:0/4222834132 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f63dc153e60 0x7f63dc157470 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f63dc068c10 tx=0x7f63d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:29:14.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63c2ffd700 1 -- 172.21.15.158:0/4222834132 <== mon.0 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d000b850 con 0x7f63dc153e60 2023-10-18T17:29:14.683 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63c2ffd700 1 -- 172.21.15.158:0/4222834132 <== mon.0 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d000b9b0 con 0x7f63dc153e60 2023-10-18T17:29:14.684 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63e181b700 1 -- 172.21.15.158:0/4222834132 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63dc0a8660 con 0x7f63dc153e60 2023-10-18T17:29:14.684 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63c2ffd700 1 -- 172.21.15.158:0/4222834132 <== mon.0 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d001b660 con 0x7f63dc153e60 2023-10-18T17:29:14.684 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.671+0000 7f63e181b700 1 -- 172.21.15.158:0/4222834132 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63dc0abbc0 con 0x7f63dc153e60 2023-10-18T17:29:14.685 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.675+0000 7f63e181b700 1 -- 172.21.15.158:0/4222834132 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63dc156c60 con 0x7f63dc153e60 2023-10-18T17:29:14.685 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.675+0000 7f63c2ffd700 1 -- 172.21.15.158:0/4222834132 <== mon.0 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f63d001ba90 con 0x7f63dc153e60 2023-10-18T17:29:14.685 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.675+0000 7f63c2ffd700 1 --2- 172.21.15.158:0/4222834132 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f63c805a540 0x7f63c805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:14.685 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.675+0000 7f63c2ffd700 1 -- 172.21.15.158:0/4222834132 <== mon.0 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f63d00764e0 con 0x7f63dc153e60 2023-10-18T17:29:14.686 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.675+0000 7f63daffd700 1 --2- 172.21.15.158:0/4222834132 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f63c805a540 0x7f63c805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T17:29:14.686 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.675+0000 7f63daffd700 1 --2- 172.21.15.158:0/4222834132 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f63c805a540 0x7f63c805ca00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f63cc001740 tx=0x7f63cc009040).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T17:29:14.689 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.683+0000 7f63c2ffd700 1 -- 172.21.15.158:0/4222834132 <== mon.0 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162466 (secure 0 0 0) 0x7f63d0049a60 con 0x7f63dc153e60 2023-10-18T17:29:14.891 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.883+0000 7f63e181b700 1 -- 172.21.15.158:0/4222834132 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f63dc0c3c90 con 0x7f63dc153e60 2023-10-18T17:29:14.892 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.883+0000 7f63c2ffd700 1 -- 172.21.15.158:0/4222834132 <== mon.0 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+195 (secure 0 0 0) 0x7f63d00290e0 con 0x7f63dc153e60 2023-10-18T17:29:14.892 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T17:29:14.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.887+0000 7f63e181b700 1 -- 172.21.15.158:0/4222834132 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f63c805a540 msgr2=0x7f63c805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:14.896 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.887+0000 7f63e181b700 1 --2- 172.21.15.158:0/4222834132 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f63c805a540 0x7f63c805ca00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f63cc001740 tx=0x7f63cc009040).stop 2023-10-18T17:29:14.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.887+0000 7f63e181b700 1 -- 172.21.15.158:0/4222834132 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f63dc153e60 msgr2=0x7f63dc157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T17:29:14.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.887+0000 7f63e181b700 1 --2- 172.21.15.158:0/4222834132 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f63dc153e60 0x7f63dc157470 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f63dc068c10 tx=0x7f63d0017000).stop 2023-10-18T17:29:14.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.887+0000 7f63e181b700 1 -- 172.21.15.158:0/4222834132 shutdown_connections 2023-10-18T17:29:14.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.887+0000 7f63e181b700 1 --2- 172.21.15.158:0/4222834132 >> [v2:172.21.15.183:6832/33555,v1:172.21.15.183:6833/33555] conn(0x7f63c805a540 0x7f63c805ca00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:14.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.887+0000 7f63e181b700 1 --2- 172.21.15.158:0/4222834132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63dc0a48a0 0x7f63dc0a54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:14.897 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.887+0000 7f63e181b700 1 --2- 172.21.15.158:0/4222834132 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f63dc153e60 0x7f63dc157470 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:14.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.887+0000 7f63e181b700 1 --2- 172.21.15.158:0/4222834132 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63dc062270 0x7f63dc156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T17:29:14.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.887+0000 7f63e181b700 1 -- 172.21.15.158:0/4222834132 >> 172.21.15.158:0/4222834132 conn(0x7f63dc0658b0 msgr2=0x7f63dc0c1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T17:29:14.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.891+0000 7f63e181b700 1 -- 172.21.15.158:0/4222834132 shutdown_connections 2023-10-18T17:29:14.898 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:14.891+0000 7f63e181b700 1 -- 172.21.15.158:0/4222834132 wait complete. 2023-10-18T17:29:14.917 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2023-10-18T17:29:15.547 INFO:tasks.ceph.osd.0:Sent signal 15 2023-10-18T17:29:15.548 INFO:tasks.ceph.osd.1:Sent signal 15 2023-10-18T17:29:15.549 INFO:tasks.ceph.osd.2:Sent signal 15 2023-10-18T17:29:15.549 INFO:tasks.ceph.osd.3:Sent signal 15 2023-10-18T17:29:15.549 INFO:tasks.ceph.osd.4:Sent signal 15 2023-10-18T17:29:15.550 INFO:tasks.ceph.osd.5:Sent signal 15 2023-10-18T17:29:15.550 INFO:tasks.ceph.osd.6:Sent signal 15 2023-10-18T17:29:15.550 INFO:tasks.ceph.osd.7:Sent signal 15 2023-10-18T17:29:15.551 INFO:tasks.ceph.mon.a:Sent signal 15 2023-10-18T17:29:15.551 INFO:tasks.ceph.mon.b:Sent signal 15 2023-10-18T17:29:15.552 INFO:tasks.ceph.mon.c:Sent signal 15 2023-10-18T17:29:15.552 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-10-18T17:29:15.552 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-10-18T17:29:15.553 INFO:tasks.ceph.osd.0.smithi158.stderr:2023-10-18T17:29:15.543+0000 7f7a3aa9f700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33180) UID: 0 2023-10-18T17:29:15.553 INFO:tasks.ceph.osd.0.smithi158.stderr:2023-10-18T17:29:15.543+0000 7f7a3aa9f700 -1 osd.0 28 *** Got signal Terminated *** 2023-10-18T17:29:15.554 INFO:tasks.ceph.osd.0.smithi158.stderr:2023-10-18T17:29:15.543+0000 7f7a3aa9f700 -1 osd.0 28 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T17:29:15.554 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-10-18T17:29:15.546+0000 7fc5ca372700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33888) UID: 0 2023-10-18T17:29:15.554 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-10-18T17:29:15.546+0000 7fc5ca372700 -1 osd.4 28 *** Got signal Terminated *** 2023-10-18T17:29:15.555 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-10-18T17:29:15.546+0000 7fc5ca372700 -1 osd.4 28 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T17:29:15.555 INFO:tasks.ceph.osd.1.smithi158.stderr:2023-10-18T17:29:15.543+0000 7fb7fedad700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33183) UID: 0 2023-10-18T17:29:15.555 INFO:tasks.ceph.osd.1.smithi158.stderr:2023-10-18T17:29:15.543+0000 7fb7fedad700 -1 osd.1 28 *** Got signal Terminated *** 2023-10-18T17:29:15.555 INFO:tasks.ceph.osd.1.smithi158.stderr:2023-10-18T17:29:15.543+0000 7fb7fedad700 -1 osd.1 28 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T17:29:15.556 INFO:tasks.ceph.osd.2.smithi158.stderr:2023-10-18T17:29:15.543+0000 7f27f4d1f700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33182) UID: 0 2023-10-18T17:29:15.556 INFO:tasks.ceph.osd.2.smithi158.stderr:2023-10-18T17:29:15.543+0000 7f27f4d1f700 -1 osd.2 28 *** Got signal Terminated *** 2023-10-18T17:29:15.556 INFO:tasks.ceph.osd.2.smithi158.stderr:2023-10-18T17:29:15.543+0000 7f27f4d1f700 -1 osd.2 28 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T17:29:15.557 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-18T17:29:15.546+0000 7fe78d9ea700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33890) UID: 0 2023-10-18T17:29:15.557 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-18T17:29:15.546+0000 7fe78d9ea700 -1 osd.5 28 *** Got signal Terminated *** 2023-10-18T17:29:15.557 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-18T17:29:15.546+0000 7fe78d9ea700 -1 osd.5 28 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T17:29:15.558 INFO:tasks.ceph.osd.3.smithi158.stderr:2023-10-18T17:29:15.543+0000 7fdf51ea9700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33186) UID: 0 2023-10-18T17:29:15.558 INFO:tasks.ceph.osd.3.smithi158.stderr:2023-10-18T17:29:15.543+0000 7fdf51ea9700 -1 osd.3 28 *** Got signal Terminated *** 2023-10-18T17:29:15.558 INFO:tasks.ceph.osd.3.smithi158.stderr:2023-10-18T17:29:15.543+0000 7fdf51ea9700 -1 osd.3 28 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T17:29:15.559 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-18T17:29:15.546+0000 7f81a83c0700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33895) UID: 0 2023-10-18T17:29:15.559 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-18T17:29:15.546+0000 7f81a83c0700 -1 osd.6 28 *** Got signal Terminated *** 2023-10-18T17:29:15.559 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-18T17:29:15.546+0000 7f81a83c0700 -1 osd.6 28 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T17:29:15.559 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-18T17:29:15.546+0000 7f0cb1fe6700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33892) UID: 0 2023-10-18T17:29:15.560 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-18T17:29:15.546+0000 7f0cb1fe6700 -1 osd.7 28 *** Got signal Terminated *** 2023-10-18T17:29:15.560 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-18T17:29:15.546+0000 7f0cb1fe6700 -1 osd.7 28 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T17:29:15.560 INFO:tasks.ceph.mon.a.smithi158.stderr:2023-10-18T17:29:15.547+0000 7fc4819a8700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 33063) UID: 0 2023-10-18T17:29:15.560 INFO:tasks.ceph.mon.a.smithi158.stderr:2023-10-18T17:29:15.547+0000 7fc4819a8700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-18T17:29:15.561 INFO:tasks.ceph.mon.b.smithi183.stderr:2023-10-18T17:29:15.546+0000 7f501df37700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 33546) UID: 0 2023-10-18T17:29:15.561 INFO:tasks.ceph.mon.b.smithi183.stderr:2023-10-18T17:29:15.546+0000 7f501df37700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-10-18T17:29:15.562 INFO:tasks.ceph.mon.c.smithi183.stderr:2023-10-18T17:29:15.546+0000 7efe60271700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 33549) UID: 0 2023-10-18T17:29:15.562 INFO:tasks.ceph.mon.c.smithi183.stderr:2023-10-18T17:29:15.546+0000 7efe60271700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-10-18T17:29:15.562 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:29:15.546+0000 7fa69aadc700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 33551) UID: 0 2023-10-18T17:29:15.562 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-18T17:29:15.546+0000 7fa69aadc700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-10-18T17:29:15.755 INFO:tasks.ceph.mgr.y.smithi158.stderr:daemon-helper: command crashed with signal 15 2023-10-18T17:29:17.918 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T17:29:18.077 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.071+0000 7f4edcdb9700 1 Processor -- start 2023-10-18T17:29:18.077 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.071+0000 7f4edcdb9700 1 -- start start 2023-10-18T17:29:18.079 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.071+0000 7f4edcdb9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ed80658a0 0x7f4ed8065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:18.079 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.071+0000 7f4edcdb9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 0x7f4ed80c2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:18.079 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.071+0000 7f4edcdb9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ed80c2b20 0x7f4ed80630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:18.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.071+0000 7f4edcdb9700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ed8069f20 2023-10-18T17:29:18.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.071+0000 7f4edcdb9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ed80c2b20 2023-10-18T17:29:18.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.071+0000 7f4edcdb9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed806a480 con 0x7f4ed80658a0 2023-10-18T17:29:18.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.071+0000 7f4ecffff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 msgr2=0x7f4ed80c2630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:18.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.071+0000 7f4ecffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 0x7f4ed80c2630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:18.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.071+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ed80658a0 msgr2=0x7f4ed8065c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:18.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.071+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ed80658a0 0x7f4ed8065c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:18.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.071+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ed80c2b20 msgr2=0x7f4ed80630e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:18.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.071+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ed80c2b20 0x7f4ed80630e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:18.281 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.275+0000 7f4ecffff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 msgr2=0x7f4ed80c2630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:18.281 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.275+0000 7f4ecffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 0x7f4ed80c2630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:18.282 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.275+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ed80658a0 msgr2=0x7f4ed8065c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:18.282 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.275+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ed80c2b20 msgr2=0x7f4ed80630e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:18.282 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.275+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ed80c2b20 0x7f4ed80630e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:18.282 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.275+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ed80658a0 0x7f4ed8065c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:18.685 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.679+0000 7f4ecffff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 msgr2=0x7f4ed80c2630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:18.685 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.679+0000 7f4ecffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 0x7f4ed80c2630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:18.685 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.679+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ed80c2b20 msgr2=0x7f4ed80630e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:18.685 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.679+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ed80658a0 msgr2=0x7f4ed8065c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:18.686 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.679+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ed80c2b20 0x7f4ed80630e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:18.686 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:18.679+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ed80658a0 0x7f4ed8065c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:19.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:19.483+0000 7f4ecffff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 msgr2=0x7f4ed80c2630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:19.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:19.483+0000 7f4ecffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 0x7f4ed80c2630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:19.490 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:19.483+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ed80658a0 msgr2=0x7f4ed8065c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:19.490 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:19.483+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ed80c2b20 msgr2=0x7f4ed80630e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:19.490 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:19.483+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ed80658a0 0x7f4ed8065c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:19.490 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:19.483+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ed80c2b20 0x7f4ed80630e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:21.079 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:21.071+0000 7f4ed5ffb700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ed80658a0 msgr2=0x7f4ed8065c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:21.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:21.071+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ed80658a0 0x7f4ed8065c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:29:21.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:21.071+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ed80c2b20 msgr2=0x7f4ed80630e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:21.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:21.071+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ed80c2b20 0x7f4ed80630e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:29:21.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:21.071+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 msgr2=0x7f4ed80c2630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:21.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:21.071+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 0x7f4ed80c2630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:29:21.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:21.071+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed814fe30 con 0x7f4ebc0072c0 2023-10-18T17:29:21.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:21.071+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00c030 con 0x7f4ebc003580 2023-10-18T17:29:21.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:21.071+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc0072c0 legacy=0x7f4ebc009780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:21.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:21.071+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc003580 legacy=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:21.280 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:21.275+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc0072c0 legacy=0x7f4ebc009780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:21.281 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:21.275+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc003580 legacy=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:21.685 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:21.679+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc0072c0 legacy=0x7f4ebc009780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:21.685 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:21.679+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc003580 legacy=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:22.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:22.483+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc0072c0 legacy=0x7f4ebc009780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:22.489 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:22.483+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc003580 legacy=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:24.080 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.075+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc003580 legacy=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:24.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.075+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc0072c0 legacy=0x7f4ebc009780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:24.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.075+0000 7f4ed7fff700 1 -- reap_dead start 2023-10-18T17:29:24.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.075+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 0x7f4ebc00c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:24.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.075+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00cb90 0x7f4ebc009700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:24.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.075+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00d230 con 0x7f4ebc00c6e0 2023-10-18T17:29:24.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.075+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ed8069f20 2023-10-18T17:29:24.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.075+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ebc00cb90 2023-10-18T17:29:24.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.075+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00c6e0 legacy=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:24.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.075+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 msgr2=0x7f4ebc00c1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:24.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.075+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 0x7f4ebc00c1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:24.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.075+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00cb90 msgr2=0x7f4ebc009700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:24.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.075+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00cb90 0x7f4ebc009700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:24.285 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.279+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 msgr2=0x7f4ebc00c1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:24.285 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.279+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00c6e0 legacy=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:24.285 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.279+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 0x7f4ebc00c1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:24.285 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.279+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00cb90 msgr2=0x7f4ebc009700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:24.286 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.279+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00cb90 0x7f4ebc009700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:24.689 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.683+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00c6e0 legacy=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:24.689 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.683+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 msgr2=0x7f4ebc00c1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:24.689 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.683+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 0x7f4ebc00c1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:24.689 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.683+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00cb90 msgr2=0x7f4ebc009700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:24.690 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:24.683+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00cb90 0x7f4ebc009700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:25.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:25.487+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 msgr2=0x7f4ebc00c1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:25.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:25.487+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00c6e0 legacy=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:25.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:25.487+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 0x7f4ebc00c1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:25.494 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:25.487+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00cb90 msgr2=0x7f4ebc009700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:25.494 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:25.487+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00cb90 0x7f4ebc009700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:27.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:27.071+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00cb90 msgr2=0x7f4ebc009700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:27.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:27.071+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00cb90 0x7f4ebc009700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:29:27.081 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:27.071+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 msgr2=0x7f4ebc00c1f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:27.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:27.071+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ed8069f20 0x7f4ebc00c1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:29:27.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:27.071+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00c6e0 legacy=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:27.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:27.071+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc009eb0 0x7f4ebc00a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:27.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:27.075+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed814fe30 con 0x7f4ebc00a780 2023-10-18T17:29:27.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:27.075+0000 7f4ed5ffb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc009eb0 2023-10-18T17:29:27.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:27.075+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc009eb0 msgr2=0x7f4ebc00a290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:27.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:27.075+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc00a780 legacy=0x7f4ebc006110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:27.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:27.075+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc009eb0 0x7f4ebc00a290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:27.285 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:27.279+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc009eb0 msgr2=0x7f4ebc00a290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:27.286 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:27.279+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc00a780 legacy=0x7f4ebc006110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:27.286 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:27.279+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc009eb0 0x7f4ebc00a290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:27.689 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:27.683+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc009eb0 msgr2=0x7f4ebc00a290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:27.689 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:27.683+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc00a780 legacy=0x7f4ebc006110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:27.689 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:27.683+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc009eb0 0x7f4ebc00a290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:28.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:28.487+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc009eb0 msgr2=0x7f4ebc00a290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:28.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:28.487+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc00a780 legacy=0x7f4ebc006110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:28.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:28.487+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc009eb0 0x7f4ebc00a290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:30.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.075+0000 7f4ed5ffb700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc009eb0 msgr2=0x7f4ebc00a290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:30.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.075+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc009eb0 0x7f4ebc00a290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:29:30.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.075+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc00a780 legacy=0x7f4ebc006110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:30.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.075+0000 7f4ed7fff700 1 -- reap_dead start 2023-10-18T17:29:30.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.075+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 0x7f4ebc009700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:30.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.075+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009e90 0x7f4ebc006110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:30.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.075+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00d230 con 0x7f4ebc00c6e0 2023-10-18T17:29:30.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.075+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc00c1f0 2023-10-18T17:29:30.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.075+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ebc009e90 2023-10-18T17:29:30.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.075+0000 7f4ecffff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 msgr2=0x7f4ebc009700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:30.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.075+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009e90 msgr2=0x7f4ebc006110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:30.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.075+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00c6e0 legacy=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:30.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.075+0000 7f4ecffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 0x7f4ebc009700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:30.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.075+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009e90 0x7f4ebc006110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:30.285 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.279+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009e90 msgr2=0x7f4ebc006110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:30.285 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.279+0000 7f4ecffff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 msgr2=0x7f4ebc009700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:30.286 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.279+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00c6e0 legacy=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:30.286 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.279+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009e90 0x7f4ebc006110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:30.286 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.279+0000 7f4ecffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 0x7f4ebc009700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:30.689 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.683+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00c6e0 legacy=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:30.689 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.683+0000 7f4ecffff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 msgr2=0x7f4ebc009700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:30.689 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.683+0000 7f4ecffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 0x7f4ebc009700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:30.690 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.683+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009e90 msgr2=0x7f4ebc006110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:30.690 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:30.683+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009e90 0x7f4ebc006110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:31.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:31.487+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00c6e0 legacy=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:31.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:31.487+0000 7f4ecffff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 msgr2=0x7f4ebc009700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:31.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:31.487+0000 7f4ecffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 0x7f4ebc009700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:31.494 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:31.487+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009e90 msgr2=0x7f4ebc006110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:31.494 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:31.487+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009e90 0x7f4ebc006110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:33.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:33.075+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009e90 msgr2=0x7f4ebc006110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:33.082 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:33.075+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009e90 0x7f4ebc006110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:29:33.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:33.075+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 msgr2=0x7f4ebc009700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:33.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:33.075+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 0x7f4ebc009700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:29:33.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:33.075+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00c6e0 legacy=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:33.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:33.075+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc006600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:33.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:33.075+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed814fe30 con 0x7f4ebc006af0 2023-10-18T17:29:33.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:33.075+0000 7f4ed5ffb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc00a2d0 2023-10-18T17:29:33.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:33.075+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc006af0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:33.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:33.075+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:33.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:33.075+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:33.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:33.279+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc006af0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:33.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:33.279+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:33.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:33.279+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:33.689 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:33.683+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:33.689 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:33.683+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc006af0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:33.689 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:33.683+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:34.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:34.487+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc006af0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:34.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:34.487+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:34.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:34.487+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:34.620 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:29:34.628 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:29:36.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.075+0000 7f4ed5ffb700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc006600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:36.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.075+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:29:36.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.075+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc006af0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:36.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.075+0000 7f4ed7fff700 1 -- reap_dead start 2023-10-18T17:29:36.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.075+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc006600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:36.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.075+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00d230 con 0x7f4ebc009e90 2023-10-18T17:29:36.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.075+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed814fe30 con 0x7f4ebc014c70 2023-10-18T17:29:36.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.075+0000 7f4ed5ffb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc00a2d0 2023-10-18T17:29:36.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.075+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc014c70 legacy=0x7f4ebc017060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:36.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.075+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:36.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.075+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:36.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.075+0000 7f4ed7fff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:36.285 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.279+0000 7f4ed7fff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:36.285 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.279+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:36.285 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.279+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc014c70 legacy=0x7f4ebc017060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:36.286 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.279+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:36.690 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.683+0000 7f4ed7fff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:36.690 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.683+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc014c70 legacy=0x7f4ebc017060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:36.690 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.683+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:36.691 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:36.683+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:37.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:37.487+0000 7f4ed7fff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:37.493 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:37.487+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc014c70 legacy=0x7f4ebc017060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:37.494 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:37.487+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:37.494 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:37.487+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:39.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.079+0000 7f4ed5ffb700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc006600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:39.083 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.079+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:29:39.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.079+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc014c70 legacy=0x7f4ebc017060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:39.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.079+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:39.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.079+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 0x7f4ebc00b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:39.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.079+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00c6e0 0x7f4ebc005a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:39.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.079+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc00c1f0 2023-10-18T17:29:39.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.079+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ebc00c6e0 2023-10-18T17:29:39.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.079+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 msgr2=0x7f4ebc00b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:39.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.079+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 0x7f4ebc00b6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:39.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.079+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00c6e0 msgr2=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:39.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.079+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00c6e0 0x7f4ebc005a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:39.289 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.283+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 msgr2=0x7f4ebc00b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:39.289 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.283+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 0x7f4ebc00b6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:39.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.283+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00c6e0 msgr2=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:39.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.283+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00c6e0 0x7f4ebc005a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:39.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.687+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 msgr2=0x7f4ebc00b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:39.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.687+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 0x7f4ebc00b6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:39.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.687+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00c6e0 msgr2=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:39.694 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:39.687+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00c6e0 0x7f4ebc005a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:40.497 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:40.491+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 msgr2=0x7f4ebc00b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:40.497 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:40.491+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 0x7f4ebc00b6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:40.498 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:40.491+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00c6e0 msgr2=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:40.498 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:40.491+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00c6e0 0x7f4ebc005a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:42.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.079+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00c6e0 msgr2=0x7f4ebc005a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:42.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.079+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00c6e0 0x7f4ebc005a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:29:42.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.079+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 msgr2=0x7f4ebc00b6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:42.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.079+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00c1f0 0x7f4ebc00b6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:29:42.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.079+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00bbe0 0x7f4ebc005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:42.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.079+0000 7f4ed7fff700 1 -- reap_dead start 2023-10-18T17:29:42.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.079+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc00b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:42.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.079+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00c030 con 0x7f4ebc009e90 2023-10-18T17:29:42.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.079+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc00bbe0 2023-10-18T17:29:42.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.079+0000 7f4ed5ffb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ebc00a2d0 2023-10-18T17:29:42.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.079+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00bbe0 msgr2=0x7f4ebc005ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:42.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.079+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc00b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:42.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.079+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00bbe0 0x7f4ebc005ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:42.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.079+0000 7f4ed7fff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:42.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.079+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc00b6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:42.289 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.283+0000 7f4ed7fff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:42.289 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.283+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00bbe0 msgr2=0x7f4ebc005ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:42.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.283+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00bbe0 0x7f4ebc005ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:42.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.283+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc00b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:42.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.283+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc00b6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:42.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.687+0000 7f4ed7fff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:42.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.687+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00bbe0 msgr2=0x7f4ebc005ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:42.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.687+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00bbe0 0x7f4ebc005ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:42.694 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.687+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc00b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:42.694 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:42.687+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc00b6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:43.497 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:43.491+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00bbe0 msgr2=0x7f4ebc005ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:43.497 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:43.491+0000 7f4ed7fff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:43.498 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:43.491+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00bbe0 0x7f4ebc005ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:43.498 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:43.491+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc00b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:43.498 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:43.491+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc00b6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:45.084 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:45.079+0000 7f4ed5ffb700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc00b6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:45.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:45.079+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc00b6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:29:45.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:45.079+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00bbe0 msgr2=0x7f4ebc005ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:45.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:45.079+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00bbe0 0x7f4ebc005ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:29:45.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:45.079+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:45.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:45.079+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008700 0x7f4ebc0059e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:45.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:45.079+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00d230 con 0x7f4ebc00c6e0 2023-10-18T17:29:45.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:45.079+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc008700 2023-10-18T17:29:45.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:45.079+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc00c6e0 legacy=0x7f4ebc0063e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:45.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:45.079+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008700 msgr2=0x7f4ebc0059e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:45.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:45.079+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008700 0x7f4ebc0059e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:45.289 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:45.283+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008700 msgr2=0x7f4ebc0059e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:45.289 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:45.283+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc00c6e0 legacy=0x7f4ebc0063e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:45.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:45.283+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008700 0x7f4ebc0059e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:45.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:45.687+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc00c6e0 legacy=0x7f4ebc0063e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:45.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:45.687+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008700 msgr2=0x7f4ebc0059e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:45.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:45.687+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008700 0x7f4ebc0059e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:46.494 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:46.491+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc00c6e0 legacy=0x7f4ebc0063e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:46.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:46.491+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008700 msgr2=0x7f4ebc0059e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:46.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:46.491+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008700 0x7f4ebc0059e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:48.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.075+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008700 msgr2=0x7f4ebc0059e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:48.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.075+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008700 0x7f4ebc0059e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:29:48.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.075+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc00c6e0 legacy=0x7f4ebc0063e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:48.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.075+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008b10 0x7f4ebc008ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:48.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.075+0000 7f4ed7fff700 1 -- reap_dead start 2023-10-18T17:29:48.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.075+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00c030 con 0x7f4ebc009e90 2023-10-18T17:29:48.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.075+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00d230 con 0x7f4ebc0059e0 2023-10-18T17:29:48.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.075+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc008b10 2023-10-18T17:29:48.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.079+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:48.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.079+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc008ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:48.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.079+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:48.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.079+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008b10 0x7f4ebc008ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:48.289 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.283+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc008ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:48.289 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.283+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:48.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.283+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:48.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.283+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008b10 0x7f4ebc008ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:48.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.687+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:48.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.687+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc008ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:48.694 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.687+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:48.694 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:48.687+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008b10 0x7f4ebc008ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:49.494 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:49.491+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:49.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:49.491+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:49.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:49.491+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc008ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:49.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:49.491+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008b10 0x7f4ebc008ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:51.085 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.078+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc008ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:51.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.078+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc008b10 0x7f4ebc008ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:29:51.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.078+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:51.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.078+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:51.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.078+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00a2d0 0x7f4ebc00b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:51.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.078+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bbe0 0x7f4ebc005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:51.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.078+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc00a2d0 2023-10-18T17:29:51.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.078+0000 7f4ed5ffb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ebc00bbe0 2023-10-18T17:29:51.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.078+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc00b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:51.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.078+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00a2d0 0x7f4ebc00b6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:51.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.078+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bbe0 msgr2=0x7f4ebc005ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:51.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.078+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bbe0 0x7f4ebc005ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:51.289 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.282+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc00b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:51.289 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.282+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00a2d0 0x7f4ebc00b6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:51.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.282+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bbe0 msgr2=0x7f4ebc005ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:51.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.282+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bbe0 0x7f4ebc005ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:51.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.686+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc00b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:51.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.686+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00a2d0 0x7f4ebc00b6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:51.694 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.686+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bbe0 msgr2=0x7f4ebc005ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:51.694 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:51.686+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bbe0 0x7f4ebc005ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:52.494 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:52.490+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc00b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:52.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:52.490+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00a2d0 0x7f4ebc00b6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:52.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:52.490+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bbe0 msgr2=0x7f4ebc005ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:52.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:52.490+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bbe0 0x7f4ebc005ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:54.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.078+0000 7f4ed5ffb700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bbe0 msgr2=0x7f4ebc005ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:54.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.078+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bbe0 0x7f4ebc005ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:29:54.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.078+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc00b6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:54.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.078+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00a2d0 0x7f4ebc00b6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:29:54.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.078+0000 7f4ed7fff700 1 -- reap_dead start 2023-10-18T17:29:54.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.078+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:54.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.078+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed814fe30 con 0x7f4ebc009e90 2023-10-18T17:29:54.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.078+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00c030 con 0x7f4ebc0059e0 2023-10-18T17:29:54.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.078+0000 7f4ed5ffb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc00a2d0 2023-10-18T17:29:54.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.078+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:54.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.078+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc0063e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:54.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.078+0000 7f4ed7fff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc005ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:54.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.078+0000 7f4ed7fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc005ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:54.287 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.282+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:54.287 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.282+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc0063e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:54.287 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.282+0000 7f4ed7fff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc005ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:54.288 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.282+0000 7f4ed7fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc005ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:54.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.686+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc0063e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:54.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.686+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:54.694 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.686+0000 7f4ed7fff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc005ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:54.694 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:54.686+0000 7f4ed7fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc005ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:55.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:55.490+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc0063e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:29:55.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:55.490+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:29:55.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:55.490+0000 7f4ed7fff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc005ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:29:55.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:55.490+0000 7f4ed7fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc005ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:57.086 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.078+0000 7f4ed5ffb700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 msgr2=0x7f4ebc005ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:57.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.078+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00a2d0 0x7f4ebc005ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:29:57.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.078+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc0063e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:57.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.078+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e90 legacy=0x7f4ebc00afe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:29:57.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.078+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00b6f0 0x7f4ebc008b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:57.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.078+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 0x7f4ebc016570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:29:57.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.078+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc00b6f0 2023-10-18T17:29:57.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.078+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ebc009000 2023-10-18T17:29:57.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.078+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00b6f0 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:57.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.078+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00b6f0 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:57.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.078+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:57.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.078+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:29:57.287 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.282+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00b6f0 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:57.287 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.282+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00b6f0 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:57.287 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.282+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:57.288 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.282+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:29:57.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.686+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00b6f0 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:57.693 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.686+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00b6f0 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:57.694 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.686+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:57.694 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:57.686+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:29:58.494 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:58.490+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00b6f0 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:29:58.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:58.490+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00b6f0 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:29:58.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:58.490+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:29:58.495 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:29:58.490+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:00.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.082+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:00.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.082+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:00.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.082+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00b6f0 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:00.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.082+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00b6f0 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:00.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.082+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 0x7f4ebc016570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:00.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.082+0000 7f4ed7fff700 1 -- reap_dead start 2023-10-18T17:30:00.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.082+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:00.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.082+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00d230 con 0x7f4ebc0059e0 2023-10-18T17:30:00.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.082+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc009000 2023-10-18T17:30:00.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.082+0000 7f4ed5ffb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ebc00bb10 2023-10-18T17:30:00.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.082+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc0063e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:00.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.082+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:00.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.082+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:00.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.082+0000 7f4ed7fff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:00.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.082+0000 7f4ed7fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:00.293 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.286+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc0063e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:00.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.286+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:00.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.286+0000 7f4ed7fff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:00.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.286+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:00.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.286+0000 7f4ed7fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:00.697 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.690+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc0063e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:00.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.690+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:00.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.690+0000 7f4ed7fff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:00.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.690+0000 7f4ed7fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:00.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:00.690+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:01.499 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:01.494+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc0063e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:01.499 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:01.494+0000 7f4ed7fff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:01.499 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:01.494+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:01.499 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:01.494+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:01.500 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:01.494+0000 7f4ed7fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:03.087 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:03.082+0000 7f4ed5ffb700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:03.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:03.082+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:03.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:03.082+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:03.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:03.082+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:03.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:03.082+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc0063e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:03.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:03.082+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc00b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:03.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:03.082+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed814fe30 con 0x7f4ebc005eb0 2023-10-18T17:30:03.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:03.082+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc00afe0 2023-10-18T17:30:03.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:03.082+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc005eb0 legacy=0x7f4ebc009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:03.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:03.082+0000 7f4ecffff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:03.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:03.082+0000 7f4ecffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc00b3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:03.293 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:03.286+0000 7f4ecffff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:03.293 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:03.286+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc005eb0 legacy=0x7f4ebc009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:03.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:03.286+0000 7f4ecffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc00b3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:03.697 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:03.690+0000 7f4ecffff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:03.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:03.690+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc005eb0 legacy=0x7f4ebc009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:03.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:03.690+0000 7f4ecffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc00b3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:04.498 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:04.494+0000 7f4ecffff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:04.499 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:04.494+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc005eb0 legacy=0x7f4ebc009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:04.499 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:04.494+0000 7f4ecffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc00b3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:04.692 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:30:04.700 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:30:06.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.082+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:06.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.082+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc00b3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:06.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.082+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc005eb0 legacy=0x7f4ebc009e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:06.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.082+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:06.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.082+0000 7f4ed7fff700 1 -- reap_dead start 2023-10-18T17:30:06.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.082+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 0x7f4ebc016570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:06.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.082+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00d230 con 0x7f4ebc0059e0 2023-10-18T17:30:06.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.082+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc009000 2023-10-18T17:30:06.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.082+0000 7f4ed5ffb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ebc00bb10 2023-10-18T17:30:06.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.082+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:06.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.082+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:06.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.082+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:06.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.082+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:06.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.082+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:06.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.286+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:06.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.286+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:06.295 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.286+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:06.295 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.286+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:06.295 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.286+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:06.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.690+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:06.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.690+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:06.696 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.690+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:06.696 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.690+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:06.697 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:06.690+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:07.501 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:07.494+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:07.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:07.494+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:07.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:07.494+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:07.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:07.494+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:07.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:07.494+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:09.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:09.082+0000 7f4ed5ffb700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:09.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:09.082+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:09.088 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:09.082+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:09.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:09.082+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc009000 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:09.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:09.082+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059e0 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:09.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:09.082+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc005eb0 0x7f4ebc009e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:09.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:09.082+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed814fe30 con 0x7f4ebc00afe0 2023-10-18T17:30:09.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:09.082+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc005eb0 2023-10-18T17:30:09.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:09.082+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc005eb0 msgr2=0x7f4ebc009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:09.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:09.082+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc005eb0 0x7f4ebc009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:09.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:09.082+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00afe0 legacy=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:09.293 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:09.286+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc005eb0 msgr2=0x7f4ebc009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:09.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:09.286+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00afe0 legacy=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:09.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:09.286+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc005eb0 0x7f4ebc009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:09.694 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:09.690+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc005eb0 msgr2=0x7f4ebc009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:09.694 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:09.690+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00afe0 legacy=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:09.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:09.690+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc005eb0 0x7f4ebc009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:10.501 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:10.494+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00afe0 legacy=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:10.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:10.494+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc005eb0 msgr2=0x7f4ebc009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:10.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:10.494+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc005eb0 0x7f4ebc009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:12.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.082+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc005eb0 msgr2=0x7f4ebc009e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:12.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.082+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc005eb0 0x7f4ebc009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:12.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.082+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00afe0 legacy=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:12.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.082+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 0x7f4ebc018e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:12.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.082+0000 7f4ed7fff700 1 -- reap_dead start 2023-10-18T17:30:12.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.082+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:12.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.082+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00d230 con 0x7f4ebc009000 2023-10-18T17:30:12.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.082+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc016a60 2023-10-18T17:30:12.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.082+0000 7f4ed5ffb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ebc00bb10 2023-10-18T17:30:12.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.082+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 msgr2=0x7f4ebc018e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:12.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.082+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc009000 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:12.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.082+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:12.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.082+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 0x7f4ebc018e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:12.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.082+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:12.293 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.286+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 msgr2=0x7f4ebc018e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:12.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.286+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc009000 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:12.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.286+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:12.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.286+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 0x7f4ebc018e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:12.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.286+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:12.694 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.690+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 msgr2=0x7f4ebc018e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:12.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.690+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc009000 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:12.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.690+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 0x7f4ebc018e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:12.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.690+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:12.695 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:12.690+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:13.501 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:13.494+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 msgr2=0x7f4ebc018e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:13.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:13.494+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 0x7f4ebc018e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:13.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:13.494+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc009000 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:13.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:13.494+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:13.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:13.494+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:15.089 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:15.082+0000 7f4ed5ffb700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:15.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:15.082+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:15.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:15.082+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 msgr2=0x7f4ebc018e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:15.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:15.082+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 0x7f4ebc018e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:15.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:15.082+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc009000 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:15.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:15.082+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc00b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:15.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:15.082+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed814fe30 con 0x7f4ebc0059c0 2023-10-18T17:30:15.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:15.082+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc00afe0 2023-10-18T17:30:15.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:15.082+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc0059c0 legacy=0x7f4ebc009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:15.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:15.082+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:15.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:15.082+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc00b3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:15.290 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:15.286+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc0059c0 legacy=0x7f4ebc009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:15.291 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:15.286+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:15.291 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:15.286+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc00b3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:15.697 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:15.690+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc0059c0 legacy=0x7f4ebc009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:15.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:15.690+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:15.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:15.690+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc00b3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:16.501 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:16.494+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc0059c0 legacy=0x7f4ebc009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:16.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:16.494+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:16.502 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:16.494+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc00b3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:18.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.082+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:18.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.082+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc00b3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:18.090 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.082+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc0059c0 legacy=0x7f4ebc009e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:18.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.082+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 0x7f4ebc016570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:18.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.082+0000 7f4ed7fff700 1 -- reap_dead start 2023-10-18T17:30:18.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.082+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:18.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.082+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00d230 con 0x7f4ebc0059c0 2023-10-18T17:30:18.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.082+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc016a60 2023-10-18T17:30:18.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.082+0000 7f4ed5ffb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ebc00bb10 2023-10-18T17:30:18.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.082+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:18.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.082+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059c0 legacy=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:18.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.082+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:18.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.082+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:18.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.082+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:18.291 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.286+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:18.291 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.286+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:18.291 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.286+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:18.291 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.286+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059c0 legacy=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:18.292 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.286+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:18.697 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.690+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:18.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.690+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059c0 legacy=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:18.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.690+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:18.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.690+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:18.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:18.690+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:19.499 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:19.494+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:19.500 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:19.494+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:19.500 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:19.494+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059c0 legacy=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:19.501 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:19.494+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:19.501 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:19.494+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:21.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:21.086+0000 7f4ed5ffb700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 msgr2=0x7f4ebc008b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:21.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:21.086+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00bb10 0x7f4ebc008b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:21.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:21.086+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:21.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:21.086+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:21.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:21.086+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059c0 legacy=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:21.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:21.086+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc009e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:21.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:21.086+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed814fe30 con 0x7f4ebc009000 2023-10-18T17:30:21.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:21.086+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc00afe0 2023-10-18T17:30:21.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:21.086+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009000 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:21.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:21.086+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:21.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:21.086+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc009e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:21.297 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:21.290+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009000 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:21.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:21.290+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:21.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:21.290+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc009e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:21.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:21.694+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009000 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:21.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:21.694+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:21.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:21.694+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc009e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:22.505 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:22.498+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009000 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:22.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:22.498+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:22.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:22.498+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc009e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:24.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.086+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:24.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.086+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc009e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:24.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.086+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009000 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:24.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.086+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 0x7f4ebc016570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:24.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.086+0000 7f4ed7fff700 1 -- reap_dead start 2023-10-18T17:30:24.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.086+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:24.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.086+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00d230 con 0x7f4ebc0059c0 2023-10-18T17:30:24.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.086+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc016a60 2023-10-18T17:30:24.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.086+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ebc00afe0 2023-10-18T17:30:24.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.086+0000 7f4ecffff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:24.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.086+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059c0 legacy=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:24.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.086+0000 7f4ecffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:24.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.086+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:24.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.086+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc006290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:24.297 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.290+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:24.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.290+0000 7f4ecffff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:24.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.290+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059c0 legacy=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:24.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.290+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc006290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:24.299 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.290+0000 7f4ecffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:24.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.694+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:24.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.694+0000 7f4ecffff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:24.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.694+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc006290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:24.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.694+0000 7f4ecffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:24.700 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:24.694+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059c0 legacy=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:25.505 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:25.498+0000 7f4ecffff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:25.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:25.498+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059c0 legacy=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:25.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:25.498+0000 7f4ed7fff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:25.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:25.498+0000 7f4ecffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:25.507 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:25.498+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc006290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:27.091 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:27.086+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:27.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:27.086+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc006290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:27.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:27.086+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:27.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:27.086+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc016a60 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:27.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:27.086+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0059c0 legacy=0x7f4ebc00b3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:27.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:27.086+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc016e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:27.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:27.086+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed814fe30 con 0x7f4ebc00bb10 2023-10-18T17:30:27.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:27.086+0000 7f4ed5ffb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc008b10 2023-10-18T17:30:27.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:27.086+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00bb10 legacy=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:27.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:27.086+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc016e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:27.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:27.086+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc016e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:27.297 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:27.290+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00bb10 legacy=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:27.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:27.290+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc016e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:27.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:27.290+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc016e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:27.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:27.694+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00bb10 legacy=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:27.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:27.694+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc016e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:27.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:27.694+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc016e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:28.505 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:28.498+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00bb10 legacy=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:28.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:28.498+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc016e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:28.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:28.498+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc016e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:30.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.086+0000 7f4ed5ffb700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc016e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:30.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.086+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc016e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:30.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.086+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00bb10 legacy=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:30.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.086+0000 7f4ed7fff700 1 -- reap_dead start 2023-10-18T17:30:30.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.086+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc009e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:30.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.086+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:30.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.086+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00d230 con 0x7f4ebc008f10 2023-10-18T17:30:30.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.086+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc008b10 2023-10-18T17:30:30.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.086+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ebc0059c0 2023-10-18T17:30:30.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.086+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc008f10 legacy=0x7f4ebc019340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:30.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.086+0000 7f4ed7fff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:30.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.086+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:30.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.086+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc006290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:30.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.086+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc009e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:30.297 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.290+0000 7f4ed7fff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:30.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.290+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc008f10 legacy=0x7f4ebc019340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:30.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.290+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:30.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.290+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc006290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:30.299 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.290+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc009e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:30.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.694+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc008f10 legacy=0x7f4ebc019340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:30.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.694+0000 7f4ed7fff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:30.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.694+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:30.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.694+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc006290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:30.700 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:30.694+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc009e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:31.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:31.498+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc008f10 legacy=0x7f4ebc019340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:31.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:31.498+0000 7f4ed7fff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:31.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:31.498+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:31.507 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:31.498+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc006290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:31.507 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:31.498+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc009e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:33.092 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:33.086+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:33.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:33.086+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc009e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:33.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:33.086+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:33.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:33.086+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc006290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:33.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:33.086+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc008f10 legacy=0x7f4ebc019340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:33.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:33.086+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 0x7f4ebc00b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:33.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:33.086+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed814fe30 con 0x7f4ebc0076f0 2023-10-18T17:30:33.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:33.086+0000 7f4ed5ffb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc00afe0 2023-10-18T17:30:33.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:33.086+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:33.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:33.086+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:33.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:33.086+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 0x7f4ebc00b420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:33.297 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:33.290+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:33.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:33.290+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:33.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:33.290+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 0x7f4ebc00b420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:33.698 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:33.693+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:33.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:33.693+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:33.699 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:33.693+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 0x7f4ebc00b420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:34.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:34.497+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:34.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:34.497+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:34.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:34.497+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 0x7f4ebc00b420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:34.763 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:30:34.771 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:30:36.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.085+0000 7f4ed5ffb700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:36.093 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.085+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 0x7f4ebc00b420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:36.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.085+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:36.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.085+0000 7f4ed7fff700 1 -- reap_dead start 2023-10-18T17:30:36.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.085+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc008210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:36.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.085+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc009e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:36.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.085+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00d230 con 0x7f4ebc0076f0 2023-10-18T17:30:36.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.085+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc008b10 2023-10-18T17:30:36.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.085+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ebc0059c0 2023-10-18T17:30:36.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.085+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:36.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.085+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:36.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.085+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:36.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.085+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:36.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.085+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc009e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:36.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.289+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:36.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.289+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:36.294 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.289+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:36.295 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.289+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:36.295 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.289+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc009e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:36.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.693+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:36.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.693+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:36.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.693+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc009e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:36.703 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.693+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:36.703 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:36.693+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:37.503 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:37.497+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:37.503 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:37.497+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:37.504 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:37.497+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:37.504 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:37.497+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc009e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:37.504 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:37.497+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:39.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:39.085+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc009e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:39.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:39.085+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc009e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:39.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:39.085+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc008210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:39.094 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:39.085+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:39.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:39.085+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:39.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:39.085+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 0x7f4ebc00b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:39.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:39.089+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed814fe30 con 0x7f4ebc008f10 2023-10-18T17:30:39.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:39.089+0000 7f4ed5ffb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc00afe0 2023-10-18T17:30:39.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:39.089+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc008f10 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:39.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:39.089+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:39.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:39.089+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:39.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:39.293+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc008f10 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:39.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:39.293+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:39.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:39.293+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:39.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:39.697+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc008f10 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:39.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:39.697+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:39.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:39.697+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:40.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:40.501+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc008f10 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:40.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:40.501+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:40.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:40.501+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:42.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.089+0000 7f4ed5ffb700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:42.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.089+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc00afe0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:42.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.089+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc008f10 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:42.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.089+0000 7f4ed7fff700 1 -- reap_dead start 2023-10-18T17:30:42.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.089+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc00b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:42.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.089+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc017580 legacy=0x7f4ebc019970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:42.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.089+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00d230 con 0x7f4ebc017580 2023-10-18T17:30:42.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.089+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed814fe30 con 0x7f4ebc0076f0 2023-10-18T17:30:42.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.089+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc0059c0 2023-10-18T17:30:42.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.089+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:42.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.089+0000 7f4ed7fff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:42.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.089+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:42.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.293+0000 7f4ed7fff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:42.299 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.293+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc017580 legacy=0x7f4ebc019970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:42.299 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.293+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:42.299 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.293+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:42.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.697+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc017580 legacy=0x7f4ebc019970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:42.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.697+0000 7f4ed7fff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:42.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.697+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:42.703 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:42.697+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:43.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:43.501+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc017580 legacy=0x7f4ebc019970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:43.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:43.501+0000 7f4ed7fff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:43.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:43.501+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:43.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:43.501+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:45.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.089+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:45.095 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.089+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:45.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.089+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:45.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.089+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc017580 legacy=0x7f4ebc019970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:45.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.089+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc009e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:45.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.089+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc007b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:45.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.089+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc00afe0 2023-10-18T17:30:45.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.089+0000 7f4ed5ffb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ebc008b10 2023-10-18T17:30:45.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.089+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:45.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.089+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc009e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:45.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.089+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:45.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.089+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc009e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:45.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.293+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:45.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.293+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc009e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:45.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.293+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:45.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.293+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc009e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:45.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.697+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:45.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.697+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc009e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:45.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.697+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:45.703 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:45.697+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc009e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:46.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:46.501+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:46.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:46.501+0000 7f4ed77fe700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc009e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:46.507 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:46.501+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:46.507 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:46.501+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc009e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:48.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.089+0000 7f4ed5ffb700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc009e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:48.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.089+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc009e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:48.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.089+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:48.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.089+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc00afe0 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:48.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.089+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ff0 0x7f4ebc016570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:48.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.089+0000 7f4ed7fff700 1 -- reap_dead start 2023-10-18T17:30:48.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.089+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc007b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:48.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.089+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00c030 con 0x7f4ebc0076f0 2023-10-18T17:30:48.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.089+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc007ff0 2023-10-18T17:30:48.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.089+0000 7f4ed5ffb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ebc008b10 2023-10-18T17:30:48.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.089+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ff0 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:48.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.089+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:48.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.089+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ff0 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:48.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.089+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:48.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.089+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:48.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.293+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:48.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.293+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:48.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.293+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ff0 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:48.299 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.293+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:48.299 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.293+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ff0 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:48.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.697+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ff0 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:48.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.697+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:48.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.697+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:48.703 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.697+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ff0 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:48.703 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:48.697+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:49.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:49.501+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ff0 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:49.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:49.501+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:49.507 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:49.501+0000 7f4ed7fff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:49.507 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:49.501+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:49.507 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:49.501+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ff0 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:51.096 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:51.089+0000 7f4ed5ffb700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:51.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:51.089+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:51.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:51.089+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ff0 msgr2=0x7f4ebc016570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:51.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:51.089+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ff0 0x7f4ebc016570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:51.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:51.089+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc0076f0 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:51.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:51.089+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc00b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:51.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:51.089+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00d230 con 0x7f4ebc009e20 2023-10-18T17:30:51.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:51.089+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc0059c0 2023-10-18T17:30:51.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:51.089+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e20 legacy=0x7f4ebc016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:51.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:51.089+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:51.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:51.089+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:51.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:51.293+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:51.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:51.293+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e20 legacy=0x7f4ebc016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:51.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:51.293+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:51.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:51.697+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:51.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:51.697+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e20 legacy=0x7f4ebc016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:51.703 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:51.697+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:52.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:52.501+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e20 legacy=0x7f4ebc016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:52.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:52.501+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:52.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:52.501+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:54.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.089+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:54.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.089+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059c0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:54.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.089+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc009e20 legacy=0x7f4ebc016a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:54.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.089+0000 7f4ed7fff700 1 -- reap_dead start 2023-10-18T17:30:54.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.089+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc007b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:54.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.089+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059a0 0x7f4ebc00b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:54.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.089+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00c030 con 0x7f4ebc00a220 2023-10-18T17:30:54.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.089+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc0059a0 2023-10-18T17:30:54.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.089+0000 7f4ed5ffb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ebc008b10 2023-10-18T17:30:54.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.089+0000 7f4ed7fff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059a0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:54.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.089+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc01a190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:54.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.089+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:54.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.089+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059a0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:54.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.089+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:54.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.293+0000 7f4ed7fff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059a0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:54.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.293+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc01a190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:54.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.293+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059a0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:54.299 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.293+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:54.299 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.293+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:54.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.697+0000 7f4ed7fff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059a0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:54.703 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.697+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc01a190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:54.703 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.697+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059a0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:54.704 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.697+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:54.704 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:54.697+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:55.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:55.501+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc01a190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:30:55.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:55.501+0000 7f4ed7fff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059a0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:30:55.507 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:55.501+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059a0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:55.507 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:55.501+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:30:55.507 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:55.501+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:30:57.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:57.089+0000 7f4ed5ffb700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:57.097 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:57.089+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc008b10 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:57.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:57.089+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059a0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:57.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:57.089+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc0059a0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:30:57.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:57.089+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc01a190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:30:57.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:57.089+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0076d0 0x7f4ebc006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:30:57.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:57.089+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00d230 con 0x7f4ebc007ff0 2023-10-18T17:30:57.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:57.089+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc0076d0 2023-10-18T17:30:57.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:57.089+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:57.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:57.089+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0076d0 msgr2=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:57.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:57.089+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0076d0 0x7f4ebc006290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:30:57.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:57.293+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:57.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:57.293+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0076d0 msgr2=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:57.298 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:57.293+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0076d0 0x7f4ebc006290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:30:57.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:57.697+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:57.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:57.697+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0076d0 msgr2=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:57.702 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:57.697+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0076d0 0x7f4ebc006290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:30:58.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:58.501+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:30:58.506 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:58.501+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0076d0 msgr2=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:30:58.507 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:30:58.501+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0076d0 0x7f4ebc006290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:00.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.089+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0076d0 msgr2=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:00.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.089+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc0076d0 0x7f4ebc006290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:00.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.089+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:00.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.089+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 0x7f4ebc017060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:00.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.089+0000 7f4ed7fff700 1 -- reap_dead start 2023-10-18T17:31:00.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.089+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc0059a0 0x7f4ebc00b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:00.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.089+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00c030 con 0x7f4ebc007ff0 2023-10-18T17:31:00.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.089+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc014c70 2023-10-18T17:31:00.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.089+0000 7f4ed5ffb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ebc0059a0 2023-10-18T17:31:00.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.093+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 msgr2=0x7f4ebc017060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:00.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.093+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:00.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.093+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 0x7f4ebc017060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:00.103 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.093+0000 7f4ed7fff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc0059a0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:00.103 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.093+0000 7f4ed7fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc0059a0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:00.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.297+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 msgr2=0x7f4ebc017060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:00.303 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.297+0000 7f4ed7fff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc0059a0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:00.303 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.297+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:00.303 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.297+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 0x7f4ebc017060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:00.303 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.297+0000 7f4ed7fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc0059a0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:00.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.701+0000 7f4ed7fff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc0059a0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:00.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.701+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 msgr2=0x7f4ebc017060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:00.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.701+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:00.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.701+0000 7f4ed7fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc0059a0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:00.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:00.701+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 0x7f4ebc017060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:01.510 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:01.505+0000 7f4ed7fff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc0059a0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:01.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:01.505+0000 7f4ecffff700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 msgr2=0x7f4ebc017060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:01.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:01.505+0000 7f4ed77fe700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:01.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:01.505+0000 7f4ed7fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc0059a0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:01.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:01.505+0000 7f4ecffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 0x7f4ebc017060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:03.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:03.089+0000 7f4ed5ffb700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc0059a0 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:03.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:03.089+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc0059a0 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:03.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:03.089+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 msgr2=0x7f4ebc017060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:03.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:03.089+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 0x7f4ebc017060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:03.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:03.089+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:03.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:03.093+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc007b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:03.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:03.093+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00d230 con 0x7f4ebc00a220 2023-10-18T17:31:03.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:03.093+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc008b10 2023-10-18T17:31:03.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:03.093+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:03.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:03.093+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:03.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:03.093+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:03.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:03.297+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:03.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:03.297+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:03.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:03.297+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:03.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:03.701+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:03.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:03.701+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:03.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:03.701+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:04.510 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:04.505+0000 7f4ecffff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:04.510 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:04.505+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:04.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:04.505+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:04.840 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:31:04.848 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:31:06.098 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.093+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc007b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:06.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.093+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc007b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:06.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.093+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:06.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.093+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 0x7f4ebc017060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:06.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.093+0000 7f4ed7fff700 1 -- reap_dead start 2023-10-18T17:31:06.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.093+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00c030 con 0x7f4ebc00a220 2023-10-18T17:31:06.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.093+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00d230 con 0x7f4ebc007ff0 2023-10-18T17:31:06.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.093+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc014c70 2023-10-18T17:31:06.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.093+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 msgr2=0x7f4ebc017060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:06.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.093+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 0x7f4ebc017060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:06.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.093+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:06.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.093+0000 7f4ed7fff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:06.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.297+0000 7f4ed7fff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:06.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.297+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:06.303 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.297+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 msgr2=0x7f4ebc017060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:06.303 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.297+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 0x7f4ebc017060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:06.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.701+0000 7f4ed7fff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:06.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.701+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:06.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.701+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 msgr2=0x7f4ebc017060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:06.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:06.701+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 0x7f4ebc017060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:07.510 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:07.505+0000 7f4ed7fff700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:07.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:07.505+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:07.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:07.505+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 msgr2=0x7f4ebc017060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:07.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:07.505+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 0x7f4ebc017060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:09.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.093+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 msgr2=0x7f4ebc017060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:09.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.093+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc014c70 0x7f4ebc017060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:09.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.093+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:09.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.093+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:09.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.093+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc00b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:09.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.093+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc007ae0 0x7f4ebc018560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:09.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.093+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc008b10 2023-10-18T17:31:09.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.093+0000 7f4ed5ffb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ebc007ae0 2023-10-18T17:31:09.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.093+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:09.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.093+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:09.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.093+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc007ae0 msgr2=0x7f4ebc018560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:09.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.093+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc007ae0 0x7f4ebc018560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:09.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.297+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:09.303 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.297+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:09.303 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.297+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc007ae0 msgr2=0x7f4ebc018560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:09.304 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.297+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc007ae0 0x7f4ebc018560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:09.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.701+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:09.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.701+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:09.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.701+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc007ae0 msgr2=0x7f4ebc018560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:09.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:09.701+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc007ae0 0x7f4ebc018560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:10.510 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:10.505+0000 7f4ed77fe700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:10.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:10.505+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:10.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:10.505+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc007ae0 msgr2=0x7f4ebc018560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:10.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:10.505+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc007ae0 0x7f4ebc018560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:12.099 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.093+0000 7f4ed5ffb700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc007ae0 msgr2=0x7f4ebc018560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:12.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.093+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc007ae0 0x7f4ebc018560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:12.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.093+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:12.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.093+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:12.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.093+0000 7f4ed7fff700 1 -- reap_dead start 2023-10-18T17:31:12.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.093+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc00b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:12.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.093+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed814fe30 con 0x7f4ebc00a220 2023-10-18T17:31:12.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.093+0000 7f4ed5ffb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc00c030 con 0x7f4ebc007ff0 2023-10-18T17:31:12.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.093+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc008b10 2023-10-18T17:31:12.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.093+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:12.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.093+0000 7f4ed7fff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:12.102 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.093+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:12.102 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.093+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:12.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.297+0000 7f4ed7fff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:12.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.297+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:12.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.297+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:12.303 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.297+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:12.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.701+0000 7f4ed7fff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:12.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.701+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:12.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.701+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:12.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:12.701+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:13.510 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:13.505+0000 7f4ed7fff700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:13.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:13.505+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:13.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:13.505+0000 7f4ed77fe700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:13.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:13.505+0000 7f4ecffff700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:15.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.093+0000 7f4ed5ffb700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 msgr2=0x7f4ebc00b400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:15.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.093+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ebc008b10 0x7f4ebc00b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:15.100 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.093+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f4ebc007ff0 legacy=0x7f4ebc013550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:15.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.093+0000 7f4ed5ffb700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f4ebc00a220 legacy=0x7f4ebc006290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:15.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.093+0000 7f4ed5ffb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ae0 0x7f4ebc014c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:15.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.093+0000 7f4ed5ffb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc005970 0x7f4ebc018560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:15.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.093+0000 7f4ed5ffb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806a760 con 0x7f4ebc007ae0 2023-10-18T17:31:15.101 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.093+0000 7f4ed5ffb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8150bf0 con 0x7f4ebc005970 2023-10-18T17:31:15.102 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.093+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc005970 msgr2=0x7f4ebc018560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:15.102 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.093+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ae0 msgr2=0x7f4ebc014c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:15.102 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.093+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ae0 0x7f4ebc014c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:15.103 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.093+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc005970 0x7f4ebc018560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:15.302 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.297+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ae0 msgr2=0x7f4ebc014c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:15.303 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.297+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc005970 msgr2=0x7f4ebc018560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:15.303 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.297+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ae0 0x7f4ebc014c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:15.303 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.297+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc005970 0x7f4ebc018560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:15.706 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.701+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ae0 msgr2=0x7f4ebc014c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:15.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.701+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc005970 msgr2=0x7f4ebc018560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:15.707 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.701+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ae0 0x7f4ebc014c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:15.708 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:15.701+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc005970 0x7f4ebc018560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:16.510 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:16.505+0000 7f4ed77fe700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ae0 msgr2=0x7f4ebc014c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:16.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:16.505+0000 7f4ecffff700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc005970 msgr2=0x7f4ebc018560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:16.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:16.505+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ebc007ae0 0x7f4ebc014c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:16.511 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:16.505+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc005970 0x7f4ebc018560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:17.976 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-18T17:31:17.977 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-18T17:31:17.977 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T17:31:18.136 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.128+0000 7f600f29b700 1 Processor -- start 2023-10-18T17:31:18.137 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.128+0000 7f600f29b700 1 -- start start 2023-10-18T17:31:18.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.132+0000 7f600f29b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f60080bc2f0 0x7f6008067e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:18.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.132+0000 7f600f29b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6008069d80 0x7f6008068320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:18.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.132+0000 7f600f29b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60081551c0 con 0x7f60080b55b0 2023-10-18T17:31:18.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.132+0000 7f600f29b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f60080bc2f0 2023-10-18T17:31:18.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.132+0000 7f600f29b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f6008069d80 2023-10-18T17:31:18.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.132+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f60080b55b0 legacy=0x7f60080bcab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:18.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.132+0000 7f600d838700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6008069d80 msgr2=0x7f6008068320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:18.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.132+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f60080bc2f0 msgr2=0x7f6008067e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:18.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.132+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f60080bc2f0 0x7f6008067e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:18.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.132+0000 7f600d838700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6008069d80 0x7f6008068320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:18.342 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.336+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f60080b55b0 legacy=0x7f60080bcab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:18.342 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.336+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f60080bc2f0 msgr2=0x7f6008067e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:18.343 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.336+0000 7f600d838700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6008069d80 msgr2=0x7f6008068320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:18.343 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.336+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f60080bc2f0 0x7f6008067e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:18.343 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.336+0000 7f600d838700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6008069d80 0x7f6008068320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:18.746 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.740+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f60080b55b0 legacy=0x7f60080bcab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:18.747 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.740+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f60080bc2f0 msgr2=0x7f6008067e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:18.747 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.740+0000 7f600d838700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6008069d80 msgr2=0x7f6008068320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:18.747 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.740+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f60080bc2f0 0x7f6008067e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:18.747 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:18.740+0000 7f600d838700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6008069d80 0x7f6008068320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:19.550 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:19.544+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f60080b55b0 legacy=0x7f60080bcab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:19.551 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:19.544+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f60080bc2f0 msgr2=0x7f6008067e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:19.551 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:19.544+0000 7f600d838700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6008069d80 msgr2=0x7f6008068320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:19.551 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:19.544+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f60080bc2f0 0x7f6008067e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:19.551 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:19.544+0000 7f600d838700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6008069d80 0x7f6008068320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:21.140 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:21.132+0000 7f5ffeffd700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6008069d80 msgr2=0x7f6008068320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:21.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:21.132+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6008069d80 0x7f6008068320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:21.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:21.132+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f60080bc2f0 msgr2=0x7f6008067e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:21.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:21.132+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f60080bc2f0 0x7f6008067e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:21.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:21.132+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f60080b55b0 legacy=0x7f60080bcab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:21.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:21.132+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec003590 0x7f5fec005a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:21.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:21.132+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6008154920 con 0x7f5fec006010 2023-10-18T17:31:21.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:21.132+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec003590 2023-10-18T17:31:21.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:21.132+0000 7f600d037700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec003590 msgr2=0x7f5fec005a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:21.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:21.132+0000 7f600d037700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec003590 0x7f5fec005a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:21.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:21.132+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec006010 legacy=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:21.342 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:21.336+0000 7f600d037700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec003590 msgr2=0x7f5fec005a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:21.342 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:21.336+0000 7f600d037700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec003590 0x7f5fec005a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:21.343 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:21.336+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec006010 legacy=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:21.746 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:21.740+0000 7f600d037700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec003590 msgr2=0x7f5fec005a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:21.747 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:21.740+0000 7f600d037700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec003590 0x7f5fec005a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:21.747 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:21.740+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec006010 legacy=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:22.550 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:22.544+0000 7f600d037700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec003590 msgr2=0x7f5fec005a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:22.551 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:22.544+0000 7f600d037700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec003590 0x7f5fec005a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:22.551 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:22.544+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec006010 legacy=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:24.141 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.132+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec003590 msgr2=0x7f5fec005a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:24.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.132+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec003590 0x7f5fec005a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:24.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.132+0000 7f5ffeffd700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec006010 legacy=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:24.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.132+0000 7f600d838700 1 -- reap_dead start 2023-10-18T17:31:24.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.132+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a490 0x7f5fec00a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:24.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.132+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec0084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:24.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.132+0000 7f5ffeffd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60081551c0 con 0x7f60080b55b0 2023-10-18T17:31:24.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.132+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec005b40 2023-10-18T17:31:24.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.132+0000 7f5ffeffd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f5fec00a490 2023-10-18T17:31:24.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.132+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f60080b55b0 legacy=0x7f5fec009d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:24.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.132+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:24.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.132+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a490 msgr2=0x7f5fec00a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:24.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.132+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:24.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.132+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a490 0x7f5fec00a870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:24.342 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.336+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f60080b55b0 legacy=0x7f5fec009d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:24.342 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.336+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:24.343 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.336+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:24.343 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.336+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a490 msgr2=0x7f5fec00a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:24.343 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.336+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a490 0x7f5fec00a870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:24.746 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.740+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:24.747 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.740+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f60080b55b0 legacy=0x7f5fec009d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:24.747 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.740+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:24.747 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.740+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a490 msgr2=0x7f5fec00a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:24.747 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:24.740+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a490 0x7f5fec00a870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:25.550 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:25.544+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:25.551 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:25.544+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f60080b55b0 legacy=0x7f5fec009d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:25.551 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:25.544+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:25.551 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:25.544+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a490 msgr2=0x7f5fec00a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:25.551 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:25.544+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a490 0x7f5fec00a870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:27.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:27.136+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a490 msgr2=0x7f5fec00a870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:27.142 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:27.136+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a490 0x7f5fec00a870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:27.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:27.136+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:27.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:27.136+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:27.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:27.136+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f60080b55b0 legacy=0x7f5fec009d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:27.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:27.136+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec008d20 0x7f5fec009100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:27.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:27.136+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6008154920 con 0x7f5fec0096c0 2023-10-18T17:31:27.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:27.136+0000 7f5ffeffd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec008d20 2023-10-18T17:31:27.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:27.136+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec0096c0 legacy=0x7f5fec011ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:27.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:27.136+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec008d20 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:27.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:27.136+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec008d20 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:27.346 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:27.340+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec008d20 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:27.347 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:27.340+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec0096c0 legacy=0x7f5fec011ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:27.347 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:27.340+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec008d20 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:27.750 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:27.744+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec0096c0 legacy=0x7f5fec011ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:27.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:27.744+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec008d20 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:27.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:27.744+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec008d20 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:28.554 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:28.548+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec0096c0 legacy=0x7f5fec011ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:28.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:28.548+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec008d20 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:28.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:28.548+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec008d20 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:30.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.132+0000 7f5ffeffd700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec008d20 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:30.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.132+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec008d20 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:30.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.132+0000 7f5ffeffd700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec0096c0 legacy=0x7f5fec011ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:30.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.136+0000 7f600d838700 1 -- reap_dead start 2023-10-18T17:31:30.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.136+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:30.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.136+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:30.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.136+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 0x7f5fec00cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:30.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.136+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec009d80 2023-10-18T17:31:30.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.136+0000 7f5ffeffd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f5fec00a870 2023-10-18T17:31:30.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.136+0000 7f5ffeffd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec00d3e0 con 0x7f5fec005b40 2023-10-18T17:31:30.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.136+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 msgr2=0x7f5fec00cef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:30.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.136+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 0x7f5fec00cef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:30.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.136+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:30.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.136+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:30.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.136+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:30.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.136+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:30.346 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.340+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 msgr2=0x7f5fec00cef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:30.347 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.340+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:30.347 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.340+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:30.347 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.340+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 0x7f5fec00cef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:30.347 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.340+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:30.349 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.340+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:30.750 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.744+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:30.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.744+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 msgr2=0x7f5fec00cef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:30.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.744+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:30.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.744+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 0x7f5fec00cef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:30.752 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.744+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:30.752 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:30.744+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:31.554 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:31.548+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 msgr2=0x7f5fec00cef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:31.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:31.548+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:31.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:31.548+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:31.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:31.548+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 0x7f5fec00cef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:31.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:31.548+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:31.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:31.548+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:33.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:33.136+0000 7f5ffeffd700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:33.143 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:33.136+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:33.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:33.136+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:33.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:33.136+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:33.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:33.136+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 msgr2=0x7f5fec00cef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:33.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:33.136+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 0x7f5fec00cef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:33.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:33.136+0000 7f5ffeffd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60081551c0 con 0x7f5fec00daf0 2023-10-18T17:31:33.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:33.136+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6008154920 con 0x7f5fec00d6e0 2023-10-18T17:31:33.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:33.136+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec00daf0 legacy=0x7f5fec0136c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:33.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:33.136+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:33.346 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:33.340+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec00daf0 legacy=0x7f5fec0136c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:33.346 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:33.340+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:33.750 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:33.744+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec00daf0 legacy=0x7f5fec0136c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:33.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:33.744+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:34.554 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:34.548+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec00daf0 legacy=0x7f5fec0136c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:34.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:34.548+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:34.920 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:31:34.926 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:31:36.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.136+0000 7f5ffeffd700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00ff90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:36.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.136+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec00daf0 legacy=0x7f5fec0136c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:36.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.136+0000 7f600d838700 1 -- reap_dead start 2023-10-18T17:31:36.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.136+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:36.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.136+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:36.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.136+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 0x7f5fec00cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:36.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.136+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec009d80 2023-10-18T17:31:36.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.136+0000 7f5ffeffd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f5fec00a870 2023-10-18T17:31:36.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.136+0000 7f5ffeffd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec00d3e0 con 0x7f5fec005b40 2023-10-18T17:31:36.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.136+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:36.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.136+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 msgr2=0x7f5fec00cef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:36.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.136+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:36.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.136+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:36.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.136+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 0x7f5fec00cef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:36.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.136+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:36.346 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.340+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 msgr2=0x7f5fec00cef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:36.347 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.340+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 0x7f5fec00cef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:36.347 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.340+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:36.347 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.340+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:36.347 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.340+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:36.348 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.340+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:36.750 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.744+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 msgr2=0x7f5fec00cef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:36.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.744+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 0x7f5fec00cef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:36.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.744+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:36.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.744+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:36.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.744+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:36.752 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:36.744+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:37.554 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:37.548+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 msgr2=0x7f5fec00cef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:37.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:37.548+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 0x7f5fec00cef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:37.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:37.548+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:37.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:37.548+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:37.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:37.548+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:37.556 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:37.548+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:39.144 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:39.136+0000 7f5ffeffd700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:39.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:39.136+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:39.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:39.136+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:39.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:39.136+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:39.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:39.136+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 msgr2=0x7f5fec00cef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:39.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:39.136+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009d80 0x7f5fec00cef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:39.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:39.136+0000 7f5ffeffd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec016e40 con 0x7f5fec00daf0 2023-10-18T17:31:39.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:39.136+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60081551c0 con 0x7f5fec00d6e0 2023-10-18T17:31:39.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:39.136+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec0165c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:39.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:39.136+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec00daf0 legacy=0x7f5fec014e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:39.345 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:39.340+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec00daf0 legacy=0x7f5fec014e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:39.345 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:39.340+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec0165c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:39.750 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:39.744+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec00daf0 legacy=0x7f5fec014e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:39.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:39.744+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec0165c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:40.554 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:40.548+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec00daf0 legacy=0x7f5fec014e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:40.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:40.548+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec0165c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:42.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.136+0000 7f5ffeffd700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec0165c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:42.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.136+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec00daf0 legacy=0x7f5fec014e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:42.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.136+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:42.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.136+0000 7f600d838700 1 -- reap_dead start 2023-10-18T17:31:42.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.136+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:42.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.136+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6008154920 con 0x7f5fec00d6e0 2023-10-18T17:31:42.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.136+0000 7f5ffeffd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec00a870 2023-10-18T17:31:42.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.136+0000 7f5ffeffd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f5fec005b40 2023-10-18T17:31:42.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.136+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:42.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.136+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:42.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.136+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec0165c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:42.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.136+0000 7f600d838700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:42.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.136+0000 7f600d838700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:42.346 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.340+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:42.346 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.340+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:42.346 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.340+0000 7f600d838700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:42.347 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.340+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec0165c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:42.347 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.340+0000 7f600d838700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:42.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.744+0000 7f600d838700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:42.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.744+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:42.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.744+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec0165c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:42.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.744+0000 7f600d838700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:42.752 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:42.744+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:43.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:43.548+0000 7f600d838700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:43.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:43.548+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:43.556 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:43.548+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec0165c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:43.556 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:43.548+0000 7f600d838700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:43.556 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:43.548+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:45.145 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:45.140+0000 7f5ffeffd700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:45.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:45.140+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:45.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:45.140+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:45.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:45.140+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:45.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:45.140+0000 7f5ffeffd700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec0165c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:45.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:45.140+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 0x7f5fec014fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:45.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:45.140+0000 7f5ffeffd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec016e40 con 0x7f5fec009d80 2023-10-18T17:31:45.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:45.140+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec00daf0 2023-10-18T17:31:45.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:45.140+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009d80 legacy=0x7f5fec0155b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:45.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:45.140+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 msgr2=0x7f5fec014fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:45.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:45.140+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 0x7f5fec014fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:45.350 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:45.344+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009d80 legacy=0x7f5fec0155b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:45.350 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:45.344+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 msgr2=0x7f5fec014fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:45.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:45.344+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 0x7f5fec014fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:45.754 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:45.748+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 msgr2=0x7f5fec014fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:45.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:45.748+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009d80 legacy=0x7f5fec0155b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:45.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:45.748+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 0x7f5fec014fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:46.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:46.552+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 msgr2=0x7f5fec014fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:46.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:46.552+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009d80 legacy=0x7f5fec0155b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:46.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:46.552+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 0x7f5fec014fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:48.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.136+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 msgr2=0x7f5fec014fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:48.146 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.136+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 0x7f5fec014fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:48.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.136+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009d80 legacy=0x7f5fec0155b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:48.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.136+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:48.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.136+0000 7f600d838700 1 -- reap_dead start 2023-10-18T17:31:48.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.136+0000 7f5ffeffd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6008154920 con 0x7f5fec009d80 2023-10-18T17:31:48.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.136+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec016e40 con 0x7f5fec00d6e0 2023-10-18T17:31:48.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.136+0000 7f5ffeffd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec005b40 2023-10-18T17:31:48.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.136+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009d80 legacy=0x7f5fec0155b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:48.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.136+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:48.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.136+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:48.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.136+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:48.347 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.340+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009d80 legacy=0x7f5fec0155b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:48.347 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.340+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:48.347 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.340+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:48.347 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.340+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:48.750 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.744+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009d80 legacy=0x7f5fec0155b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:48.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.744+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:48.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.744+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:48.751 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:48.744+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:49.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:49.548+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009d80 legacy=0x7f5fec0155b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:49.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:49.548+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:49.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:49.548+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:49.555 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:49.548+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:51.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.140+0000 7f5ffeffd700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:51.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.140+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec005b40 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:51.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.140+0000 7f5ffeffd700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec011fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:51.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.140+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009d80 legacy=0x7f5fec0155b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:51.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.140+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:51.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.140+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 0x7f5fec0146c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:51.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.140+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec00daf0 2023-10-18T17:31:51.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.140+0000 7f5ffeffd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f5fec00a870 2023-10-18T17:31:51.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.140+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 msgr2=0x7f5fec0146c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:51.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.140+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 0x7f5fec0146c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:51.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.140+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:51.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.140+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:51.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.344+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 msgr2=0x7f5fec0146c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:51.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.344+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 0x7f5fec0146c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:51.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.344+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:51.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.344+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:51.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.748+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 msgr2=0x7f5fec0146c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:51.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.748+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 0x7f5fec0146c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:51.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.748+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:51.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:51.748+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:52.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:52.552+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 msgr2=0x7f5fec0146c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:52.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:52.552+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 0x7f5fec0146c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:52.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:52.552+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:52.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:52.552+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:54.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.140+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:54.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.140+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:54.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.140+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 msgr2=0x7f5fec0146c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:54.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.140+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00daf0 0x7f5fec0146c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:54.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.140+0000 7f600d838700 1 -- reap_dead start 2023-10-18T17:31:54.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.140+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 0x7f5fec00bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:54.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.140+0000 7f5ffeffd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60081551c0 con 0x7f5fec005b40 2023-10-18T17:31:54.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.140+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6008154920 con 0x7f5fec00d6e0 2023-10-18T17:31:54.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.140+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec014d40 2023-10-18T17:31:54.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.140+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:54.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.140+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:54.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.140+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec0155b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:54.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.140+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:54.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.344+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec0155b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:54.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.344+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:54.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.344+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:54.352 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.344+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:54.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.748+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec0155b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:54.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.748+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:54.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.748+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:54.756 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:54.748+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:55.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:55.552+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec0155b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:31:55.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:55.552+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:31:55.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:55.552+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:55.560 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:55.552+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:31:57.147 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.140+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:57.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.140+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:31:57.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.140+0000 7f5ffeffd700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec011fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:57.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.140+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec0155b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:31:57.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.140+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009d80 0x7f5fec009100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:57.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.140+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:31:57.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.140+0000 7f5ffeffd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec00a870 2023-10-18T17:31:57.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.140+0000 7f5ffeffd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f5fec009d80 2023-10-18T17:31:57.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.140+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009d80 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:57.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.140+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:57.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.140+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:57.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.140+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009d80 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:31:57.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.344+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:57.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.344+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009d80 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:57.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.344+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:57.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.344+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009d80 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:31:57.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.748+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:57.756 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.748+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009d80 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:57.756 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.748+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:57.756 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:57.748+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009d80 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:31:58.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:58.552+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:31:58.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:58.552+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009d80 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:31:58.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:58.552+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:31:58.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:31:58.552+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009d80 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:00.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.140+0000 7f5ffeffd700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009d80 msgr2=0x7f5fec009100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:00.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.140+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009d80 0x7f5fec009100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:00.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.140+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:00.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.140+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00a870 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:00.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.140+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 0x7f5fec00ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:00.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.140+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec014370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:00.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.140+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec016e40 con 0x7f5fec00d6e0 2023-10-18T17:32:00.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.140+0000 7f5ffeffd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec00caf0 2023-10-18T17:32:00.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.140+0000 7f5ffeffd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f5fec013f90 2023-10-18T17:32:00.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.140+0000 7f600d838700 1 -- reap_dead start 2023-10-18T17:32:00.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.140+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:00.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.140+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:00.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.140+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00c3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:00.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.140+0000 7f600d838700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec014370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:00.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.140+0000 7f600d838700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec014370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:00.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.344+0000 7f600d838700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec014370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:00.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.344+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:00.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.344+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00c3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:00.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.344+0000 7f600d838700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec014370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:00.352 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.344+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:00.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.748+0000 7f600d838700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec014370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:00.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.748+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:00.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.748+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00c3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:00.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.748+0000 7f600d838700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec014370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:00.756 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:00.748+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:01.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:01.551+0000 7f600d838700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec014370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:01.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:01.551+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00c3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:01.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:01.551+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:01.560 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:01.551+0000 7f600d838700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec014370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:01.560 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:01.551+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:03.148 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:03.139+0000 7f5ffeffd700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec014370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:03.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:03.139+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec014370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:03.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:03.139+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:03.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:03.139+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:03.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:03.139+0000 7f5ffeffd700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00c3e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:03.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:03.139+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 0x7f5fec00bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:03.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:03.139+0000 7f5ffeffd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60081551c0 con 0x7f5fec005b40 2023-10-18T17:32:03.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:03.139+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec014d40 2023-10-18T17:32:03.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:03.139+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec015510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:03.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:03.139+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:03.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:03.139+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:03.349 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:03.343+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec015510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:03.349 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:03.343+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:03.350 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:03.343+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:03.754 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:03.747+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:03.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:03.747+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec015510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:03.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:03.747+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:04.558 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:04.551+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec015510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:04.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:04.551+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:04.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:04.551+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:05.001 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:32:05.009 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:32:06.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.139+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:06.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.139+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014d40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:06.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.139+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec015510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:06.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.139+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 0x7f5fec0084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:06.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.139+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:06.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.139+0000 7f600d838700 1 -- reap_dead start 2023-10-18T17:32:06.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.139+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec016e40 con 0x7f5fec00d6e0 2023-10-18T17:32:06.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.139+0000 7f5ffeffd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec00caf0 2023-10-18T17:32:06.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.139+0000 7f5ffeffd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f5fec013f90 2023-10-18T17:32:06.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.139+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00c3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:06.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.139+0000 7f600d838700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:06.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.139+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:06.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.139+0000 7f600d838700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:06.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.139+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:06.350 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.343+0000 7f600d838700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:06.350 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.343+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:06.350 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.343+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00c3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:06.350 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.343+0000 7f600d838700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:06.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.343+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:06.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.747+0000 7f600d838700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:06.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.747+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00c3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:06.755 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.747+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:06.756 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.747+0000 7f600d838700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:06.756 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:06.747+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:07.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:07.551+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00c3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:07.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:07.551+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:07.559 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:07.551+0000 7f600d838700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:07.560 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:07.551+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:07.560 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:07.551+0000 7f600d838700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:09.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:09.143+0000 7f5ffeffd700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:09.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:09.143+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:09.149 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:09.143+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:09.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:09.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:09.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:09.143+0000 7f5ffeffd700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00c3e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:09.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:09.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec00bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:09.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:09.143+0000 7f5ffeffd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60081551c0 con 0x7f5fec014d40 2023-10-18T17:32:09.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:09.143+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec005b40 2023-10-18T17:32:09.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:09.143+0000 7f600d037700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:09.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:09.143+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014d40 legacy=0x7f5fec015510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:09.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:09.143+0000 7f600d037700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:09.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:09.347+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014d40 legacy=0x7f5fec015510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:09.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:09.347+0000 7f600d037700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:09.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:09.347+0000 7f600d037700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:09.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:09.751+0000 7f600d037700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:09.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:09.751+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014d40 legacy=0x7f5fec015510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:09.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:09.751+0000 7f600d037700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:10.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:10.555+0000 7f600d037700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:10.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:10.555+0000 7f600d037700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:10.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:10.555+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014d40 legacy=0x7f5fec015510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:12.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.143+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:12.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:12.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.143+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014d40 legacy=0x7f5fec015510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:12.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.143+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:12.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 0x7f5fec0084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:12.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.143+0000 7f600d838700 1 -- reap_dead start 2023-10-18T17:32:12.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec00bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:12.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.143+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec005b40 2023-10-18T17:32:12.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.143+0000 7f5ffeffd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f5fec00caf0 2023-10-18T17:32:12.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.143+0000 7f5ffeffd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec00d3e0 con 0x7f5fec013f90 2023-10-18T17:32:12.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.143+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:12.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.143+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:12.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.143+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:12.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.143+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:12.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.143+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:12.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.143+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:12.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.347+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:12.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.347+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:12.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.347+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:12.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.347+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:12.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.347+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:12.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.347+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:12.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.751+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:12.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.751+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:12.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.751+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:12.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.751+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:12.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.751+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:12.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:12.751+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:13.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:13.555+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:13.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:13.555+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:13.564 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:13.555+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:13.564 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:13.555+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:13.564 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:13.555+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:13.564 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:13.555+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:15.150 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:15.143+0000 7f5ffeffd700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:15.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:15.143+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:15.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:15.143+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:15.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:15.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00caf0 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:15.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:15.143+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec00bef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:15.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:15.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec00bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:15.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:15.143+0000 7f5ffeffd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec016e40 con 0x7f5fec009150 2023-10-18T17:32:15.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:15.143+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60081551c0 con 0x7f5fec00d6e0 2023-10-18T17:32:15.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:15.143+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:15.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:15.143+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00c3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:15.354 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:15.347+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:15.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:15.347+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00c3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:15.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:15.751+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:15.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:15.751+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00c3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:16.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:16.555+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:16.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:16.555+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00c3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:18.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.143+0000 7f5ffeffd700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00d6e0 legacy=0x7f5fec00c3e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:18.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.143+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:18.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.143+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:18.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.143+0000 7f600d838700 1 -- reap_dead start 2023-10-18T17:32:18.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 0x7f5fec014ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:18.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.143+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6008154920 con 0x7f5fec005b40 2023-10-18T17:32:18.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.143+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec009150 2023-10-18T17:32:18.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.143+0000 7f5ffeffd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f5fec013f90 2023-10-18T17:32:18.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.143+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:18.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.143+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:18.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.143+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:18.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.143+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec014ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:18.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.143+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 0x7f5fec014ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:18.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.347+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec014ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:18.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.347+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 0x7f5fec014ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:18.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.347+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:18.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.347+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:18.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.347+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:18.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.751+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:18.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.751+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec014ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:18.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.751+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:18.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.751+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 0x7f5fec014ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:18.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:18.751+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:19.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:19.555+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec014ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:19.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:19.555+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:19.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:19.555+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:19.564 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:19.555+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 0x7f5fec014ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:19.564 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:19.555+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:21.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:21.143+0000 7f5ffeffd700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:21.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:21.143+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:21.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:21.143+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec014ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:21.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:21.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 0x7f5fec014ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:21.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:21.143+0000 7f5ffeffd700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:21.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:21.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00d6e0 0x7f5fec014410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:21.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:21.143+0000 7f5ffeffd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec016e40 con 0x7f5fec00bef0 2023-10-18T17:32:21.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:21.143+0000 7f5ffeffd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec00d6e0 2023-10-18T17:32:21.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:21.143+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec00c300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:21.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:21.143+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00d6e0 msgr2=0x7f5fec014410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:21.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:21.143+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00d6e0 0x7f5fec014410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:21.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:21.347+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec00c300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:21.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:21.347+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00d6e0 msgr2=0x7f5fec014410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:21.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:21.347+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00d6e0 0x7f5fec014410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:21.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:21.751+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec00c300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:21.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:21.751+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00d6e0 msgr2=0x7f5fec014410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:21.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:21.751+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00d6e0 0x7f5fec014410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:22.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:22.555+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec00c300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:22.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:22.555+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00d6e0 msgr2=0x7f5fec014410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:22.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:22.555+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00d6e0 0x7f5fec014410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:24.151 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.143+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00d6e0 msgr2=0x7f5fec014410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:24.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00d6e0 0x7f5fec014410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:24.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.143+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec00c300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:24.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00ca10 0x7f5fec0084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:24.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.143+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:24.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.143+0000 7f600d838700 1 -- reap_dead start 2023-10-18T17:32:24.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.143+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6008154920 con 0x7f5fec005b40 2023-10-18T17:32:24.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.143+0000 7f5ffeffd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec00ca10 2023-10-18T17:32:24.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.143+0000 7f5ffeffd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f5fec013f90 2023-10-18T17:32:24.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.143+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:24.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.143+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00ca10 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:24.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.143+0000 7f600d838700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:24.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.143+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00ca10 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:24.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.143+0000 7f600d838700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:24.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.347+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:24.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.347+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00ca10 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:24.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.347+0000 7f600d838700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:24.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.347+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00ca10 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:24.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.347+0000 7f600d838700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:24.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.751+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00ca10 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:24.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.751+0000 7f600d838700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:24.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.751+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:24.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.751+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00ca10 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:24.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:24.751+0000 7f600d838700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:25.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:25.555+0000 7f600d838700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:25.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:25.555+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:25.564 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:25.555+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00ca10 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:25.564 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:25.555+0000 7f600d838700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:25.564 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:25.555+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00ca10 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:27.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:27.143+0000 7f5ffeffd700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:27.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:27.143+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:27.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:27.143+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00ca10 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:27.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:27.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00ca10 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:27.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:27.143+0000 7f5ffeffd700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec005b40 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:27.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:27.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00bef0 0x7f5fec014ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:27.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:27.143+0000 7f5ffeffd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec016e40 con 0x7f5fec009150 2023-10-18T17:32:27.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:27.143+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec00bef0 2023-10-18T17:32:27.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:27.143+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00bef0 msgr2=0x7f5fec014ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:27.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:27.143+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00bef0 0x7f5fec014ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:27.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:27.143+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec00c300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:27.353 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:27.347+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00bef0 msgr2=0x7f5fec014ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:27.353 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:27.347+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00bef0 0x7f5fec014ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:27.353 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:27.347+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec00c300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:27.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:27.751+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec00c300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:27.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:27.751+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00bef0 msgr2=0x7f5fec014ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:27.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:27.751+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00bef0 0x7f5fec014ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:28.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:28.555+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec00c300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:28.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:28.555+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00bef0 msgr2=0x7f5fec014ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:28.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:28.555+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00bef0 0x7f5fec014ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:30.152 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.143+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00bef0 msgr2=0x7f5fec014ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:30.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00bef0 0x7f5fec014ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:30.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.143+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec00c300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:30.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.143+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:30.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.143+0000 7f600d838700 1 -- reap_dead start 2023-10-18T17:32:30.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec0084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:30.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.143+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6008154920 con 0x7f5fec00bef0 2023-10-18T17:32:30.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.143+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec005b40 2023-10-18T17:32:30.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.143+0000 7f5ffeffd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f5fec013f90 2023-10-18T17:32:30.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.143+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:30.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.143+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:30.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.143+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:30.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.143+0000 7f600d838700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:30.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.143+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:30.353 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.347+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:30.354 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.347+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:30.354 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.347+0000 7f600d838700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:30.354 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.347+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:30.354 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.347+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:30.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.751+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:30.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.751+0000 7f600d838700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:30.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.751+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:30.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.751+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:30.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:30.751+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:31.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:31.555+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:31.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:31.555+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:31.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:31.555+0000 7f600d838700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:31.564 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:31.555+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:31.564 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:31.555+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:33.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:33.147+0000 7f5ffeffd700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:33.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:33.147+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:33.153 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:33.147+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:33.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:33.147+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:33.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:33.147+0000 7f5ffeffd700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:33.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:33.147+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec014410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:33.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:33.147+0000 7f5ffeffd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec016e40 con 0x7f5fec009150 2023-10-18T17:32:33.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:33.147+0000 7f5ffeffd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec00c9e0 2023-10-18T17:32:33.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:33.147+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:33.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:33.147+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec014410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:33.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:33.147+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec014410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:33.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:33.351+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:33.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:33.351+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec014410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:33.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:33.351+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec014410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:33.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:33.755+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:33.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:33.755+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec014410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:33.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:33.755+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec014410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:34.567 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:34.559+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:34.567 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:34.559+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec014410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:34.568 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:34.559+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec014410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:35.089 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:32:35.096 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:32:36.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.147+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec014410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:36.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.147+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec014410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:36.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.147+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:36.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.147+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:36.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.147+0000 7f600d838700 1 -- reap_dead start 2023-10-18T17:32:36.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.147+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec0084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:36.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.147+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6008154920 con 0x7f5fec00bef0 2023-10-18T17:32:36.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.147+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec005b40 2023-10-18T17:32:36.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.147+0000 7f5ffeffd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f5fec013f90 2023-10-18T17:32:36.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.147+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:36.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.147+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:36.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.147+0000 7f600d838700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:36.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.147+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:36.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.147+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:36.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.351+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:36.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.351+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:36.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.351+0000 7f600d838700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:36.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.351+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:36.360 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.351+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:36.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.755+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:36.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.755+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:36.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.755+0000 7f600d838700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:36.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.755+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:36.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:36.755+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:37.567 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:37.559+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:37.567 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:37.559+0000 7f600d838700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:37.567 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:37.559+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:37.568 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:37.559+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:37.568 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:37.559+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:39.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:39.143+0000 7f5ffeffd700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:39.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:39.143+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:39.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:39.143+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec0084d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:39.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:39.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec0084d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:39.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:39.143+0000 7f5ffeffd700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:39.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:39.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec014370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:39.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:39.143+0000 7f5ffeffd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec016e40 con 0x7f5fec009150 2023-10-18T17:32:39.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:39.143+0000 7f5ffeffd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec00c9e0 2023-10-18T17:32:39.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:39.143+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:39.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:39.143+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec014370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:39.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:39.143+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec014370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:39.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:39.347+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:39.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:39.347+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec014370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:39.356 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:39.347+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec014370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:39.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:39.751+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:39.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:39.751+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec014370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:39.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:39.751+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec014370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:40.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:40.555+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:40.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:40.555+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec014370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:40.563 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:40.555+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec014370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:42.154 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.147+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec014370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:42.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.147+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec014370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:42.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.147+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec009150 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:42.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.147+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:42.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.147+0000 7f600d838700 1 -- reap_dead start 2023-10-18T17:32:42.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.147+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec008460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:42.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.147+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6008154920 con 0x7f5fec00bef0 2023-10-18T17:32:42.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.147+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec005b40 2023-10-18T17:32:42.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.147+0000 7f5ffeffd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f5fec013f90 2023-10-18T17:32:42.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.147+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:42.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.147+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:42.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.147+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:42.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.147+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec008460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:42.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.147+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:42.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.351+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:42.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.351+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec008460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:42.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.351+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:42.360 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.351+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:42.360 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.351+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:42.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.755+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:42.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.755+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec008460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:42.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.755+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:42.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.755+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:42.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:42.755+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:43.567 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:43.559+0000 7f600d838700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:43.567 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:43.559+0000 7f600d838700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec008460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:43.567 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:43.559+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:43.568 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:43.559+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:43.568 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:43.559+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:45.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:45.143+0000 7f5ffeffd700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:45.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:45.143+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec013f90 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:45.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:45.143+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec008460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:45.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:45.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec008460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:45.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:45.143+0000 7f5ffeffd700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:45.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:45.143+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 0x7f5fec014370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:45.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:45.143+0000 7f5ffeffd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec016e40 con 0x7f5fec014cb0 2023-10-18T17:32:45.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:45.143+0000 7f5ffeffd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec009150 2023-10-18T17:32:45.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:45.147+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:45.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:45.147+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec014370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:45.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:45.147+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 0x7f5fec014370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:45.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:45.351+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:45.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:45.351+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec014370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:45.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:45.351+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 0x7f5fec014370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:45.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:45.755+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:45.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:45.755+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec014370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:45.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:45.755+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 0x7f5fec014370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:46.567 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:46.559+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:46.567 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:46.559+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec014370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:46.568 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:46.559+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 0x7f5fec014370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:48.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.147+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec014370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:48.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.147+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 0x7f5fec014370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:48.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.147+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:48.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.147+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec008460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:48.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.147+0000 7f600d838700 1 -- reap_dead start 2023-10-18T17:32:48.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.147+0000 7f5ffeffd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6008154920 con 0x7f5fec014cb0 2023-10-18T17:32:48.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.147+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec016e40 con 0x7f5fec00bef0 2023-10-18T17:32:48.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.147+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec005b40 2023-10-18T17:32:48.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.147+0000 7f600d037700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:48.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.147+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:48.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.147+0000 7f600d037700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec008460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:48.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.147+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:48.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.351+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:48.360 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.351+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:48.360 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.351+0000 7f600d037700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:48.360 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.351+0000 7f600d037700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec008460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:48.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.755+0000 7f600d037700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:48.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.755+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:48.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.755+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:48.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:48.755+0000 7f600d037700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec008460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:49.564 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:49.559+0000 7f600c836700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:49.565 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:49.559+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:49.565 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:49.559+0000 7f600d037700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:49.565 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:49.559+0000 7f600d037700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec008460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:51.155 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.147+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec008460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:51.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.147+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec008460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:51.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.147+0000 7f5ffeffd700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:51.161 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.147+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:51.161 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.147+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:51.162 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.147+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec013f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:51.162 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.147+0000 7f5ffeffd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec00c9e0 2023-10-18T17:32:51.162 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.147+0000 7f5ffeffd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f5fec009150 2023-10-18T17:32:51.163 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.147+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:51.163 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.147+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec013f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:51.163 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.147+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:51.164 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.147+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec013f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:51.357 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.351+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:51.358 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.351+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec013f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:51.358 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.351+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:51.358 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.351+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec013f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:51.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.755+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:51.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.755+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec013f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:51.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.755+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:51.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:51.755+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec013f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:52.564 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:52.559+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:52.565 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:52.559+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec013f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:52.565 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:52.559+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:52.565 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:52.559+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec013f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:54.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.147+0000 7f5ffeffd700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:54.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.147+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:54.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.147+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec013f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:54.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.147+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec013f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:54.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.147+0000 7f600d838700 1 -- reap_dead start 2023-10-18T17:32:54.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.147+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:54.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.147+0000 7f5ffeffd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60081551c0 con 0x7f5fec014cb0 2023-10-18T17:32:54.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.147+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6008154920 con 0x7f5fec00bef0 2023-10-18T17:32:54.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.147+0000 7f5ffeffd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec009150 2023-10-18T17:32:54.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.147+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:54.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.147+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:54.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.147+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:54.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.147+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:54.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.351+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:54.360 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.351+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:54.360 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.351+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:54.360 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.351+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:54.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.755+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:54.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.755+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:54.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.755+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:54.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:54.755+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:55.564 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:55.559+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:32:55.565 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:55.559+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:32:55.565 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:55.559+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:32:55.565 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:55.559+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:57.156 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.151+0000 7f5ffeffd700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:57.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.151+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:32:57.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.151+0000 7f5ffeffd700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:57.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.151+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:32:57.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.151+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec013f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:57.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.151+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec008400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:32:57.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.151+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec005b40 2023-10-18T17:32:57.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.151+0000 7f5ffeffd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f5fec00c9e0 2023-10-18T17:32:57.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.151+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec013f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:57.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.151+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec008400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:57.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.151+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec013f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:57.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.151+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec008400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:32:57.363 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.355+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec008400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:57.363 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.355+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec008400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:57.363 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.355+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec013f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:57.364 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.355+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec013f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:32:57.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.759+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec008400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:57.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.759+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec008400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:57.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.759+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec013f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:57.769 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:57.759+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec013f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:32:58.568 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:58.563+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec008400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:32:58.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:58.563+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec008400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:32:58.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:58.563+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec013f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:32:58.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:32:58.563+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec013f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:33:00.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.150+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 msgr2=0x7f5fec013f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:33:00.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.150+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec00c9e0 0x7f5fec013f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:33:00.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.150+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 msgr2=0x7f5fec008400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:33:00.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.150+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec005b40 0x7f5fec008400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:33:00.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.150+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014480 0x7f5fec018fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:33:00.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.150+0000 7f600d838700 1 -- reap_dead start 2023-10-18T17:33:00.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.150+0000 7f5ffeffd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec016e40 con 0x7f5fec014cb0 2023-10-18T17:33:00.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.150+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60081551c0 con 0x7f5fec00bef0 2023-10-18T17:33:00.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.150+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec014480 2023-10-18T17:33:00.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.150+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:33:00.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.150+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014480 msgr2=0x7f5fec018fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:33:00.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.150+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014480 0x7f5fec018fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:33:00.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.150+0000 7f600d838700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:33:00.363 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.354+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014480 msgr2=0x7f5fec018fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:33:00.363 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.354+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:33:00.364 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.354+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014480 0x7f5fec018fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:33:00.364 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.354+0000 7f600d838700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:33:00.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.758+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:33:00.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.758+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014480 msgr2=0x7f5fec018fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:33:00.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.758+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014480 0x7f5fec018fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:33:00.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:00.758+0000 7f600d838700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:33:01.568 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:01.562+0000 7f600d037700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:33:01.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:01.562+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014480 msgr2=0x7f5fec018fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:33:01.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:01.562+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014480 0x7f5fec018fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:33:01.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:01.562+0000 7f600d838700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:33:03.157 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.146+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014480 msgr2=0x7f5fec018fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:33:03.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.146+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec014480 0x7f5fec018fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:33:03.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.146+0000 7f5ffeffd700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:33:03.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.146+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:33:03.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.146+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:33:03.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.146+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec00c9e0 0x7f5fec013f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:33:03.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.146+0000 7f5ffeffd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec009150 2023-10-18T17:33:03.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.146+0000 7f5ffeffd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f5fec00c9e0 2023-10-18T17:33:03.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.146+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:33:03.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.146+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec00c9e0 msgr2=0x7f5fec013f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:33:03.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.146+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:33:03.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.146+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec00c9e0 0x7f5fec013f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:33:03.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.350+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:33:03.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.350+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec00c9e0 msgr2=0x7f5fec013f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:33:03.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.350+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:33:03.359 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.350+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec00c9e0 0x7f5fec013f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:33:03.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.754+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:33:03.763 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.754+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec00c9e0 msgr2=0x7f5fec013f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:33:03.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.754+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:33:03.764 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:03.754+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec00c9e0 0x7f5fec013f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:33:04.565 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:04.558+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:33:04.565 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:04.558+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec00c9e0 msgr2=0x7f5fec013f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:33:04.565 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:04.558+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:33:04.565 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:04.558+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec00c9e0 0x7f5fec013f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:33:05.168 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:33:05.176 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:33:06.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.150+0000 7f5ffeffd700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec00c9e0 msgr2=0x7f5fec013f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:33:06.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.150+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec00c9e0 0x7f5fec013f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:33:06.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.150+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:33:06.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.150+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:33:06.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.150+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0063f0 0x7f5fec0194d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:33:06.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.150+0000 7f600d838700 1 -- reap_dead start 2023-10-18T17:33:06.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.150+0000 7f5ffeffd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6008154920 con 0x7f5fec014cb0 2023-10-18T17:33:06.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.150+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec016e40 con 0x7f5fec00bef0 2023-10-18T17:33:06.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.150+0000 7f5ffeffd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec0063f0 2023-10-18T17:33:06.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.150+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:33:06.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.150+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0063f0 msgr2=0x7f5fec0194d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:33:06.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.150+0000 7f600d838700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:33:06.161 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.150+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0063f0 0x7f5fec0194d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:33:06.363 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.354+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:33:06.363 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.354+0000 7f600d838700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:33:06.364 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.354+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0063f0 msgr2=0x7f5fec0194d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:33:06.364 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.354+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0063f0 0x7f5fec0194d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:33:06.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.758+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:33:06.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.758+0000 7f600d838700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:33:06.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.758+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0063f0 msgr2=0x7f5fec0194d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:33:06.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:06.758+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0063f0 0x7f5fec0194d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:33:07.568 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:07.562+0000 7f600c836700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:33:07.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:07.562+0000 7f600d037700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0063f0 msgr2=0x7f5fec0194d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:33:07.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:07.562+0000 7f600d838700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:33:07.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:07.562+0000 7f600d037700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0063f0 0x7f5fec0194d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:33:09.158 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.150+0000 7f5ffeffd700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0063f0 msgr2=0x7f5fec0194d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:33:09.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.150+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0063f0 0x7f5fec0194d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:33:09.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.150+0000 7f5ffeffd700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:33:09.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.150+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:33:09.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.150+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:33:09.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.150+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec013f90 0x7f5fec016fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:33:09.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.150+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec009150 2023-10-18T17:33:09.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.150+0000 7f5ffeffd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f5fec013f90 2023-10-18T17:33:09.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.150+0000 7f600d037700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:33:09.161 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.150+0000 7f600d037700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:33:09.161 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.150+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec013f90 msgr2=0x7f5fec016fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:33:09.161 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.150+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec013f90 0x7f5fec016fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:33:09.363 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.354+0000 7f600d037700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:33:09.363 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.354+0000 7f600d037700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:33:09.363 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.354+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec013f90 msgr2=0x7f5fec016fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:33:09.364 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.354+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec013f90 0x7f5fec016fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:33:09.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.758+0000 7f600d037700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:33:09.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.758+0000 7f600d037700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:33:09.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.758+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec013f90 msgr2=0x7f5fec016fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:33:09.769 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:09.758+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec013f90 0x7f5fec016fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:33:10.568 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:10.562+0000 7f600d037700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:33:10.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:10.562+0000 7f600d037700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:33:10.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:10.562+0000 7f600c836700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec013f90 msgr2=0x7f5fec016fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:33:10.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:10.562+0000 7f600c836700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec013f90 0x7f5fec016fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:33:12.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.146+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec013f90 msgr2=0x7f5fec016fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:33:12.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.146+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec013f90 0x7f5fec016fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:33:12.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.146+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:33:12.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.146+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec009150 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:33:12.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.146+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec014410 0x7f5fec0199c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:33:12.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.146+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00ff40 0x7f5fec016fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:33:12.161 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.146+0000 7f600d838700 1 -- reap_dead start 2023-10-18T17:33:12.161 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.146+0000 7f5ffeffd700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60081551c0 con 0x7f5fec014cb0 2023-10-18T17:33:12.161 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.146+0000 7f5ffeffd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec00ff40 2023-10-18T17:33:12.161 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.146+0000 7f5ffeffd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6008154640 con 0x7f5fec014410 2023-10-18T17:33:12.162 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.146+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec014410 msgr2=0x7f5fec0199c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:33:12.162 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.150+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00ff40 msgr2=0x7f5fec016fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:33:12.162 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.150+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec014410 0x7f5fec0199c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:33:12.163 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.150+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00ff40 0x7f5fec016fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:33:12.163 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.150+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:33:12.363 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.354+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:33:12.364 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.354+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00ff40 msgr2=0x7f5fec016fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:33:12.364 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.354+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00ff40 0x7f5fec016fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:33:12.365 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.354+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec014410 msgr2=0x7f5fec0199c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:33:12.365 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.354+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec014410 0x7f5fec0199c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:33:12.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.758+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:33:12.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.758+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00ff40 msgr2=0x7f5fec016fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:33:12.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.758+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00ff40 0x7f5fec016fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:33:12.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.758+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec014410 msgr2=0x7f5fec0199c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:33:12.768 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:12.758+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec014410 0x7f5fec0199c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:33:13.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:13.562+0000 7f600d838700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.158:6789/0 2023-10-18T17:33:13.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:13.562+0000 7f600c836700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00ff40 msgr2=0x7f5fec016fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.158:3300/0 2023-10-18T17:33:13.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:13.562+0000 7f600c836700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00ff40 0x7f5fec016fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:33:13.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:13.562+0000 7f600d037700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec014410 msgr2=0x7f5fec0199c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3300/0 2023-10-18T17:33:13.570 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:13.562+0000 7f600d037700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec014410 0x7f5fec0199c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:33:15.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:15.150+0000 7f5ffeffd700 1 -- >> v2:172.21.15.183:3300/0 conn(0x7f5fec014410 msgr2=0x7f5fec0199c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:33:15.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:15.150+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5fec014410 0x7f5fec0199c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:33:15.159 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:15.150+0000 7f5ffeffd700 1 -- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00ff40 msgr2=0x7f5fec016fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:33:15.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:15.150+0000 7f5ffeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5fec00ff40 0x7f5fec016fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T17:33:15.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:15.150+0000 7f5ffeffd700 1 -- >> v1:172.21.15.158:6789/0 conn(0x7f5fec014cb0 legacy=0x7f5fec00c2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T17:33:15.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:15.150+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0194d0 0x7f5fec00ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T17:33:15.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:15.150+0000 7f5ffeffd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6008154920 con 0x7f5fec00bef0 2023-10-18T17:33:15.160 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:15.150+0000 7f5ffeffd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60081543a0 con 0x7f5fec0194d0 2023-10-18T17:33:15.161 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:15.150+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:33:15.161 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:15.150+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0194d0 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:33:15.161 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:15.150+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0194d0 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T17:33:15.360 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:15.354+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:33:15.360 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:15.354+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0194d0 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:33:15.360 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:15.354+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0194d0 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T17:33:15.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:15.758+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:33:15.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:15.758+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0194d0 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:33:15.767 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:15.758+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0194d0 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T17:33:16.568 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:16.562+0000 7f600d037700 1 -- >> v1:172.21.15.183:6789/0 conn(0x7f5fec00bef0 legacy=0x7f5fec0154b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.183:6789/0 2023-10-18T17:33:16.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:16.562+0000 7f600c836700 1 -- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0194d0 msgr2=0x7f5fec00ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.183:3301/0 2023-10-18T17:33:16.569 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T17:33:16.562+0000 7f600c836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fec0194d0 0x7f5fec00ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T17:33:18.029 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-18T17:33:18.030 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1905, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1482, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3166, in wait_until_healthy while self.get_mon_health()['status'] != 'HEALTH_OK': File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3158, in get_mon_health out = self.raw_cluster_cmd('health', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1911, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2286, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2520, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2023-10-18T17:33:18.031 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-18T17:33:18.031 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-18T17:33:18.032 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T17:33:18.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T17:33:18.033 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1905, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1482, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3166, in wait_until_healthy while self.get_mon_health()['status'] != 'HEALTH_OK': File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3158, in get_mon_health out = self.raw_cluster_cmd('health', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1451, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1911, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2286, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2520, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-10-18T17:33:18.033 INFO:tasks.ceph.mds.a:Stopped 2023-10-18T17:33:18.034 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-18T17:33:18.034 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T17:33:18.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T17:33:18.035 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1905, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1482, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3166, in wait_until_healthy while self.get_mon_health()['status'] != 'HEALTH_OK': File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3158, in get_mon_health out = self.raw_cluster_cmd('health', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1451, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1911, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2286, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2520, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-10-18T17:33:18.036 INFO:tasks.ceph.mds.c:Stopped 2023-10-18T17:33:18.037 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-10-18T17:33:18.037 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T17:33:18.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T17:33:18.038 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1905, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1482, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3166, in wait_until_healthy while self.get_mon_health()['status'] != 'HEALTH_OK': File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3158, in get_mon_health out = self.raw_cluster_cmd('health', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1451, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1911, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2286, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2520, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e' 2023-10-18T17:33:18.039 INFO:tasks.ceph.mds.e:Stopped 2023-10-18T17:33:18.039 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-18T17:33:18.040 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T17:33:18.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T17:33:18.041 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1905, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1482, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3166, in wait_until_healthy while self.get_mon_health()['status'] != 'HEALTH_OK': File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3158, in get_mon_health out = self.raw_cluster_cmd('health', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1451, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1911, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2286, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2520, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi183 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-10-18T17:33:18.041 INFO:tasks.ceph.mds.b:Stopped 2023-10-18T17:33:18.042 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-18T17:33:18.042 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T17:33:18.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T17:33:18.043 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1905, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1482, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3166, in wait_until_healthy while self.get_mon_health()['status'] != 'HEALTH_OK': File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3158, in get_mon_health out = self.raw_cluster_cmd('health', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1451, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1911, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2286, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2520, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi183 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-10-18T17:33:18.044 INFO:tasks.ceph.mds.d:Stopped 2023-10-18T17:33:18.045 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2023-10-18T17:33:18.045 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T17:33:18.046 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T17:33:18.046 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1905, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1482, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3166, in wait_until_healthy while self.get_mon_health()['status'] != 'HEALTH_OK': File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3158, in get_mon_health out = self.raw_cluster_cmd('health', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1451, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1911, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2286, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2520, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi183 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f' 2023-10-18T17:33:18.047 INFO:tasks.ceph.mds.f:Stopped 2023-10-18T17:33:18.048 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-18T17:33:18.048 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-18T17:33:18.048 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T17:33:18.049 INFO:tasks.ceph.osd.0:Stopped 2023-10-18T17:33:18.049 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-18T17:33:18.050 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T17:33:18.051 INFO:tasks.ceph.osd.1:Stopped 2023-10-18T17:33:18.051 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-18T17:33:18.051 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T17:33:18.052 INFO:tasks.ceph.osd.2:Stopped 2023-10-18T17:33:18.052 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-18T17:33:18.053 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T17:33:18.053 INFO:tasks.ceph.osd.3:Stopped 2023-10-18T17:33:18.054 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-18T17:33:18.054 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T17:33:18.055 INFO:tasks.ceph.osd.4:Stopped 2023-10-18T17:33:18.055 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-18T17:33:18.056 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T17:33:18.056 INFO:tasks.ceph.osd.5:Stopped 2023-10-18T17:33:18.057 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-18T17:33:18.057 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T17:33:18.058 INFO:tasks.ceph.osd.6:Stopped 2023-10-18T17:33:18.058 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-18T17:33:18.059 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T17:33:18.059 INFO:tasks.ceph.osd.7:Stopped 2023-10-18T17:33:18.060 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-18T17:33:18.060 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-18T17:33:18.061 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T17:33:18.061 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T17:33:18.062 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1905, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1482, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3166, in wait_until_healthy while self.get_mon_health()['status'] != 'HEALTH_OK': File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3158, in get_mon_health out = self.raw_cluster_cmd('health', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1451, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1911, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2286, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2520, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y' 2023-10-18T17:33:18.062 INFO:tasks.ceph.mgr.y:Stopped 2023-10-18T17:33:18.063 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-18T17:33:18.063 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T17:33:18.064 INFO:tasks.ceph.mgr.x:Stopped 2023-10-18T17:33:18.064 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-18T17:33:18.065 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-18T17:33:18.065 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T17:33:18.066 INFO:tasks.ceph.mon.a:Stopped 2023-10-18T17:33:18.066 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-18T17:33:18.067 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T17:33:18.067 INFO:tasks.ceph.mon.b:Stopped 2023-10-18T17:33:18.068 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-18T17:33:18.068 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T17:33:18.068 INFO:tasks.ceph.mon.c:Stopped 2023-10-18T17:33:18.069 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-18T17:33:18.070 DEBUG:teuthology.orchestra.run.smithi158:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v MDS_SLOW_METADATA_IO | egrep -v MDS_TRIM | head -n 1 2023-10-18T17:33:18.124 INFO:teuthology.orchestra.run.smithi158.stdout:2023-10-18T17:24:50.516443+0000 mon.a (mon.0) 179 : cluster [WRN] Replacing daemon mds.c as rank 0 with standby daemon mds.d 2023-10-18T17:33:18.125 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-18T17:33:18.125 DEBUG:teuthology.orchestra.run.smithi158:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v MDS_SLOW_METADATA_IO | egrep -v MDS_TRIM | head -n 1 2023-10-18T17:33:18.171 DEBUG:teuthology.orchestra.run.smithi158:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v MDS_SLOW_METADATA_IO | egrep -v MDS_TRIM | head -n 1 2023-10-18T17:33:18.274 DEBUG:teuthology.orchestra.run.smithi158:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v MDS_SLOW_METADATA_IO | egrep -v MDS_TRIM | head -n 1 2023-10-18T17:33:18.320 INFO:teuthology.orchestra.run.smithi158.stdout:2023-10-18T17:24:50.516443+0000 mon.a (mon.0) 179 : cluster [WRN] Replacing daemon mds.c as rank 0 with standby daemon mds.d 2023-10-18T17:33:18.321 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-18T17:33:18.322 DEBUG:teuthology.orchestra.run.smithi158:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-18T17:33:18.624 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-18T17:33:18.625 DEBUG:teuthology.orchestra.run.smithi158:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-18T17:33:18.863 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-18T17:33:18.864 DEBUG:teuthology.orchestra.run.smithi158:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-18T17:33:19.121 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi158.front.sepia.ceph.com 2023-10-18T17:33:19.123 DEBUG:teuthology.orchestra.run.smithi158:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-18T17:33:19.308 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-18T17:33:19.309 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-18T17:33:19.426 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-18T17:33:19.427 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-18T17:33:19.618 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-18T17:33:19.619 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-18T17:33:19.778 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-18T17:33:19.779 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-18T17:33:19.969 INFO:tasks.ceph:Archiving mon data... 2023-10-18T17:33:19.972 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429128/data/mon.a.tgz 2023-10-18T17:33:19.973 DEBUG:teuthology.orchestra.run.smithi158:> mktemp 2023-10-18T17:33:19.994 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.5u5Zl5EE0I 2023-10-18T17:33:19.996 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.5u5Zl5EE0I 2023-10-18T17:33:20.259 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.5u5Zl5EE0I 2023-10-18T17:33:20.353 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.5u5Zl5EE0I is 810KB 2023-10-18T17:33:20.435 DEBUG:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.5u5Zl5EE0I 2023-10-18T17:33:20.456 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429128/data/mon.b.tgz 2023-10-18T17:33:20.456 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2023-10-18T17:33:20.463 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.To7XrrmIyY 2023-10-18T17:33:20.464 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.To7XrrmIyY 2023-10-18T17:33:20.700 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.To7XrrmIyY 2023-10-18T17:33:20.770 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.To7XrrmIyY is 971KB 2023-10-18T17:33:20.842 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.To7XrrmIyY 2023-10-18T17:33:20.849 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429128/data/mon.c.tgz 2023-10-18T17:33:20.850 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2023-10-18T17:33:20.856 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.aAstcM9kFJ 2023-10-18T17:33:20.856 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.aAstcM9kFJ 2023-10-18T17:33:21.129 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.aAstcM9kFJ 2023-10-18T17:33:21.155 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.aAstcM9kFJ is 971KB 2023-10-18T17:33:21.226 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.aAstcM9kFJ 2023-10-18T17:33:21.233 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-18T17:33:21.234 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-18T17:33:21.242 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-18T17:33:21.271 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-18T17:33:21.271 DEBUG:teuthology.orchestra.run.smithi158:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-18T17:33:21.321 DEBUG:teuthology.orchestra.run.smithi183:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-18T17:33:21.346 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-18T17:33:21.369 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-18T17:33:21.384 INFO:tasks.ceph:Archiving crash dumps... 2023-10-18T17:33:21.386 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429128/remote/smithi158/crash 2023-10-18T17:33:21.387 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-18T17:33:21.478 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429128/remote/smithi183/crash 2023-10-18T17:33:21.480 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-18T17:33:21.513 INFO:tasks.ceph:Shutting down logrotate 2023-10-18T17:33:21.514 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:33:21.525 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T17:33:21.589 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-18T17:33:21.623 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-18T17:33:21.639 INFO:tasks.ceph:Compressing logs... 2023-10-18T17:33:21.640 DEBUG:teuthology.orchestra.run.smithi158:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-18T17:33:21.673 DEBUG:teuthology.orchestra.run.smithi183:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-18T17:33:21.701 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2023-10-18T17:33:21.702 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-18T17:33:21.702 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-18T17:33:21.702 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33672.log 2023-10-18T17:33:21.705 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33802.log 2023-10-18T17:33:21.706 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-18T17:33:21.706 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.33672.log: gzip /var/log/ceph/ceph-client.admin.33802.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33697.log 2023-10-18T17:33:21.706 INFO:teuthology.orchestra.run.smithi183.stderr: 88.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 89.2% 2023-10-18T17:33:21.706 INFO:teuthology.orchestra.run.smithi183.stderr: -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2023-10-18T17:33:21.707 INFO:teuthology.orchestra.run.smithi183.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33672.log.gz 2023-10-18T17:33:21.707 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-18T17:33:21.707 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.5.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33802.log.gz 2023-10-18T17:33:21.707 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.33697.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33697.log.gz 2023-10-18T17:33:21.708 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-18T17:33:21.708 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-18T17:33:21.708 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-18T17:33:21.709 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 /var/log/ceph/ceph.audit.log: --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-18T17:33:21.709 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33749.log 2023-10-18T17:33:21.709 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mds.b.log: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-18T17:33:21.712 INFO:teuthology.orchestra.run.smithi183.stderr: 88.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-18T17:33:21.712 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33774.log 2023-10-18T17:33:21.714 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33723.log 2023-10-18T17:33:21.714 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.33749.log: /var/log/ceph/ceph-client.admin.33774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33857.log 2023-10-18T17:33:21.714 INFO:teuthology.orchestra.run.smithi183.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33749.log.gz 2023-10-18T17:33:21.714 INFO:teuthology.orchestra.run.smithi183.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.33774.log.gz/var/log/ceph/ceph-client.admin.33723.log: 2023-10-18T17:33:21.715 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-18T17:33:21.715 INFO:teuthology.orchestra.run.smithi183.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.33723.log.gz 2023-10-18T17:33:21.715 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 /var/log/ceph/ceph-client.admin.33857.log: --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-18T17:33:21.716 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.33857.log.gz 2023-10-18T17:33:21.717 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33830.log 2023-10-18T17:33:21.717 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-18T17:33:21.717 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.33830.log: 93.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-18T17:33:21.717 INFO:teuthology.orchestra.run.smithi183.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33830.log.gz 2023-10-18T17:33:21.725 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38108.log 2023-10-18T17:33:21.728 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37242.log 2023-10-18T17:33:21.730 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39885.log 2023-10-18T17:33:21.730 INFO:teuthology.orchestra.run.smithi158.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38108.log.gz 2023-10-18T17:33:21.731 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36801.log 2023-10-18T17:33:21.733 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37242.log: /var/log/ceph/ceph-client.admin.39885.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39885.log.gz 2023-10-18T17:33:21.733 INFO:teuthology.orchestra.run.smithi158.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37242.log.gz 2023-10-18T17:33:21.734 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39039.log 2023-10-18T17:33:21.735 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.36801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38929.log 2023-10-18T17:33:21.736 INFO:teuthology.orchestra.run.smithi158.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36801.log.gz 2023-10-18T17:33:21.737 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-18T17:33:21.738 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39039.log: /var/log/ceph/ceph-client.admin.38929.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39039.log.gz 2023-10-18T17:33:21.739 INFO:teuthology.orchestra.run.smithi158.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38929.log.gz 2023-10-18T17:33:21.739 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37350.log 2023-10-18T17:33:21.741 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38412.log 2023-10-18T17:33:21.742 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37350.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37350.log.gz 2023-10-18T17:33:21.743 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37458.log 2023-10-18T17:33:21.744 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38412.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38412.log.gz 2023-10-18T17:33:21.745 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36965.log 2023-10-18T17:33:21.747 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37458.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37458.log.gz 2023-10-18T17:33:21.748 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33318.log 2023-10-18T17:33:21.749 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.36965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39286.log 2023-10-18T17:33:21.750 INFO:teuthology.orchestra.run.smithi158.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36965.log.gz 2023-10-18T17:33:21.751 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.33318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40291.log 2023-10-18T17:33:21.752 INFO:teuthology.orchestra.run.smithi158.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.33318.log.gz 2023-10-18T17:33:21.753 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39286.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39286.log.gz 2023-10-18T17:33:21.754 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39394.log 2023-10-18T17:33:21.755 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.40291.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-18T17:33:21.757 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39394.log: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.40291.log.gz 2023-10-18T17:33:21.757 INFO:teuthology.orchestra.run.smithi158.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39394.log.gz 2023-10-18T17:33:21.757 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38848.log 2023-10-18T17:33:21.758 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36597.log 2023-10-18T17:33:21.759 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38848.log: 86.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-18T17:33:21.760 INFO:teuthology.orchestra.run.smithi158.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38848.log.gz 2023-10-18T17:33:21.761 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38249.log 2023-10-18T17:33:21.762 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.36597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38189.log 2023-10-18T17:33:21.762 INFO:teuthology.orchestra.run.smithi158.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36597.log.gz 2023-10-18T17:33:21.763 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38249.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38249.log.gz 2023-10-18T17:33:21.764 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37971.log 2023-10-18T17:33:21.764 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.7.log: 91.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-18T17:33:21.765 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38189.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38189.log.gz 2023-10-18T17:33:21.765 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33067.log 2023-10-18T17:33:21.766 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37971.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-18T17:33:21.766 INFO:teuthology.orchestra.run.smithi158.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37971.log.gz 2023-10-18T17:33:21.768 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.33067.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.33067.log.gz 2023-10-18T17:33:21.768 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36996.log 2023-10-18T17:33:21.769 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36855.log 2023-10-18T17:33:21.770 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.36996.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36996.log.gz 2023-10-18T17:33:21.770 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37809.log 2023-10-18T17:33:21.771 INFO:teuthology.orchestra.run.smithi158.stderr: 88.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-18T17:33:21.772 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.36855.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36855.log.gz 2023-10-18T17:33:21.773 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39012.log 2023-10-18T17:33:21.774 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39232.log 2023-10-18T17:33:21.775 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37809.log: /var/log/ceph/ceph-client.admin.39012.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37809.log.gz 2023-10-18T17:33:21.775 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39640.log 2023-10-18T17:33:21.776 INFO:teuthology.orchestra.run.smithi158.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39012.log.gz 2023-10-18T17:33:21.777 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39232.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39232.log.gz 2023-10-18T17:33:21.778 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38135.log 2023-10-18T17:33:21.779 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37647.log 2023-10-18T17:33:21.780 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39640.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39640.log.gz 2023-10-18T17:33:21.780 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38135.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38135.log.gz 2023-10-18T17:33:21.781 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37296.log 2023-10-18T17:33:21.781 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36624.log 2023-10-18T17:33:21.782 INFO:teuthology.orchestra.run.smithi158.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37647.log.gz 2023-10-18T17:33:21.783 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37296.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37296.log.gz 2023-10-18T17:33:21.783 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37917.log 2023-10-18T17:33:21.784 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.36624.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36624.log.gz 2023-10-18T17:33:21.785 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37782.log 2023-10-18T17:33:21.786 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37755.log 2023-10-18T17:33:21.786 INFO:teuthology.orchestra.run.smithi158.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37917.log.gz 2023-10-18T17:33:21.787 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37782.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37782.log.gz 2023-10-18T17:33:21.788 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40240.log 2023-10-18T17:33:21.789 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39205.log 2023-10-18T17:33:21.789 INFO:teuthology.orchestra.run.smithi158.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37755.log.gz 2023-10-18T17:33:21.790 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.40240.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40240.log.gz 2023-10-18T17:33:21.790 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39149.log 2023-10-18T17:33:21.792 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39205.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39205.log.gz 2023-10-18T17:33:21.792 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38303.log 2023-10-18T17:33:21.794 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39149.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39149.log.gz 2023-10-18T17:33:21.795 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38439.log 2023-10-18T17:33:21.796 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38630.log 2023-10-18T17:33:21.796 INFO:teuthology.orchestra.run.smithi158.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38303.log.gz 2023-10-18T17:33:21.797 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39259.log 2023-10-18T17:33:21.798 INFO:teuthology.orchestra.run.smithi158.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38439.log.gz 2023-10-18T17:33:21.799 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39750.log 2023-10-18T17:33:21.799 INFO:teuthology.orchestra.run.smithi158.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38630.log.gz 2023-10-18T17:33:21.800 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39259.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39259.log.gz 2023-10-18T17:33:21.801 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36936.log 2023-10-18T17:33:21.802 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39750.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-18T17:33:21.802 INFO:teuthology.orchestra.run.smithi158.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39750.log.gz 2023-10-18T17:33:21.803 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.36936.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36936.log.gz 2023-10-18T17:33:21.803 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2023-10-18T17:33:21.804 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40267.log 2023-10-18T17:33:21.806 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38000.log 2023-10-18T17:33:21.807 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.40267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40130.log 2023-10-18T17:33:21.808 INFO:teuthology.orchestra.run.smithi158.stderr: 88.5% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2023-10-18T17:33:21.808 INFO:teuthology.orchestra.run.smithi158.stderr: 95.4%/var/log/ceph/ceph-client.admin.38000.log: -- replaced with /var/log/ceph/ceph-client.admin.40267.log.gz 2023-10-18T17:33:21.809 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37215.log 2023-10-18T17:33:21.809 INFO:teuthology.orchestra.run.smithi158.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38000.log.gz 2023-10-18T17:33:21.810 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.40130.log: 93.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-18T17:33:21.811 INFO:teuthology.orchestra.run.smithi158.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40130.log.gz 2023-10-18T17:33:21.811 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28181.log 2023-10-18T17:33:21.812 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37215.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37215.log.gz 2023-10-18T17:33:21.812 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40076.log 2023-10-18T17:33:21.812 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph.tmp-client.admin.28181.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28181.log.gz 2023-10-18T17:33:21.813 INFO:teuthology.orchestra.run.smithi183.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-18T17:33:21.813 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38276.log 2023-10-18T17:33:21.815 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.40076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39340.log 2023-10-18T17:33:21.815 INFO:teuthology.orchestra.run.smithi158.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40076.log.gz 2023-10-18T17:33:21.816 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37051.log 2023-10-18T17:33:21.816 INFO:teuthology.orchestra.run.smithi158.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38276.log.gz 2023-10-18T17:33:21.817 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39340.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39340.log.gz 2023-10-18T17:33:21.818 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39586.log 2023-10-18T17:33:21.819 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36828.log 2023-10-18T17:33:21.819 INFO:teuthology.orchestra.run.smithi158.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37051.log.gz 2023-10-18T17:33:21.821 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39586.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39586.log.gz 2023-10-18T17:33:21.821 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40022.log 2023-10-18T17:33:21.822 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.36828.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36828.log.gz 2023-10-18T17:33:21.822 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36571.log 2023-10-18T17:33:21.824 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.40022.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-18T17:33:21.824 INFO:teuthology.orchestra.run.smithi158.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40022.log.gz 2023-10-18T17:33:21.825 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.36571.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36571.log.gz 2023-10-18T17:33:21.825 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37377.log 2023-10-18T17:33:21.826 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39421.log 2023-10-18T17:33:21.826 INFO:teuthology.orchestra.run.smithi158.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-18T17:33:21.827 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38603.log 2023-10-18T17:33:21.828 INFO:teuthology.orchestra.run.smithi158.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37377.log.gz 2023-10-18T17:33:21.828 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39421.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39421.log.gz 2023-10-18T17:33:21.829 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37512.log 2023-10-18T17:33:21.830 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38495.log 2023-10-18T17:33:21.830 INFO:teuthology.orchestra.run.smithi158.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38603.log.gz 2023-10-18T17:33:21.831 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39367.log 2023-10-18T17:33:21.831 INFO:teuthology.orchestra.run.smithi158.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37512.log.gz 2023-10-18T17:33:21.832 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38495.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38495.log.gz 2023-10-18T17:33:21.832 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39941.log 2023-10-18T17:33:21.834 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39313.log 2023-10-18T17:33:21.834 INFO:teuthology.orchestra.run.smithi158.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39367.log.gz 2023-10-18T17:33:21.835 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37539.log 2023-10-18T17:33:21.835 INFO:teuthology.orchestra.run.smithi158.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39941.log.gz 2023-10-18T17:33:21.836 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36882.log 2023-10-18T17:33:21.837 INFO:teuthology.orchestra.run.smithi158.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39313.log.gz 2023-10-18T17:33:21.837 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37539.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37539.log.gz 2023-10-18T17:33:21.838 INFO:teuthology.orchestra.run.smithi183.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-18T17:33:21.838 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40157.log 2023-10-18T17:33:21.839 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.36882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38466.log 2023-10-18T17:33:21.839 INFO:teuthology.orchestra.run.smithi158.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36882.log.gz 2023-10-18T17:33:21.840 INFO:teuthology.orchestra.run.smithi183.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-18T17:33:21.841 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.40157.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40157.log.gz 2023-10-18T17:33:21.841 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37431.log 2023-10-18T17:33:21.841 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36909.log 2023-10-18T17:33:21.842 INFO:teuthology.orchestra.run.smithi158.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38466.log.gz 2023-10-18T17:33:21.843 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37431.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37431.log.gz 2023-10-18T17:33:21.844 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40049.log 2023-10-18T17:33:21.845 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.36909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37269.log 2023-10-18T17:33:21.845 INFO:teuthology.orchestra.run.smithi158.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36909.log.gz 2023-10-18T17:33:21.846 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.40049.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.40049.log.gz 2023-10-18T17:33:21.846 INFO:teuthology.orchestra.run.smithi158.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.38385.log 2023-10-18T17:33:21.847 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37269.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37269.log.gz 2023-10-18T17:33:21.847 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37836.log 2023-10-18T17:33:21.849 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38385.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38385.log.gz 2023-10-18T17:33:21.849 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37944.log 2023-10-18T17:33:21.851 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39667.log 2023-10-18T17:33:21.851 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37836.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37836.log.gz/var/log/ceph/ceph-client.admin.37944.log: 2023-10-18T17:33:21.852 INFO:teuthology.orchestra.run.smithi158.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37944.log.gz 2023-10-18T17:33:21.852 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38027.log 2023-10-18T17:33:21.854 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39667.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39667.log.gz 2023-10-18T17:33:21.854 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38958.log 2023-10-18T17:33:21.858 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38027.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38027.log.gz 2023-10-18T17:33:21.858 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39450.log 2023-10-18T17:33:21.858 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38958.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38958.log.gz 2023-10-18T17:33:21.858 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37566.log 2023-10-18T17:33:21.859 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38711.log 2023-10-18T17:33:21.860 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39450.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39450.log.gz 2023-10-18T17:33:21.860 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38576.log 2023-10-18T17:33:21.861 INFO:teuthology.orchestra.run.smithi158.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37566.log.gz 2023-10-18T17:33:21.861 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38711.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38711.log.gz 2023-10-18T17:33:21.862 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39504.log 2023-10-18T17:33:21.863 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39858.log 2023-10-18T17:33:21.864 INFO:teuthology.orchestra.run.smithi158.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38576.log.gz 2023-10-18T17:33:21.865 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39504.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-18T17:33:21.865 INFO:teuthology.orchestra.run.smithi158.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39504.log.gz 2023-10-18T17:33:21.866 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38219.log 2023-10-18T17:33:21.866 INFO:teuthology.orchestra.run.smithi158.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39858.log.gz 2023-10-18T17:33:21.867 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37728.log 2023-10-18T17:33:21.868 INFO:teuthology.orchestra.run.smithi183.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-18T17:33:21.869 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38219.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38219.log.gz 2023-10-18T17:33:21.869 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38740.log 2023-10-18T17:33:21.870 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37728.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37728.log.gz 2023-10-18T17:33:21.870 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37323.log 2023-10-18T17:33:21.871 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40213.log 2023-10-18T17:33:21.872 INFO:teuthology.orchestra.run.smithi158.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38740.log.gz 2023-10-18T17:33:21.873 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37323.log: gzip -5 87.7%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.37323.log.gz/var/log/ceph/ceph-client.admin.38522.log 2023-10-18T17:33:21.873 INFO:teuthology.orchestra.run.smithi158.stderr: 2023-10-18T17:33:21.874 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.40213.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40213.log.gz 2023-10-18T17:33:21.874 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36660.log 2023-10-18T17:33:21.875 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39723.log 2023-10-18T17:33:21.876 INFO:teuthology.orchestra.run.smithi158.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38522.log.gz 2023-10-18T17:33:21.877 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.36660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39613.log 2023-10-18T17:33:21.877 INFO:teuthology.orchestra.run.smithi158.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36660.log.gz 2023-10-18T17:33:21.878 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37674.log 2023-10-18T17:33:21.879 INFO:teuthology.orchestra.run.smithi158.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39723.log.gz 2023-10-18T17:33:21.880 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39804.log 2023-10-18T17:33:21.880 INFO:teuthology.orchestra.run.smithi158.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39613.log.gz 2023-10-18T17:33:21.881 INFO:teuthology.orchestra.run.smithi183.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-18T17:33:21.881 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38821.log 2023-10-18T17:33:21.881 INFO:teuthology.orchestra.run.smithi158.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37674.log.gz 2023-10-18T17:33:21.882 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39093.log 2023-10-18T17:33:21.883 INFO:teuthology.orchestra.run.smithi158.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39804.log.gz 2023-10-18T17:33:21.883 INFO:teuthology.orchestra.run.smithi183.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-18T17:33:21.885 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39121.log 2023-10-18T17:33:21.885 INFO:teuthology.orchestra.run.smithi158.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38821.log.gz 2023-10-18T17:33:21.885 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39093.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39093.log.gz 2023-10-18T17:33:21.885 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38684.log 2023-10-18T17:33:21.887 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37701.log 88.9% 2023-10-18T17:33:21.887 INFO:teuthology.orchestra.run.smithi158.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39121.log.gz 2023-10-18T17:33:21.887 INFO:teuthology.orchestra.run.smithi183.stderr: 2023-10-18T17:33:21.888 INFO:teuthology.orchestra.run.smithi183.stderr:real 0m0.205s 2023-10-18T17:33:21.888 INFO:teuthology.orchestra.run.smithi183.stderr:user 0m0.935s 2023-10-18T17:33:21.888 INFO:teuthology.orchestra.run.smithi183.stderr:sys 0m0.063s 2023-10-18T17:33:21.892 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38684.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38684.log.gz 2023-10-18T17:33:21.893 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38330.log 2023-10-18T17:33:21.893 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37701.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37701.log.gz 2023-10-18T17:33:21.893 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39831.log 2023-10-18T17:33:21.893 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38330.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38330.log.gz 2023-10-18T17:33:21.893 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39912.log 2023-10-18T17:33:21.894 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39831.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39831.log.gz 2023-10-18T17:33:21.894 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37863.log 2023-10-18T17:33:21.894 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39912.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39912.log.gz 2023-10-18T17:33:21.894 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39176.log 2023-10-18T17:33:21.896 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37863.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37863.log.gz 2023-10-18T17:33:21.896 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37024.log 2023-10-18T17:33:21.896 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39176.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39176.log.gz 2023-10-18T17:33:21.896 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39532.log 2023-10-18T17:33:21.896 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37024.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37024.log.gz 2023-10-18T17:33:21.897 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37159.log 2023-10-18T17:33:21.897 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39532.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39532.log.gz 2023-10-18T17:33:21.898 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37132.log 2023-10-18T17:33:21.898 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37159.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37159.log.gz 2023-10-18T17:33:21.898 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37105.log 2023-10-18T17:33:21.899 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37620.log 2023-10-18T17:33:21.900 INFO:teuthology.orchestra.run.smithi158.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37132.log.gz 2023-10-18T17:33:21.901 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37105.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37105.log.gz 2023-10-18T17:33:21.901 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36771.log 2023-10-18T17:33:21.902 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37620.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-18T17:33:21.902 INFO:teuthology.orchestra.run.smithi158.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37620.log.gz 2023-10-18T17:33:21.904 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.36771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39995.log 2023-10-18T17:33:21.904 INFO:teuthology.orchestra.run.smithi158.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36771.log.gz 2023-10-18T17:33:21.905 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38902.log 2023-10-18T17:33:21.906 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39995.log: 87.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-18T17:33:21.906 INFO:teuthology.orchestra.run.smithi158.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39995.log.gz 2023-10-18T17:33:21.907 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37188.log 2023-10-18T17:33:21.908 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38549.log 2023-10-18T17:33:21.908 INFO:teuthology.orchestra.run.smithi158.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38902.log.gz 2023-10-18T17:33:21.909 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39066.log 2023-10-18T17:33:21.910 INFO:teuthology.orchestra.run.smithi158.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37188.log.gz 2023-10-18T17:33:21.911 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38054.log 2023-10-18T17:33:21.911 INFO:teuthology.orchestra.run.smithi158.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38549.log.gz 2023-10-18T17:33:21.912 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39066.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39066.log.gz 2023-10-18T17:33:21.913 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-18T17:33:21.914 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38054.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38054.log.gz 2023-10-18T17:33:21.915 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39559.log 2023-10-18T17:33:21.916 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38357.log 2023-10-18T17:33:21.916 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39559.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39559.log.gz 2023-10-18T17:33:21.917 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39968.log 2023-10-18T17:33:21.918 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40186.log 2023-10-18T17:33:21.919 INFO:teuthology.orchestra.run.smithi158.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38357.log.gz 2023-10-18T17:33:21.920 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39968.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39968.log.gz 2023-10-18T17:33:21.920 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40103.log 2023-10-18T17:33:21.921 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.40186.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40186.log.gz 2023-10-18T17:33:21.922 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37078.log 2023-10-18T17:33:21.923 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38657.log 2023-10-18T17:33:21.923 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.40103.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40103.log.gz 2023-10-18T17:33:21.925 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37078.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37078.log.gz 2023-10-18T17:33:21.925 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38875.log 2023-10-18T17:33:21.926 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38657.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38657.log.gz 2023-10-18T17:33:21.926 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37485.log 2023-10-18T17:33:21.927 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39477.log 2023-10-18T17:33:21.927 INFO:teuthology.orchestra.run.smithi158.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38875.log.gz 2023-10-18T17:33:21.929 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37485.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37485.log.gz 2023-10-18T17:33:21.929 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38081.log 2023-10-18T17:33:21.931 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38767.log 2023-10-18T17:33:21.931 INFO:teuthology.orchestra.run.smithi158.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39477.log.gz 2023-10-18T17:33:21.932 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38081.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38081.log.gz 2023-10-18T17:33:21.932 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39777.log 2023-10-18T17:33:21.933 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38767.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-18T17:33:21.934 INFO:teuthology.orchestra.run.smithi158.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38767.log.gz 2023-10-18T17:33:21.935 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39777.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39777.log.gz 2023-10-18T17:33:21.935 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38985.log 2023-10-18T17:33:21.936 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38162.log 2023-10-18T17:33:21.938 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37890.log 2023-10-18T17:33:21.938 INFO:teuthology.orchestra.run.smithi158.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38985.log.gz 2023-10-18T17:33:21.939 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37593.log 2023-10-18T17:33:21.940 INFO:teuthology.orchestra.run.smithi158.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38162.log.gz 2023-10-18T17:33:21.941 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33192.log 2023-10-18T17:33:21.941 INFO:teuthology.orchestra.run.smithi158.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37890.log.gz 2023-10-18T17:33:21.942 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37404.log 2023-10-18T17:33:21.942 INFO:teuthology.orchestra.run.smithi158.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37593.log.gz 2023-10-18T17:33:21.944 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.33192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36744.log 2023-10-18T17:33:21.944 INFO:teuthology.orchestra.run.smithi158.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33192.log.gz 2023-10-18T17:33:21.945 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.37404.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-18T17:33:21.946 INFO:teuthology.orchestra.run.smithi158.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37404.log.gz 2023-10-18T17:33:21.947 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.36744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38794.log 2023-10-18T17:33:21.947 INFO:teuthology.orchestra.run.smithi158.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36744.log.gz 2023-10-18T17:33:21.948 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39696.log 2023-10-18T17:33:21.950 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.38794.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38794.log.gz 2023-10-18T17:33:21.951 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.39696.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39696.log.gz 2023-10-18T17:33:21.983 INFO:teuthology.orchestra.run.smithi158.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-18T17:33:22.013 INFO:teuthology.orchestra.run.smithi158.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-18T17:33:22.047 INFO:teuthology.orchestra.run.smithi158.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-18T17:33:22.073 INFO:teuthology.orchestra.run.smithi158.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-18T17:33:22.075 INFO:teuthology.orchestra.run.smithi158.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-18T17:33:22.079 INFO:teuthology.orchestra.run.smithi158.stderr: 2023-10-18T17:33:22.079 INFO:teuthology.orchestra.run.smithi158.stderr:real 0m0.397s 2023-10-18T17:33:22.080 INFO:teuthology.orchestra.run.smithi158.stderr:user 0m0.887s 2023-10-18T17:33:22.080 INFO:teuthology.orchestra.run.smithi158.stderr:sys 0m0.457s 2023-10-18T17:33:22.081 INFO:tasks.ceph:Archiving logs... 2023-10-18T17:33:22.081 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429128/remote/smithi158/log 2023-10-18T17:33:22.083 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-18T17:33:22.327 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429128/remote/smithi183/log 2023-10-18T17:33:22.328 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-18T17:33:22.465 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1905, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1482, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3166, in wait_until_healthy while self.get_mon_health()['status'] != 'HEALTH_OK': File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3158, in get_mon_health out = self.raw_cluster_cmd('health', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1911, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2286, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2520, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2023-10-18T17:33:22.538 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=10e5ae29a921482c9744920e25418f7f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1905, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1482, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3166, in wait_until_healthy while self.get_mon_health()['status'] != 'HEALTH_OK': File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3158, in get_mon_health out = self.raw_cluster_cmd('health', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1911, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2286, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 2520, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1600, in raw_cluster_cmd p = self.run_cluster_cmd(args=args, stdout=stdout, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 1593, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2023-10-18T17:33:22.545 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-18T17:33:22.558 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-18T17:33:22.584 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-18T17:33:22.585 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-18T17:33:22.599 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-18T17:33:22.677 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-18T17:33:22.686 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-18T17:33:22.686 DEBUG:teuthology.orchestra.run.smithi158:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T17:33:22.694 DEBUG:teuthology.orchestra.run.smithi183:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T17:33:22.718 INFO:teuthology.orchestra.run.smithi183.stdout: remote refid st t when poll reach delay offset jitter 2023-10-18T17:33:22.718 INFO:teuthology.orchestra.run.smithi183.stdout:============================================================================== 2023-10-18T17:33:22.718 INFO:teuthology.orchestra.run.smithi183.stdout:*hv01.front.sepi 67.205.162.81 3 u 12 64 377 0.052 -3.228 0.318 2023-10-18T17:33:22.719 INFO:teuthology.orchestra.run.smithi183.stdout:+hv02.front.sepi 63.231.80.2 3 u 12 64 377 0.077 1.807 0.207 2023-10-18T17:33:22.719 INFO:teuthology.orchestra.run.smithi183.stdout:+hv03.front.sepi 74.6.168.72 3 u 2 64 377 0.123 0.704 0.356 2023-10-18T17:33:22.719 INFO:teuthology.orchestra.run.smithi183.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 0.000 0.000 2023-10-18T17:33:22.726 INFO:teuthology.orchestra.run.smithi158.stdout: remote refid st t when poll reach delay offset jitter 2023-10-18T17:33:22.726 INFO:teuthology.orchestra.run.smithi158.stdout:============================================================================== 2023-10-18T17:33:22.727 INFO:teuthology.orchestra.run.smithi158.stdout:+hv01.front.sepi 67.205.162.81 3 u 11 64 377 0.081 -3.187 2.753 2023-10-18T17:33:22.727 INFO:teuthology.orchestra.run.smithi158.stdout:*hv02.front.sepi 63.231.80.2 3 u 11 64 377 0.088 5.512 2.885 2023-10-18T17:33:22.727 INFO:teuthology.orchestra.run.smithi158.stdout:+hv03.front.sepi 74.6.168.72 3 u 16 64 377 0.112 3.864 2.211 2023-10-18T17:33:22.727 INFO:teuthology.orchestra.run.smithi158.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 0.000 0.000 2023-10-18T17:33:22.728 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-18T17:33:22.741 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-18T17:33:22.742 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-18T17:33:22.750 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-18T17:33:22.758 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-18T17:33:22.766 INFO:teuthology.task.internal:Duration was 1275.607795 seconds 2023-10-18T17:33:22.766 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-18T17:33:22.776 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-18T17:33:22.776 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-18T17:33:22.783 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-18T17:33:22.925 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-18T17:33:22.926 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi158.front.sepia.ceph.com 2023-10-18T17:33:22.927 DEBUG:teuthology.orchestra.run.smithi158:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-18T17:33:22.960 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi183.front.sepia.ceph.com 2023-10-18T17:33:22.960 DEBUG:teuthology.orchestra.run.smithi183:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-18T17:33:22.977 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-18T17:33:22.977 DEBUG:teuthology.orchestra.run.smithi158:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-18T17:33:23.009 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-18T17:33:23.061 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-18T17:33:23.062 DEBUG:teuthology.orchestra.run.smithi158:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-18T17:33:23.069 DEBUG:teuthology.orchestra.run.smithi183:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-18T17:33:23.155 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-18T17:33:23.167 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-18T17:33:23.168 DEBUG:teuthology.orchestra.run.smithi158:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-18T17:33:23.207 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-18T17:33:23.224 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-18T17:33:23.234 DEBUG:teuthology.orchestra.run.smithi158:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-18T17:33:23.257 DEBUG:teuthology.orchestra.run.smithi183:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-18T17:33:23.281 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = core 2023-10-18T17:33:23.285 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern = core 2023-10-18T17:33:23.379 DEBUG:teuthology.orchestra.run.smithi158:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-18T17:33:23.440 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi158.front.sepia.ceph.com, flagging run as failed 2023-10-18T17:33:23.441 DEBUG:teuthology.orchestra.run.smithi183:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-18T17:33:23.447 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi183.front.sepia.ceph.com, flagging run as failed 2023-10-18T17:33:23.448 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-18T17:33:23.457 INFO:teuthology.task.internal:Transferring archived files... 2023-10-18T17:33:23.458 DEBUG:teuthology.misc:Transferring archived files from smithi158:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429128/remote/smithi158 2023-10-18T17:33:23.460 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-18T17:33:47.631 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2023-10-18T17:33:47.641 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429128/remote/smithi158/coredump/1697649920.36662.core.gz: gzip compressed data, was "1697649920.36662.core", last modified: Wed Oct 18 17:33:39 2023, max compression, original size modulo 2^32 299319296 2023-10-18T17:33:47.642 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2023-10-18T17:33:48.781 INFO:teuthology.task.internal: core looks like: /tmp/tmpwsecv5ra: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i e', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-mds', platform: 'x86_64' 2023-10-18T17:33:48.812 INFO:teuthology.task.internal: dump_program: ceph-mds -f --cluster ceph -i e 2023-10-18T17:33:48.813 DEBUG:teuthology.orchestra.run.smithi158:> which 'ceph-mds -f --cluster ceph -i e' 2023-10-18T17:33:48.832 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T17:33:48.833 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 1: "which 'ceph-mds -f --cluster ceph -i e'" 2023-10-18T17:33:48.840 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-18T17:33:48.851 INFO:teuthology.task.internal:Not uploading archives. 2023-10-18T17:33:48.851 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-18T17:33:48.872 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-18T17:33:48.873 DEBUG:teuthology.orchestra.run.smithi158:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-18T17:33:48.883 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-18T17:33:48.891 INFO:teuthology.orchestra.run.smithi183.stdout: 1048602 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 18 17:33 /home/ubuntu/cephtest 2023-10-18T17:33:48.892 INFO:teuthology.orchestra.run.smithi183.stdout: 1048603 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Oct 18 17:12 /home/ubuntu/cephtest/archive 2023-10-18T17:33:48.892 INFO:teuthology.orchestra.run.smithi183.stdout: 1048619 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 18 17:33 /home/ubuntu/cephtest/archive/syslog 2023-10-18T17:33:48.893 INFO:teuthology.orchestra.run.smithi183.stdout: 1049359 4 -rw-rw-rw- 1 ubuntu ubuntu 567 Oct 18 17:33 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-10-18T17:33:48.893 INFO:teuthology.orchestra.run.smithi183.stdout: 1048620 84 -rw-rw-rw- 1 ubuntu ubuntu 83090 Oct 18 17:33 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-10-18T17:33:48.893 INFO:teuthology.orchestra.run.smithi183.stdout: 1048621 96 -rw-rw-r-- 1 ubuntu ubuntu 96931 Oct 18 17:33 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-18T17:33:48.893 INFO:teuthology.orchestra.run.smithi183.stdout: 1048618 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 18 17:25 /home/ubuntu/cephtest/archive/coredump 2023-10-18T17:33:48.894 INFO:teuthology.orchestra.run.smithi183.stdout: 1050551 13616 -rw------- 1 root root 299307008 Oct 18 17:25 /home/ubuntu/cephtest/archive/coredump/1697649950.37299.core 2023-10-18T17:33:48.894 INFO:teuthology.orchestra.run.smithi183.stdout: 1050550 13344 -rw------- 1 root root 299315200 Oct 18 17:25 /home/ubuntu/cephtest/archive/coredump/1697649935.37300.core 2023-10-18T17:33:48.894 INFO:teuthology.orchestra.run.smithi183.stdout: 1050549 12444 -rw------- 1 root root 299315200 Oct 18 17:24 /home/ubuntu/cephtest/archive/coredump/1697649890.37298.core 2023-10-18T17:33:48.895 INFO:teuthology.orchestra.run.smithi183.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-18T17:33:48.899 INFO:teuthology.orchestra.run.smithi158.stdout: 1048601 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 18 17:33 /home/ubuntu/cephtest 2023-10-18T17:33:48.899 INFO:teuthology.orchestra.run.smithi158.stdout: 1053530 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Oct 18 17:12 /home/ubuntu/cephtest/archive 2023-10-18T17:33:48.900 INFO:teuthology.orchestra.run.smithi158.stdout: 1053533 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 18 17:33 /home/ubuntu/cephtest/archive/syslog 2023-10-18T17:33:48.900 INFO:teuthology.orchestra.run.smithi158.stdout: 1048620 4 -rw-rw-rw- 1 ubuntu ubuntu 1879 Oct 18 17:33 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-10-18T17:33:48.900 INFO:teuthology.orchestra.run.smithi158.stdout: 1053534 88 -rw-rw-rw- 1 ubuntu ubuntu 87158 Oct 18 17:33 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-10-18T17:33:48.901 INFO:teuthology.orchestra.run.smithi158.stdout: 1053535 100 -rw-rw-r-- 1 ubuntu ubuntu 100682 Oct 18 17:33 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-18T17:33:48.901 INFO:teuthology.orchestra.run.smithi158.stdout: 1053531 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 18 17:25 /home/ubuntu/cephtest/archive/coredump 2023-10-18T17:33:48.901 INFO:teuthology.orchestra.run.smithi158.stdout: 1066527 12272 -rw------- 1 root root 299319296 Oct 18 17:24 /home/ubuntu/cephtest/archive/coredump/1697649844.36661.core 2023-10-18T17:33:48.901 INFO:teuthology.orchestra.run.smithi158.stdout: 1066573 13628 -rw------- 1 root root 299315200 Oct 18 17:25 /home/ubuntu/cephtest/archive/coredump/1697649905.36663.core 2023-10-18T17:33:48.902 INFO:teuthology.orchestra.run.smithi158.stdout: 1066579 13688 -rw------- 1 root root 299319296 Oct 18 17:25 /home/ubuntu/cephtest/archive/coredump/1697649920.36662.core 2023-10-18T17:33:48.903 INFO:teuthology.orchestra.run.smithi158.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-18T17:33:48.905 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T17:33:48.905 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 1: "which 'ceph-mds -f --cluster ceph -i e'" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi158 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-18T17:33:48.913 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-18T17:33:48.924 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-18T17:33:48.933 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi158 with status 1: "which 'ceph-mds -f --cluster ceph -i e'" 2023-10-18T17:33:48.934 INFO:teuthology.nuke:Checking targets against current locks 2023-10-18T17:33:48.964 DEBUG:teuthology.nuke:shortname: smithi158 2023-10-18T17:33:48.964 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T17:33:48.991 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429128', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 16:57:50.031855', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-18T17:33:48.994 DEBUG:teuthology.nuke:shortname: smithi183 2023-10-18T17:33:48.994 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T17:33:49.016 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429128', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 16:57:50.033954', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-18T17:33:49.045 INFO:teuthology.orchestra.console.smithi158:Power off 2023-10-18T17:33:49.046 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T17:33:49.068 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2023-10-18T17:33:49.076 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T17:33:49.092 INFO:teuthology.orchestra.console.smithi183:Power off 2023-10-18T17:33:49.093 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T17:33:49.104 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-10-18T17:33:49.117 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-10-18T17:33:49.117 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T17:33:49.140 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-18T17:33:53.105 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T17:33:53.143 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T17:33:53.216 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-10-18T17:33:53.254 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-18T17:33:57.222 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T17:33:57.256 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T17:33:57.333 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-10-18T17:33:57.368 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-18T17:33:57.469 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-10-18T17:34:01.338 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T17:34:01.451 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-10-18T17:34:01.552 INFO:teuthology.orchestra.console.smithi158:Power off completed 2023-10-18T17:34:01.658 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 description: fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/snaps}} duration: 1275.6077947616577 failure_reason: '"2023-10-18T17:24:50.516443+0000 mon.a (mon.0) 179 : cluster [WRN] Replacing daemon mds.c as rank 0 with standby daemon mds.d" in cluster log' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=10e5ae29a921482c9744920e25418f7f status: fail success: false 2023-10-18T17:34:01.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T17:34:01.756 INFO:teuthology.run:FAIL